2024-04-19T03:21:52.965 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T03:21:52.965 DEBUG:teuthology.run:Teuthology command: teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907 --name teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi --verbose -- /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/orig.config.yaml 2024-04-19T03:21:52.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T03:21:53.083 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7662907' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: rhel os_version: '8.6' overrides: admin_socket: branch: reef ceph: conf: global: osd_pg_log_dups_tracked: 10000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 2879 sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOzduFsuMMOkcxCvYjbzE/HRyBKUnw+tU/zvOtJi0DuBG8kdGBuFWJzEC9Qgy63eXWCRe0rCzHUkimJU7MgkAI= smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfEZMEnSgPHS/+BOHdD2oFGmCDoziS7reSa5TTXZVPk8RYqntJy99gI70G/bqF22yoRVVRfKMYcwL53vGFCZDo= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0hKG5eyrNjtcTKxO929j5vBVQ60t5fX4e6cIVrL4Q7F2HRJPCqp4Iti8uZOa5uvnIlQwIHxl9k6yJETWaVS0Y= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG3xWBnZcXzlonvH63RiQHp+wW/V64a6ahACt9k11UqI6LJGuUEZnYtO9xdk3fYZMvol5yxFci3asSYlOVcwoxU= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-18_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-19T03:21:53.083 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa; will attempt to use it 2024-04-19T03:21:53.084 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa/tasks 2024-04-19T03:21:53.084 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-19T03:21:53.085 INFO:teuthology.task.internal:Checking packages... 2024-04-19T03:21:53.109 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '646b8c7d293d8ec31a40c69f7b3237b19c1be24d' 2024-04-19T03:21:53.110 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-19T03:21:53.110 INFO:teuthology.packaging:ref: None 2024-04-19T03:21:53.110 INFO:teuthology.packaging:tag: None 2024-04-19T03:21:53.110 INFO:teuthology.packaging:branch: reef 2024-04-19T03:21:53.110 INFO:teuthology.packaging:sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:21:53.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-19T03:21:53.354 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1237.g646b8c7d 2024-04-19T03:21:53.356 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-19T03:21:53.363 INFO:teuthology.task.internal:no buildpackages task found 2024-04-19T03:21:53.363 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-19T03:21:53.410 INFO:teuthology.task.internal:Saving configuration 2024-04-19T03:21:53.422 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-19T03:21:53.443 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-19T03:21:53.468 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 03:16:35.270538', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOzduFsuMMOkcxCvYjbzE/HRyBKUnw+tU/zvOtJi0DuBG8kdGBuFWJzEC9Qgy63eXWCRe0rCzHUkimJU7MgkAI='} 2024-04-19T03:21:53.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 03:16:35.272289', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfEZMEnSgPHS/+BOHdD2oFGmCDoziS7reSa5TTXZVPk8RYqntJy99gI70G/bqF22yoRVVRfKMYcwL53vGFCZDo='} 2024-04-19T03:21:53.515 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 03:16:35.273343', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0hKG5eyrNjtcTKxO929j5vBVQ60t5fX4e6cIVrL4Q7F2HRJPCqp4Iti8uZOa5uvnIlQwIHxl9k6yJETWaVS0Y='} 2024-04-19T03:21:53.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 03:16:35.274378', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG3xWBnZcXzlonvH63RiQHp+wW/V64a6ahACt9k11UqI6LJGuUEZnYtO9xdk3fYZMvol5yxFci3asSYlOVcwoxU='} 2024-04-19T03:21:53.538 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-19T03:21:53.545 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-19T03:21:53.545 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['osd.0'] 2024-04-19T03:21:53.545 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['osd.1'] 2024-04-19T03:21:53.545 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['osd.2'] 2024-04-19T03:21:53.546 INFO:teuthology.run_tasks:Running task console_log... 2024-04-19T03:21:53.708 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f820ea720d0>, signals=[15]) 2024-04-19T03:21:53.709 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-19T03:21:53.716 INFO:teuthology.task.internal:Opening connections... 2024-04-19T03:21:53.716 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-04-19T03:21:53.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:21:53.799 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-04-19T03:21:53.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:21:53.881 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-04-19T03:21:53.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:21:53.953 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-04-19T03:21:53.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:21:54.030 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-19T03:21:54.037 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-04-19T03:21:54.060 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-04-19T03:21:54.060 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-04-19T03:21:54.120 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2024-04-19T03:21:54.120 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-19T03:21:54.121 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-19T03:21:54.122 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-04-19T03:21:54.152 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-04-19T03:21:54.174 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-04-19T03:21:54.174 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-19T03:21:54.235 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2024-04-19T03:21:54.235 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2024-04-19T03:21:54.235 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2024-04-19T03:21:54.235 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2024-04-19T03:21:54.235 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2024-04-19T03:21:54.235 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2024-04-19T03:21:54.235 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-19T03:21:54.235 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-04-19T03:21:54.236 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-19T03:21:54.236 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2024-04-19T03:21:54.236 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-19T03:21:54.236 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T03:21:54.236 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:21:54.236 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T03:21:54.236 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-19T03:21:54.236 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-19T03:21:54.236 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-19T03:21:54.236 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-19T03:21:54.260 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-04-19T03:21:54.281 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-04-19T03:21:54.282 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-04-19T03:21:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Red Hat Enterprise Linux" 2024-04-19T03:21:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8.6 (Ootpa)" 2024-04-19T03:21:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:ID="rhel" 2024-04-19T03:21:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="fedora" 2024-04-19T03:21:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8.6" 2024-04-19T03:21:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2024-04-19T03:21:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-19T03:21:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-04-19T03:21:54.342 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-19T03:21:54.343 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.redhat.com/" 2024-04-19T03:21:54.343 INFO:teuthology.orchestra.run.smithi087.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-19T03:21:54.343 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T03:21:54.343 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:21:54.343 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T03:21:54.343 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-19T03:21:54.343 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-19T03:21:54.343 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-19T03:21:54.343 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-04-19T03:21:54.369 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-04-19T03:21:54.389 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-04-19T03:21:54.390 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-04-19T03:21:54.446 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8.6 (Ootpa)" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8.6" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2024-04-19T03:21:54.447 INFO:teuthology.orchestra.run.smithi129.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-19T03:21:54.448 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T03:21:54.448 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:21:54.448 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-19T03:21:54.448 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-19T03:21:54.448 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-19T03:21:54.448 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-19T03:21:54.448 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-04-19T03:21:54.477 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-19T03:21:54.488 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-19T03:21:54.527 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-19T03:21:54.527 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-04-19T03:21:54.530 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-04-19T03:21:54.532 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-04-19T03:21:54.534 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-04-19T03:21:54.553 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-19T03:21:54.559 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-19T03:21:54.560 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-04-19T03:21:54.590 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-04-19T03:21:54.592 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-04-19T03:21:54.595 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-04-19T03:21:54.625 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-19T03:21:54.723 INFO:teuthology.run_tasks:Running task kernel... 2024-04-19T03:21:54.737 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-19T03:21:54.738 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-19T03:21:54.738 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T03:21:54.738 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T03:21:54.739 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T03:21:54.739 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T03:21:54.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:21:54.758 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-04-19T03:21:54.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:21:54.759 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-04-19T03:21:54.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:21:54.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:21:54.761 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-04-19T03:21:54.761 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-19T03:21:54.817 INFO:teuthology.orchestra.run.smithi129.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:21:54.818 INFO:teuthology.task.kernel:Running kernel on smithi129: 4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:21:54.818 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum install -y kernel 2024-04-19T03:21:54.819 INFO:teuthology.orchestra.run.smithi087.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:21:54.819 INFO:teuthology.task.kernel:Running kernel on smithi087: 4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:21:54.819 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2024-04-19T03:21:54.822 INFO:teuthology.orchestra.run.smithi057.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:21:54.822 INFO:teuthology.task.kernel:Running kernel on smithi057: 4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:21:54.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum install -y kernel 2024-04-19T03:21:54.823 INFO:teuthology.orchestra.run.smithi005.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:21:54.823 INFO:teuthology.task.kernel:Running kernel on smithi005: 4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:21:54.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-04-19T03:21:56.418 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2024-04-19T03:21:56.418 INFO:teuthology.orchestra.run.smithi057.stdout:Unable to read consumer identity 2024-04-19T03:21:56.419 INFO:teuthology.orchestra.run.smithi129.stdout:Updating Subscription Management repositories. 2024-04-19T03:21:56.419 INFO:teuthology.orchestra.run.smithi129.stdout:Unable to read consumer identity 2024-04-19T03:21:56.426 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-04-19T03:21:56.426 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2024-04-19T03:21:56.433 INFO:teuthology.orchestra.run.smithi087.stdout:Updating Subscription Management repositories. 2024-04-19T03:21:56.433 INFO:teuthology.orchestra.run.smithi087.stdout:Unable to read consumer identity 2024-04-19T03:21:56.680 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:21:56.680 INFO:teuthology.orchestra.run.smithi129.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:21:56.681 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:21:56.741 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:21:56.741 INFO:teuthology.orchestra.run.smithi057.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:21:56.741 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:21:56.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:21:56.758 INFO:teuthology.orchestra.run.smithi005.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:21:56.759 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:21:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:21:56.767 INFO:teuthology.orchestra.run.smithi087.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:21:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:21:58.480 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-19T03:21:58.507 INFO:teuthology.orchestra.run.smithi129.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2024-04-19T03:21:58.518 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-04-19T03:21:58.619 INFO:teuthology.orchestra.run.smithi087.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2024-04-19T03:21:59.243 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2024-04-19T03:21:59.502 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2024-04-19T03:22:00.138 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2024-04-19T03:22:00.918 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 6.9 MB/s | 16 MB 00:02 2024-04-19T03:22:02.891 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 457 kB/s | 24 kB 00:00 2024-04-19T03:22:03.127 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 320 kB/s | 24 kB 00:00 2024-04-19T03:22:03.661 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-19T03:22:03.661 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-19T03:22:03.751 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-04-19T03:22:03.752 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-04-19T03:22:03.752 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-04-19T03:22:03.855 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-19T03:22:03.855 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-19T03:22:03.911 DEBUG:teuthology.orchestra.run.smithi129:> echo no | sudo yum reinstall kernel || true 2024-04-19T03:22:03.932 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-04-19T03:22:03.933 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-04-19T03:22:03.933 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-04-19T03:22:04.094 DEBUG:teuthology.orchestra.run.smithi087:> echo no | sudo yum reinstall kernel || true 2024-04-19T03:22:04.180 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 529 kB/s | 24 kB 00:00 2024-04-19T03:22:04.245 INFO:teuthology.orchestra.run.smithi129.stdout:Updating Subscription Management repositories. 2024-04-19T03:22:04.245 INFO:teuthology.orchestra.run.smithi129.stdout:Unable to read consumer identity 2024-04-19T03:22:04.373 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:22:04.373 INFO:teuthology.orchestra.run.smithi129.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:22:04.373 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:22:04.429 INFO:teuthology.orchestra.run.smithi087.stdout:Updating Subscription Management repositories. 2024-04-19T03:22:04.429 INFO:teuthology.orchestra.run.smithi087.stdout:Unable to read consumer identity 2024-04-19T03:22:04.615 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:22:04.616 INFO:teuthology.orchestra.run.smithi087.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:22:04.616 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:22:04.681 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:02 ago on Fri 19 Apr 2024 03:22:02 AM UTC. 2024-04-19T03:22:04.749 INFO:teuthology.orchestra.run.smithi129.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-19T03:22:04.757 INFO:teuthology.orchestra.run.smithi129.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-19T03:22:04.802 INFO:teuthology.orchestra.run.smithi129.stderr:Error: No packages marked for reinstall. 2024-04-19T03:22:04.850 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum reinstall -y kernel || true 2024-04-19T03:22:04.924 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-19T03:22:04.925 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-19T03:22:04.933 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:01 ago on Fri 19 Apr 2024 03:22:03 AM UTC. 2024-04-19T03:22:05.002 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-19T03:22:05.003 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-19T03:22:05.003 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-19T03:22:05.004 INFO:teuthology.orchestra.run.smithi087.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-19T03:22:05.010 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 428 kB/s | 24 kB 00:00 2024-04-19T03:22:05.012 INFO:teuthology.orchestra.run.smithi087.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-19T03:22:05.065 INFO:teuthology.orchestra.run.smithi087.stderr:Error: No packages marked for reinstall. 2024-04-19T03:22:05.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum reinstall -y kernel || true 2024-04-19T03:22:05.184 INFO:teuthology.orchestra.run.smithi129.stdout:Updating Subscription Management repositories. 2024-04-19T03:22:05.184 INFO:teuthology.orchestra.run.smithi129.stdout:Unable to read consumer identity 2024-04-19T03:22:05.187 DEBUG:teuthology.orchestra.run.smithi057:> echo no | sudo yum reinstall kernel || true 2024-04-19T03:22:05.446 INFO:teuthology.orchestra.run.smithi087.stdout:Updating Subscription Management repositories. 2024-04-19T03:22:05.446 INFO:teuthology.orchestra.run.smithi087.stdout:Unable to read consumer identity 2024-04-19T03:22:05.469 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:22:05.469 INFO:teuthology.orchestra.run.smithi129.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:22:05.470 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:22:05.576 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2024-04-19T03:22:05.576 INFO:teuthology.orchestra.run.smithi057.stdout:Unable to read consumer identity 2024-04-19T03:22:05.660 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:22:05.661 INFO:teuthology.orchestra.run.smithi087.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:22:05.661 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:22:05.774 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:03 ago on Fri 19 Apr 2024 03:22:02 AM UTC. 2024-04-19T03:22:05.788 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-19T03:22:05.788 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-19T03:22:05.826 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:22:05.826 INFO:teuthology.orchestra.run.smithi057.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:22:05.826 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:22:05.836 INFO:teuthology.orchestra.run.smithi129.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-19T03:22:05.836 INFO:teuthology.orchestra.run.smithi129.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-19T03:22:05.872 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-19T03:22:05.874 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-19T03:22:05.874 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-19T03:22:05.892 INFO:teuthology.orchestra.run.smithi129.stderr:Error: No packages marked for reinstall. 2024-04-19T03:22:05.940 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T03:22:05.961 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:02 ago on Fri 19 Apr 2024 03:22:03 AM UTC. 2024-04-19T03:22:06.022 INFO:teuthology.orchestra.run.smithi087.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-19T03:22:06.022 INFO:teuthology.orchestra.run.smithi087.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-19T03:22:06.029 DEBUG:teuthology.orchestra.run.smithi005:> echo no | sudo yum reinstall kernel || true 2024-04-19T03:22:06.059 INFO:teuthology.orchestra.run.smithi087.stderr:Error: No packages marked for reinstall. 2024-04-19T03:22:06.102 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:22:06.103 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:22:06.103 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-19T03:22:06.103 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-19T03:22:06.103 DEBUG:teuthology.orchestra.run.smithi129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T03:22:06.106 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T03:22:06.141 INFO:teuthology.orchestra.run.smithi129.stdout:ttyS1 2024-04-19T03:22:06.157 DEBUG:teuthology.parallel:result is None 2024-04-19T03:22:06.195 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:02 ago on Fri 19 Apr 2024 03:22:04 AM UTC. 2024-04-19T03:22:06.256 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:22:06.256 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:22:06.256 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-19T03:22:06.256 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-19T03:22:06.257 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T03:22:06.290 INFO:teuthology.orchestra.run.smithi057.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-19T03:22:06.290 INFO:teuthology.orchestra.run.smithi057.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-19T03:22:06.304 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-04-19T03:22:06.319 DEBUG:teuthology.parallel:result is None 2024-04-19T03:22:06.337 INFO:teuthology.orchestra.run.smithi057.stderr:Error: No packages marked for reinstall. 2024-04-19T03:22:06.394 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum reinstall -y kernel || true 2024-04-19T03:22:06.413 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-04-19T03:22:06.414 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2024-04-19T03:22:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:22:06.669 INFO:teuthology.orchestra.run.smithi005.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:22:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:22:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2024-04-19T03:22:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:Unable to read consumer identity 2024-04-19T03:22:06.976 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:22:06.976 INFO:teuthology.orchestra.run.smithi057.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:22:06.976 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:22:07.035 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:03 ago on Fri 19 Apr 2024 03:22:04 AM UTC. 2024-04-19T03:22:07.134 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-19T03:22:07.136 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-19T03:22:07.179 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2024-04-19T03:22:07.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum reinstall -y kernel || true 2024-04-19T03:22:07.328 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:03 ago on Fri 19 Apr 2024 03:22:04 AM UTC. 2024-04-19T03:22:07.402 INFO:teuthology.orchestra.run.smithi057.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-19T03:22:07.402 INFO:teuthology.orchestra.run.smithi057.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-19T03:22:07.436 INFO:teuthology.orchestra.run.smithi057.stderr:Error: No packages marked for reinstall. 2024-04-19T03:22:07.492 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T03:22:07.616 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-04-19T03:22:07.616 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2024-04-19T03:22:07.670 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:22:07.671 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:22:07.671 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-19T03:22:07.671 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-19T03:22:07.671 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T03:22:07.714 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2024-04-19T03:22:07.727 DEBUG:teuthology.parallel:result is None 2024-04-19T03:22:07.915 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:22:07.915 INFO:teuthology.orchestra.run.smithi005.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-19T03:22:07.915 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:22:08.279 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:04 ago on Fri 19 Apr 2024 03:22:04 AM UTC. 2024-04-19T03:22:08.350 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-19T03:22:08.350 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-19T03:22:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2024-04-19T03:22:08.429 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-04-19T03:22:08.599 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:22:08.600 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-19T03:22:08.600 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-19T03:22:08.600 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-19T03:22:08.600 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T03:22:08.638 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-04-19T03:22:08.658 DEBUG:teuthology.parallel:result is None 2024-04-19T03:22:08.658 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-19T03:22:08.762 INFO:teuthology.task.internal:Creating test directory... 2024-04-19T03:22:08.762 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T03:22:08.766 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T03:22:08.771 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T03:22:08.775 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T03:22:08.797 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-19T03:22:08.983 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-19T03:22:09.142 INFO:teuthology.task.internal:Creating archive directory... 2024-04-19T03:22:09.142 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T03:22:09.147 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T03:22:09.151 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T03:22:09.156 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T03:22:09.203 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-19T03:22:09.286 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-19T03:22:09.287 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T03:22:09.292 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T03:22:09.296 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T03:22:09.301 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T03:22:09.335 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T03:22:09.339 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T03:22:09.339 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T03:22:09.347 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T03:22:09.349 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T03:22:09.352 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T03:22:09.353 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T03:22:09.363 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T03:22:09.363 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-19T03:22:09.377 INFO:teuthology.task.internal:Configuring sudo... 2024-04-19T03:22:09.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T03:22:09.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T03:22:09.383 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T03:22:09.397 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T03:22:09.428 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-19T03:22:09.438 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-19T03:22:09.438 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T03:22:09.456 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T03:22:09.458 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T03:22:09.469 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T03:22:09.487 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T03:22:09.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T03:22:09.631 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T03:22:09.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T03:22:09.729 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:22:09.729 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T03:22:09.804 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T03:22:09.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T03:22:09.913 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T03:22:09.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T03:22:10.013 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:22:10.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T03:22:10.088 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T03:22:10.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T03:22:10.203 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T03:22:10.249 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T03:22:10.294 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:22:10.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T03:22:10.363 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T03:22:10.412 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T03:22:10.467 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T03:22:10.553 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T03:22:10.599 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:22:10.599 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T03:22:10.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-04-19T03:22:10.671 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-04-19T03:22:10.674 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-04-19T03:22:10.676 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-04-19T03:22:10.724 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T03:22:10.730 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T03:22:10.733 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T03:22:10.762 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T03:22:11.165 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-19T03:22:11.173 INFO:teuthology.task.internal:Starting timer... 2024-04-19T03:22:11.174 INFO:teuthology.run_tasks:Running task pcp... 2024-04-19T03:22:11.204 INFO:teuthology.run_tasks:Running task selinux... 2024-04-19T03:22:11.253 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-19T03:22:11.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-04-19T03:22:11.324 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-04-19T03:22:11.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2024-04-19T03:22:11.405 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2024-04-19T03:22:11.407 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-04-19T03:22:11.458 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-04-19T03:22:11.460 DEBUG:teuthology.orchestra.run.smithi129:> sudo service auditd rotate 2024-04-19T03:22:11.514 INFO:teuthology.orchestra.run.smithi129.stdout:Rotating logs: 2024-04-19T03:22:11.516 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-19T03:22:11.516 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-04-19T03:22:11.560 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-04-19T03:22:11.561 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2024-04-19T03:22:11.590 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2024-04-19T03:22:11.591 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-04-19T03:22:11.623 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-04-19T03:22:11.624 DEBUG:teuthology.orchestra.run.smithi129:> /usr/sbin/getenforce 2024-04-19T03:22:11.651 INFO:teuthology.orchestra.run.smithi129.stdout:Permissive 2024-04-19T03:22:11.651 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi129.front.sepia.ceph.com': 'permissive'} 2024-04-19T03:22:11.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T03:22:11.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:22:11.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T03:22:11.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:22:11.713 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T03:22:11.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:22:11.741 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T03:22:11.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:22:11.771 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-19T03:22:11.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-04-19T03:22:11.803 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2024-04-19T03:22:11.852 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-04-19T03:22:11.881 DEBUG:teuthology.orchestra.run.smithi129:> sudo /usr/sbin/setenforce permissive 2024-04-19T03:22:11.909 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-19T03:22:11.920 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-19T03:22:11.936 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-19T03:22:11.937 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi057.front.sepia.ceph.com,smithi087.front.sepia.ceph.com,smithi129.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-19T03:32:13.058 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com')] 2024-04-19T03:32:13.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-19T03:32:13.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:32:13.141 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-04-19T03:32:13.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-19T03:32:13.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-19T03:32:13.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:32:13.296 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-19T03:32:13.367 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-19T03:32:13.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-19T03:32:13.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:32:13.440 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-04-19T03:32:13.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-19T03:32:13.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-19T03:32:13.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:32:13.584 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-04-19T03:32:13.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-19T03:32:13.655 INFO:teuthology.run_tasks:Running task clock... 2024-04-19T03:32:13.666 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-19T03:32:13.666 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T03:32:13.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:32:13.672 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T03:32:13.673 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:32:13.675 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T03:32:13.675 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:32:13.677 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T03:32:13.678 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:32:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T03:32:13.714 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T03:32:13.714 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T03:32:13.729 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-19T03:32:13.729 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T03:32:13.730 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T03:32:13.732 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T03:32:13.744 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-19T03:32:13.800 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-04-19T03:32:13.803 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-04-19T03:32:13.812 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-04-19T03:32:13.816 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2024-04-19T03:32:13.818 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-04-19T03:32:13.825 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: ntpd: command not found 2024-04-19T03:32:13.827 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T03:32:13.831 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2024-04-19T03:32:13.835 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T03:32:13.837 INFO:teuthology.orchestra.run.smithi129.stdout:506 Cannot talk to daemon 2024-04-19T03:32:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T03:32:13.849 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T03:32:13.851 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-19T03:32:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T03:32:13.866 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T03:32:13.866 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-19T03:32:13.911 INFO:teuthology.orchestra.run.smithi087.stderr:bash: ntpq: command not found 2024-04-19T03:32:13.915 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T03:32:13.915 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-04-19T03:32:13.915 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.915 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.915 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.915 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.938 INFO:teuthology.orchestra.run.smithi129.stderr:bash: ntpq: command not found 2024-04-19T03:32:13.938 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2024-04-19T03:32:13.941 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T03:32:13.941 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-04-19T03:32:13.941 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.942 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.942 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.942 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.943 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T03:32:13.943 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-04-19T03:32:13.943 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.943 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.943 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.943 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.944 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2024-04-19T03:32:13.948 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T03:32:13.948 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-04-19T03:32:13.948 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.948 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.949 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.949 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:32:13.949 INFO:teuthology.run_tasks:Running task install... 2024-04-19T03:32:13.959 DEBUG:teuthology.task.install:project ceph 2024-04-19T03:32:13.959 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T03:32:13.959 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'} 2024-04-19T03:32:13.959 INFO:teuthology.task.install:Using flavor: default 2024-04-19T03:32:13.964 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-19T03:32:13.965 INFO:teuthology.task.install:extra packages: [] 2024-04-19T03:32:13.965 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T03:32:13.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:32:13.967 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T03:32:13.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:32:13.968 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T03:32:13.968 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:32:13.969 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'tag': None, 'wait_for_package': False} 2024-04-19T03:32:13.970 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:32:14.116 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T03:32:14.116 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T03:32:14.121 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T03:32:14.121 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T03:32:14.192 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T03:32:14.192 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T03:32:14.195 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/ 2024-04-19T03:32:14.195 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1237.g646b8c7d 2024-04-19T03:32:14.240 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T03:32:14.241 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:32:14.241 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T03:32:14.272 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-19T03:32:14.272 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T03:32:14.292 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T03:32:14.292 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:32:14.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T03:32:14.302 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T03:32:14.302 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:32:14.302 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T03:32:14.328 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-19T03:32:14.328 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T03:32:14.330 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-19T03:32:14.330 DEBUG:teuthology.orchestra.run.smithi129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T03:32:14.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T03:32:14.360 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-19T03:32:14.360 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:32:14.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-19T03:32:14.397 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-19T03:32:14.397 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-19T03:32:14.398 DEBUG:teuthology.orchestra.run.smithi129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T03:32:14.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T03:32:14.420 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T03:32:14.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-19T03:32:14.476 DEBUG:teuthology.orchestra.run.smithi129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T03:32:14.487 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-04-19T03:32:14.488 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-04-19T03:32:14.491 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T03:32:14.522 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-04-19T03:32:14.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-04-19T03:32:14.543 INFO:teuthology.orchestra.run.smithi129.stdout:check_obsoletes = 1 2024-04-19T03:32:14.544 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum clean all 2024-04-19T03:32:14.561 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-19T03:32:14.593 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-04-19T03:32:14.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-04-19T03:32:14.865 INFO:teuthology.orchestra.run.smithi087.stdout:Updating Subscription Management repositories. 2024-04-19T03:32:14.922 INFO:teuthology.orchestra.run.smithi129.stdout:Updating Subscription Management repositories. 2024-04-19T03:32:14.959 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2024-04-19T03:32:15.029 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-04-19T03:32:15.388 INFO:teuthology.orchestra.run.smithi087.stdout:63 files removed 2024-04-19T03:32:15.435 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-19T03:32:15.443 INFO:teuthology.orchestra.run.smithi129.stdout:63 files removed 2024-04-19T03:32:15.487 INFO:teuthology.orchestra.run.smithi057.stdout:63 files removed 2024-04-19T03:32:15.491 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-19T03:32:15.512 INFO:teuthology.orchestra.run.smithi005.stdout:63 files removed 2024-04-19T03:32:15.542 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-19T03:32:15.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-19T03:32:15.768 INFO:teuthology.orchestra.run.smithi087.stdout:Updating Subscription Management repositories. 2024-04-19T03:32:15.828 INFO:teuthology.orchestra.run.smithi129.stdout:Updating Subscription Management repositories. 2024-04-19T03:32:15.927 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2024-04-19T03:32:15.951 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-04-19T03:32:16.626 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 313 kB/s | 80 kB 00:00 2024-04-19T03:32:16.843 INFO:teuthology.orchestra.run.smithi129.stdout:ceph packages for x86_64 205 kB/s | 80 kB 00:00 2024-04-19T03:32:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 250 kB/s | 80 kB 00:00 2024-04-19T03:32:16.970 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 237 kB/s | 80 kB 00:00 2024-04-19T03:32:17.153 INFO:teuthology.orchestra.run.smithi129.stdout:ceph noarch packages 42 kB/s | 11 kB 00:00 2024-04-19T03:32:17.230 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 20 kB/s | 11 kB 00:00 2024-04-19T03:32:17.274 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-04-19T03:32:17.312 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 38 kB/s | 11 kB 00:00 2024-04-19T03:32:17.429 INFO:teuthology.orchestra.run.smithi129.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2024-04-19T03:32:17.552 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2024-04-19T03:32:17.561 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 5.8 kB/s | 1.5 kB 00:00 2024-04-19T03:32:17.621 INFO:teuthology.orchestra.run.smithi129.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-04-19T03:32:17.673 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2024-04-19T03:32:17.711 INFO:teuthology.orchestra.run.smithi087.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-19T03:32:17.725 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-19T03:32:17.797 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-19T03:32:18.372 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2024-04-19T03:32:18.618 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2024-04-19T03:32:18.662 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-04-19T03:32:19.531 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 16 MB 00:01 2024-04-19T03:32:21.972 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 425 kB/s | 24 kB 00:00 2024-04-19T03:32:22.238 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 540 kB/s | 24 kB 00:00 2024-04-19T03:32:22.710 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 441 kB/s | 24 kB 00:00 2024-04-19T03:32:22.923 INFO:teuthology.orchestra.run.smithi087.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-04-19T03:32:23.324 INFO:teuthology.orchestra.run.smithi129.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 60 MB 00:01 2024-04-19T03:32:23.539 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 436 kB/s | 24 kB 00:00 2024-04-19T03:32:24.041 INFO:teuthology.orchestra.run.smithi057.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 21 MB/s | 8.8 MB 00:00 2024-04-19T03:32:24.287 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 MB/s | 67 MB 00:01 2024-04-19T03:32:25.574 INFO:teuthology.orchestra.run.smithi087.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 67 MB 00:01 2024-04-19T03:32:26.876 INFO:teuthology.orchestra.run.smithi057.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 60 MB 00:01 2024-04-19T03:32:34.467 INFO:teuthology.orchestra.run.smithi129.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 67 MB 00:01 2024-04-19T03:32:35.638 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 26 MB/s | 8.8 MB 00:00 2024-04-19T03:32:36.242 INFO:teuthology.orchestra.run.smithi087.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 60 MB 00:01 2024-04-19T03:32:38.781 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 60 MB 00:01 2024-04-19T03:32:39.301 INFO:teuthology.orchestra.run.smithi057.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 67 MB 00:01 2024-04-19T03:32:44.734 INFO:teuthology.orchestra.run.smithi129.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 24 MB/s | 8.8 MB 00:00 2024-04-19T03:32:51.614 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T03:32:51.615 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T03:32:51.840 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-04-19T03:32:51.853 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================================================================== 2024-04-19T03:32:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-04-19T03:32:51.853 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================================================================== 2024-04-19T03:32:51.853 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-04-19T03:32:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-19T03:32:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T03:32:51.853 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T03:32:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T03:32:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T03:32:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T03:32:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T03:32:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T03:32:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T03:32:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T03:32:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T03:32:51.854 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-19T03:32:51.855 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-19T03:32:51.856 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-04-19T03:32:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-19T03:32:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-19T03:32:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-19T03:32:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-19T03:32:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-19T03:32:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T03:32:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T03:32:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-19T03:32:51.857 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T03:32:51.858 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T03:32:51.859 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-19T03:32:51.860 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T03:32:51.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T03:32:51.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-19T03:32:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T03:32:51.864 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T03:32:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T03:32:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-19T03:32:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T03:32:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-19T03:32:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T03:32:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-19T03:32:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-19T03:32:51.865 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:32:51.865 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-04-19T03:32:51.866 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================================================================== 2024-04-19T03:32:51.866 INFO:teuthology.orchestra.run.smithi087.stdout:Install 122 Packages 2024-04-19T03:32:51.866 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 14 Packages 2024-04-19T03:32:51.866 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:32:51.866 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 206 M 2024-04-19T03:32:51.866 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-04-19T03:32:51.890 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T03:32:51.891 INFO:teuthology.orchestra.run.smithi129.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T03:32:52.123 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================================================================== 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================================================================== 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T03:32:52.137 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T03:32:52.138 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-19T03:32:52.139 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-19T03:32:52.140 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-19T03:32:52.141 INFO:teuthology.orchestra.run.smithi129.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T03:32:52.142 INFO:teuthology.orchestra.run.smithi129.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T03:32:52.143 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-19T03:32:52.144 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-19T03:32:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T03:32:52.146 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================================================================== 2024-04-19T03:32:52.147 INFO:teuthology.orchestra.run.smithi129.stdout:Install 122 Packages 2024-04-19T03:32:52.148 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 14 Packages 2024-04-19T03:32:52.148 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:32:52.148 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 206 M 2024-04-19T03:32:52.148 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-04-19T03:32:52.292 INFO:teuthology.orchestra.run.smithi087.stdout:(1/136): ceph-18.2.2-1237.g646b8c7d.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2024-04-19T03:32:52.768 INFO:teuthology.orchestra.run.smithi129.stdout:(1/136): ceph-18.2.2-1237.g646b8c7d.el8.x86_64. 15 kB/s | 6.4 kB 00:00 2024-04-19T03:32:54.084 INFO:teuthology.orchestra.run.smithi087.stdout:(2/136): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x8 480 kB/s | 859 kB 00:01 2024-04-19T03:32:54.293 INFO:teuthology.orchestra.run.smithi129.stdout:(2/136): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x8 564 kB/s | 859 kB 00:01 2024-04-19T03:32:54.409 INFO:teuthology.orchestra.run.smithi087.stdout:(3/136): ceph-immutable-object-cache-18.2.2-123 511 kB/s | 166 kB 00:00 2024-04-19T03:32:54.635 INFO:teuthology.orchestra.run.smithi129.stdout:(3/136): ceph-immutable-object-cache-18.2.2-123 486 kB/s | 166 kB 00:00 2024-04-19T03:32:55.379 INFO:teuthology.orchestra.run.smithi129.stdout:(4/136): ceph-base-18.2.2-1237.g646b8c7d.el8.x8 1.8 MB/s | 5.5 MB 00:03 2024-04-19T03:32:55.659 INFO:teuthology.orchestra.run.smithi087.stdout:(4/136): ceph-base-18.2.2-1237.g646b8c7d.el8.x8 1.5 MB/s | 5.5 MB 00:03 2024-04-19T03:32:56.151 INFO:teuthology.orchestra.run.smithi087.stdout:(5/136): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86 3.2 MB/s | 1.6 MB 00:00 2024-04-19T03:32:56.290 INFO:teuthology.orchestra.run.smithi129.stdout:(5/136): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86 1.7 MB/s | 1.6 MB 00:00 2024-04-19T03:32:56.387 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T03:32:56.389 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T03:32:56.654 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================================================================== 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================================================================== 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T03:32:56.669 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T03:32:56.670 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-04-19T03:32:56.671 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-19T03:32:56.672 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-19T03:32:56.673 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T03:32:56.674 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T03:32:56.675 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-19T03:32:56.676 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-19T03:32:56.677 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T03:32:56.678 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================================================================== 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout:Install 122 Packages 2024-04-19T03:32:56.679 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 14 Packages 2024-04-19T03:32:56.680 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:32:56.680 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 206 M 2024-04-19T03:32:56.680 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-19T03:32:56.967 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T03:32:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-19T03:32:57.101 INFO:teuthology.orchestra.run.smithi087.stdout:(6/136): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 5.1 MB/s | 4.8 MB 00:00 2024-04-19T03:32:57.167 INFO:teuthology.orchestra.run.smithi057.stdout:(1/136): ceph-18.2.2-1237.g646b8c7d.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2024-04-19T03:32:57.235 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-19T03:32:57.250 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================================================================== 2024-04-19T03:32:57.250 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-19T03:32:57.250 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================================================================== 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.4 k 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 5.5 M 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 859 k 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 166 k 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 1.6 M 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 138 k 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 3.5 M 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 7.4 M 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 49 k 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 13 M 2024-04-19T03:32:57.251 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 47 M 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 263 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 170 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 31 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 780 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 139 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 197 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 371 k 2024-04-19T03:32:57.252 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 364 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 106 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 95 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.5 M 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 181 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.7 M 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 3.6 M 2024-04-19T03:32:57.253 INFO:teuthology.orchestra.run.smithi005.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 22 M 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 24 k 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 2.3 M 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 245 k 2024-04-19T03:32:57.254 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 4.8 M 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 18 M 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1237.g646b8c7d.el8 ceph-noarch 15 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 24 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 142 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-19T03:32:57.255 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 474 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 6.6 M 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-19T03:32:57.256 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 45 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:18.2.2-1237.g646b8c7d.el8 ceph 129 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-19T03:32:57.257 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-19T03:32:57.258 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-19T03:32:57.259 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-19T03:32:57.260 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-19T03:32:57.261 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:32:57.261 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-19T03:32:57.261 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================================================================== 2024-04-19T03:32:57.261 INFO:teuthology.orchestra.run.smithi005.stdout:Install 122 Packages 2024-04-19T03:32:57.261 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 14 Packages 2024-04-19T03:32:57.261 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:32:57.261 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 206 M 2024-04-19T03:32:57.261 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-19T03:32:57.753 INFO:teuthology.orchestra.run.smithi129.stdout:(6/136): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86 746 kB/s | 2.3 MB 00:03 2024-04-19T03:32:57.805 INFO:teuthology.orchestra.run.smithi005.stdout:(1/136): ceph-18.2.2-1237.g646b8c7d.el8.x86_64. 16 kB/s | 6.4 kB 00:00 2024-04-19T03:32:58.135 INFO:teuthology.orchestra.run.smithi087.stdout:(7/136): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86 624 kB/s | 2.3 MB 00:03 2024-04-19T03:32:58.584 INFO:teuthology.orchestra.run.smithi057.stdout:(2/136): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x8 607 kB/s | 859 kB 00:01 2024-04-19T03:32:58.884 INFO:teuthology.orchestra.run.smithi057.stdout:(3/136): ceph-immutable-object-cache-18.2.2-123 553 kB/s | 166 kB 00:00 2024-04-19T03:32:59.188 INFO:teuthology.orchestra.run.smithi005.stdout:(2/136): ceph-fuse-18.2.2-1237.g646b8c7d.el8.x8 621 kB/s | 859 kB 00:01 2024-04-19T03:32:59.455 INFO:teuthology.orchestra.run.smithi005.stdout:(3/136): ceph-immutable-object-cache-18.2.2-123 623 kB/s | 166 kB 00:00 2024-04-19T03:32:59.628 INFO:teuthology.orchestra.run.smithi129.stdout:(7/136): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 1.4 MB/s | 4.8 MB 00:03 2024-04-19T03:33:01.072 INFO:teuthology.orchestra.run.smithi005.stdout:(4/136): ceph-base-18.2.2-1237.g646b8c7d.el8.x8 1.5 MB/s | 5.5 MB 00:03 2024-04-19T03:33:01.076 INFO:teuthology.orchestra.run.smithi087.stdout:(8/136): ceph-osd-18.2.2-1237.g646b8c7d.el8.x86 4.6 MB/s | 18 MB 00:03 2024-04-19T03:33:01.185 INFO:teuthology.orchestra.run.smithi087.stdout:(9/136): ceph-selinux-18.2.2-1237.g646b8c7d.el8 225 kB/s | 24 kB 00:00 2024-04-19T03:33:01.434 INFO:teuthology.orchestra.run.smithi057.stdout:(4/136): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86 912 kB/s | 2.3 MB 00:02 2024-04-19T03:33:02.006 INFO:teuthology.orchestra.run.smithi005.stdout:(5/136): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86 1.7 MB/s | 1.6 MB 00:00 2024-04-19T03:33:02.423 INFO:teuthology.orchestra.run.smithi005.stdout:(6/136): ceph-mds-18.2.2-1237.g646b8c7d.el8.x86 784 kB/s | 2.3 MB 00:02 2024-04-19T03:33:02.993 INFO:teuthology.orchestra.run.smithi057.stdout:(5/136): ceph-mgr-18.2.2-1237.g646b8c7d.el8.x86 1.0 MB/s | 1.6 MB 00:01 2024-04-19T03:33:03.776 INFO:teuthology.orchestra.run.smithi057.stdout:(6/136): ceph-base-18.2.2-1237.g646b8c7d.el8.x8 812 kB/s | 5.5 MB 00:06 2024-04-19T03:33:04.093 INFO:teuthology.orchestra.run.smithi057.stdout:(7/136): ceph-common-18.2.2-1237.g646b8c7d.el8. 3.0 MB/s | 22 MB 00:07 2024-04-19T03:33:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:(7/136): ceph-common-18.2.2-1237.g646b8c7d.el8. 3.2 MB/s | 22 MB 00:06 2024-04-19T03:33:04.756 INFO:teuthology.orchestra.run.smithi005.stdout:(8/136): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 1.8 MB/s | 4.8 MB 00:02 2024-04-19T03:33:04.856 INFO:teuthology.orchestra.run.smithi005.stdout:(9/136): ceph-selinux-18.2.2-1237.g646b8c7d.el8 244 kB/s | 24 kB 00:00 2024-04-19T03:33:06.976 INFO:teuthology.orchestra.run.smithi057.stdout:(8/136): ceph-mon-18.2.2-1237.g646b8c7d.el8.x86 1.2 MB/s | 4.8 MB 00:03 2024-04-19T03:33:07.085 INFO:teuthology.orchestra.run.smithi057.stdout:(9/136): ceph-selinux-18.2.2-1237.g646b8c7d.el8 225 kB/s | 24 kB 00:00 2024-04-19T03:33:08.392 INFO:teuthology.orchestra.run.smithi057.stdout:(10/136): ceph-radosgw-18.2.2-1237.g646b8c7d.el 3.0 MB/s | 13 MB 00:04 2024-04-19T03:33:08.510 INFO:teuthology.orchestra.run.smithi057.stdout:(11/136): libcephfs-devel-18.2.2-1237.g646b8c7d 263 kB/s | 31 kB 00:00 2024-04-19T03:33:08.690 INFO:teuthology.orchestra.run.smithi005.stdout:(10/136): ceph-radosgw-18.2.2-1237.g646b8c7d.el 2.9 MB/s | 13 MB 00:04 2024-04-19T03:33:08.782 INFO:teuthology.orchestra.run.smithi005.stdout:(11/136): libcephfs-devel-18.2.2-1237.g646b8c7d 338 kB/s | 31 kB 00:00 2024-04-19T03:33:08.936 INFO:teuthology.orchestra.run.smithi057.stdout:(12/136): libcephfs2-18.2.2-1237.g646b8c7d.el8. 1.8 MB/s | 780 kB 00:00 2024-04-19T03:33:08.969 INFO:teuthology.orchestra.run.smithi129.stdout:(8/136): ceph-radosgw-18.2.2-1237.g646b8c7d.el8 1.4 MB/s | 13 MB 00:09 2024-04-19T03:33:09.036 INFO:teuthology.orchestra.run.smithi057.stdout:(13/136): libcephsqlite-18.2.2-1237.g646b8c7d.e 1.4 MB/s | 142 kB 00:00 2024-04-19T03:33:09.060 INFO:teuthology.orchestra.run.smithi087.stdout:(10/136): ceph-radosgw-18.2.2-1237.g646b8c7d.el 1.2 MB/s | 13 MB 00:10 2024-04-19T03:33:09.061 INFO:teuthology.orchestra.run.smithi129.stdout:(9/136): ceph-selinux-18.2.2-1237.g646b8c7d.el8 266 kB/s | 24 kB 00:00 2024-04-19T03:33:09.107 INFO:teuthology.orchestra.run.smithi005.stdout:(12/136): libcephfs2-18.2.2-1237.g646b8c7d.el8. 2.3 MB/s | 780 kB 00:00 2024-04-19T03:33:09.136 INFO:teuthology.orchestra.run.smithi057.stdout:(14/136): librados-devel-18.2.2-1237.g646b8c7d. 1.4 MB/s | 139 kB 00:00 2024-04-19T03:33:09.143 INFO:teuthology.orchestra.run.smithi087.stdout:(11/136): libcephfs-devel-18.2.2-1237.g646b8c7d 373 kB/s | 31 kB 00:00 2024-04-19T03:33:09.199 INFO:teuthology.orchestra.run.smithi005.stdout:(13/136): libcephsqlite-18.2.2-1237.g646b8c7d.e 1.5 MB/s | 142 kB 00:00 2024-04-19T03:33:09.291 INFO:teuthology.orchestra.run.smithi005.stdout:(14/136): librados-devel-18.2.2-1237.g646b8c7d. 1.5 MB/s | 139 kB 00:00 2024-04-19T03:33:09.386 INFO:teuthology.orchestra.run.smithi057.stdout:(15/136): libradosstriper1-18.2.2-1237.g646b8c7 1.9 MB/s | 474 kB 00:00 2024-04-19T03:33:09.491 INFO:teuthology.orchestra.run.smithi005.stdout:(15/136): libradosstriper1-18.2.2-1237.g646b8c7 2.3 MB/s | 474 kB 00:00 2024-04-19T03:33:09.545 INFO:teuthology.orchestra.run.smithi129.stdout:(10/136): ceph-common-18.2.2-1237.g646b8c7d.el8 1.3 MB/s | 22 MB 00:17 2024-04-19T03:33:09.612 INFO:teuthology.orchestra.run.smithi129.stdout:(11/136): libcephfs-devel-18.2.2-1237.g646b8c7d 464 kB/s | 31 kB 00:00 2024-04-19T03:33:09.635 INFO:teuthology.orchestra.run.smithi087.stdout:(12/136): libcephfs2-18.2.2-1237.g646b8c7d.el8. 1.5 MB/s | 780 kB 00:00 2024-04-19T03:33:09.786 INFO:teuthology.orchestra.run.smithi087.stdout:(13/136): libcephsqlite-18.2.2-1237.g646b8c7d.e 945 kB/s | 142 kB 00:00 2024-04-19T03:33:09.961 INFO:teuthology.orchestra.run.smithi087.stdout:(14/136): librados-devel-18.2.2-1237.g646b8c7d. 795 kB/s | 139 kB 00:00 2024-04-19T03:33:10.205 INFO:teuthology.orchestra.run.smithi129.stdout:(12/136): libcephfs2-18.2.2-1237.g646b8c7d.el8. 1.3 MB/s | 780 kB 00:00 2024-04-19T03:33:10.278 INFO:teuthology.orchestra.run.smithi087.stdout:(15/136): libradosstriper1-18.2.2-1237.g646b8c7 1.5 MB/s | 474 kB 00:00 2024-04-19T03:33:10.354 INFO:teuthology.orchestra.run.smithi129.stdout:(13/136): libcephsqlite-18.2.2-1237.g646b8c7d.e 950 kB/s | 142 kB 00:00 2024-04-19T03:33:10.529 INFO:teuthology.orchestra.run.smithi129.stdout:(14/136): librados-devel-18.2.2-1237.g646b8c7d. 795 kB/s | 139 kB 00:00 2024-04-19T03:33:10.893 INFO:teuthology.orchestra.run.smithi129.stdout:(15/136): libradosstriper1-18.2.2-1237.g646b8c7 1.3 MB/s | 474 kB 00:00 2024-04-19T03:33:11.966 INFO:teuthology.orchestra.run.smithi005.stdout:(16/136): librgw2-18.2.2-1237.g646b8c7d.el8.x86 2.6 MB/s | 6.6 MB 00:02 2024-04-19T03:33:12.050 INFO:teuthology.orchestra.run.smithi005.stdout:(17/136): python3-ceph-argparse-18.2.2-1237.g64 538 kB/s | 45 kB 00:00 2024-04-19T03:33:12.175 INFO:teuthology.orchestra.run.smithi005.stdout:(18/136): python3-ceph-common-18.2.2-1237.g646b 1.0 MB/s | 129 kB 00:00 2024-04-19T03:33:12.275 INFO:teuthology.orchestra.run.smithi005.stdout:(19/136): python3-cephfs-18.2.2-1237.g646b8c7d. 1.9 MB/s | 197 kB 00:00 2024-04-19T03:33:12.459 INFO:teuthology.orchestra.run.smithi005.stdout:(20/136): python3-rados-18.2.2-1237.g646b8c7d.e 2.0 MB/s | 371 kB 00:00 2024-04-19T03:33:12.659 INFO:teuthology.orchestra.run.smithi005.stdout:(21/136): python3-rbd-18.2.2-1237.g646b8c7d.el8 1.8 MB/s | 364 kB 00:00 2024-04-19T03:33:12.751 INFO:teuthology.orchestra.run.smithi005.stdout:(22/136): python3-rgw-18.2.2-1237.g646b8c7d.el8 1.1 MB/s | 106 kB 00:00 2024-04-19T03:33:12.835 INFO:teuthology.orchestra.run.smithi005.stdout:(23/136): rbd-fuse-18.2.2-1237.g646b8c7d.el8.x8 1.1 MB/s | 95 kB 00:00 2024-04-19T03:33:13.553 INFO:teuthology.orchestra.run.smithi057.stdout:(16/136): librgw2-18.2.2-1237.g646b8c7d.el8.x86 1.6 MB/s | 6.6 MB 00:04 2024-04-19T03:33:13.669 INFO:teuthology.orchestra.run.smithi057.stdout:(17/136): python3-ceph-argparse-18.2.2-1237.g64 384 kB/s | 45 kB 00:00 2024-04-19T03:33:13.870 INFO:teuthology.orchestra.run.smithi057.stdout:(18/136): python3-ceph-common-18.2.2-1237.g646b 644 kB/s | 129 kB 00:00 2024-04-19T03:33:14.111 INFO:teuthology.orchestra.run.smithi087.stdout:(16/136): librgw2-18.2.2-1237.g646b8c7d.el8.x86 1.7 MB/s | 6.6 MB 00:03 2024-04-19T03:33:14.118 INFO:teuthology.orchestra.run.smithi005.stdout:(24/136): rbd-mirror-18.2.2-1237.g646b8c7d.el8. 2.7 MB/s | 3.5 MB 00:01 2024-04-19T03:33:14.128 INFO:teuthology.orchestra.run.smithi057.stdout:(19/136): python3-cephfs-18.2.2-1237.g646b8c7d. 762 kB/s | 197 kB 00:00 2024-04-19T03:33:14.178 INFO:teuthology.orchestra.run.smithi087.stdout:(17/136): python3-ceph-argparse-18.2.2-1237.g64 674 kB/s | 45 kB 00:00 2024-04-19T03:33:14.202 INFO:teuthology.orchestra.run.smithi005.stdout:(25/136): rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86 2.1 MB/s | 181 kB 00:00 2024-04-19T03:33:14.285 INFO:teuthology.orchestra.run.smithi005.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1237.g 292 kB/s | 24 kB 00:00 2024-04-19T03:33:14.286 INFO:teuthology.orchestra.run.smithi087.stdout:(18/136): python3-ceph-common-18.2.2-1237.g646b 1.2 MB/s | 129 kB 00:00 2024-04-19T03:33:14.330 INFO:teuthology.orchestra.run.smithi129.stdout:(16/136): librgw2-18.2.2-1237.g646b8c7d.el8.x86 1.9 MB/s | 6.6 MB 00:03 2024-04-19T03:33:14.361 INFO:teuthology.orchestra.run.smithi005.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1237.g646b8c7 1.8 MB/s | 138 kB 00:00 2024-04-19T03:33:14.420 INFO:teuthology.orchestra.run.smithi087.stdout:(19/136): python3-cephfs-18.2.2-1237.g646b8c7d. 1.4 MB/s | 197 kB 00:00 2024-04-19T03:33:14.479 INFO:teuthology.orchestra.run.smithi057.stdout:(20/136): python3-rados-18.2.2-1237.g646b8c7d.e 1.0 MB/s | 371 kB 00:00 2024-04-19T03:33:14.505 INFO:teuthology.orchestra.run.smithi129.stdout:(17/136): ceph-osd-18.2.2-1237.g646b8c7d.el8.x8 1.1 MB/s | 18 MB 00:16 2024-04-19T03:33:14.555 INFO:teuthology.orchestra.run.smithi129.stdout:(18/136): python3-ceph-argparse-18.2.2-1237.g64 198 kB/s | 45 kB 00:00 2024-04-19T03:33:14.620 INFO:teuthology.orchestra.run.smithi087.stdout:(20/136): python3-rados-18.2.2-1237.g646b8c7d.e 1.8 MB/s | 371 kB 00:00 2024-04-19T03:33:14.697 INFO:teuthology.orchestra.run.smithi129.stdout:(19/136): python3-cephfs-18.2.2-1237.g646b8c7d. 1.4 MB/s | 197 kB 00:00 2024-04-19T03:33:14.839 INFO:teuthology.orchestra.run.smithi129.stdout:(20/136): python3-ceph-common-18.2.2-1237.g646b 386 kB/s | 129 kB 00:00 2024-04-19T03:33:14.872 INFO:teuthology.orchestra.run.smithi129.stdout:(21/136): python3-rados-18.2.2-1237.g646b8c7d.e 2.1 MB/s | 371 kB 00:00 2024-04-19T03:33:14.902 INFO:teuthology.orchestra.run.smithi057.stdout:(21/136): python3-rbd-18.2.2-1237.g646b8c7d.el8 862 kB/s | 364 kB 00:00 2024-04-19T03:33:14.937 INFO:teuthology.orchestra.run.smithi087.stdout:(21/136): python3-rbd-18.2.2-1237.g646b8c7d.el8 1.1 MB/s | 364 kB 00:00 2024-04-19T03:33:14.956 INFO:teuthology.orchestra.run.smithi129.stdout:(22/136): python3-rgw-18.2.2-1237.g646b8c7d.el8 1.2 MB/s | 106 kB 00:00 2024-04-19T03:33:15.013 INFO:teuthology.orchestra.run.smithi087.stdout:(22/136): python3-rgw-18.2.2-1237.g646b8c7d.el8 1.4 MB/s | 106 kB 00:00 2024-04-19T03:33:15.013 INFO:teuthology.orchestra.run.smithi057.stdout:(22/136): python3-rgw-18.2.2-1237.g646b8c7d.el8 965 kB/s | 106 kB 00:00 2024-04-19T03:33:15.040 INFO:teuthology.orchestra.run.smithi129.stdout:(23/136): rbd-fuse-18.2.2-1237.g646b8c7d.el8.x8 1.1 MB/s | 95 kB 00:00 2024-04-19T03:33:15.121 INFO:teuthology.orchestra.run.smithi087.stdout:(23/136): rbd-fuse-18.2.2-1237.g646b8c7d.el8.x8 879 kB/s | 95 kB 00:00 2024-04-19T03:33:15.130 INFO:teuthology.orchestra.run.smithi057.stdout:(23/136): rbd-fuse-18.2.2-1237.g646b8c7d.el8.x8 816 kB/s | 95 kB 00:00 2024-04-19T03:33:15.294 INFO:teuthology.orchestra.run.smithi005.stdout:(28/136): ceph-mgr-dashboard-18.2.2-1237.g646b8 3.8 MB/s | 3.5 MB 00:00 2024-04-19T03:33:15.340 INFO:teuthology.orchestra.run.smithi129.stdout:(24/136): python3-rbd-18.2.2-1237.g646b8c7d.el8 727 kB/s | 364 kB 00:00 2024-04-19T03:33:15.565 INFO:teuthology.orchestra.run.smithi129.stdout:(25/136): rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86 805 kB/s | 181 kB 00:00 2024-04-19T03:33:15.682 INFO:teuthology.orchestra.run.smithi129.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1237.g 208 kB/s | 24 kB 00:00 2024-04-19T03:33:15.907 INFO:teuthology.orchestra.run.smithi129.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1237.g646b8c7 614 kB/s | 138 kB 00:00 2024-04-19T03:33:16.288 INFO:teuthology.orchestra.run.smithi087.stdout:(24/136): ceph-common-18.2.2-1237.g646b8c7d.el8 915 kB/s | 22 MB 00:24 2024-04-19T03:33:16.308 INFO:teuthology.orchestra.run.smithi129.stdout:(28/136): rbd-mirror-18.2.2-1237.g646b8c7d.el8. 2.7 MB/s | 3.5 MB 00:01 2024-04-19T03:33:16.564 INFO:teuthology.orchestra.run.smithi087.stdout:(25/136): rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86 659 kB/s | 181 kB 00:00 2024-04-19T03:33:16.672 INFO:teuthology.orchestra.run.smithi087.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1237.g 224 kB/s | 24 kB 00:00 2024-04-19T03:33:16.881 INFO:teuthology.orchestra.run.smithi087.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1237.g646b8c7 663 kB/s | 138 kB 00:00 2024-04-19T03:33:16.948 INFO:teuthology.orchestra.run.smithi087.stdout:(28/136): rbd-mirror-18.2.2-1237.g646b8c7d.el8. 1.9 MB/s | 3.5 MB 00:01 2024-04-19T03:33:17.478 INFO:teuthology.orchestra.run.smithi005.stdout:(29/136): ceph-mgr-diskprediction-local-18.2.2- 3.4 MB/s | 7.4 MB 00:02 2024-04-19T03:33:17.570 INFO:teuthology.orchestra.run.smithi005.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1237.g64 2.6 MB/s | 245 kB 00:00 2024-04-19T03:33:17.638 INFO:teuthology.orchestra.run.smithi057.stdout:(24/136): rbd-mirror-18.2.2-1237.g646b8c7d.el8. 1.4 MB/s | 3.5 MB 00:02 2024-04-19T03:33:17.813 INFO:teuthology.orchestra.run.smithi057.stdout:(25/136): rbd-nbd-18.2.2-1237.g646b8c7d.el8.x86 1.0 MB/s | 181 kB 00:00 2024-04-19T03:33:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:(31/136): ceph-osd-18.2.2-1237.g646b8c7d.el8.x8 1.2 MB/s | 18 MB 00:15 2024-04-19T03:33:17.853 INFO:teuthology.orchestra.run.smithi005.stdout:(32/136): ceph-mgr-rook-18.2.2-1237.g646b8c7d.e 173 kB/s | 49 kB 00:00 2024-04-19T03:33:17.913 INFO:teuthology.orchestra.run.smithi057.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1237.g 243 kB/s | 24 kB 00:00 2024-04-19T03:33:17.929 INFO:teuthology.orchestra.run.smithi005.stdout:(33/136): ceph-prometheus-alerts-18.2.2-1237.g6 152 kB/s | 15 kB 00:00 2024-04-19T03:33:18.012 INFO:teuthology.orchestra.run.smithi005.stdout:(34/136): ceph-volume-18.2.2-1237.g646b8c7d.el8 1.6 MB/s | 263 kB 00:00 2024-04-19T03:33:18.080 INFO:teuthology.orchestra.run.smithi057.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1237.g646b8c7 829 kB/s | 138 kB 00:00 2024-04-19T03:33:18.104 INFO:teuthology.orchestra.run.smithi005.stdout:(35/136): cephadm-18.2.2-1237.g646b8c7d.el8.noa 972 kB/s | 170 kB 00:00 2024-04-19T03:33:18.116 INFO:teuthology.orchestra.run.smithi129.stdout:(29/136): ceph-mgr-diskprediction-local-18.2.2- 4.1 MB/s | 7.4 MB 00:01 2024-04-19T03:33:18.208 INFO:teuthology.orchestra.run.smithi129.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1237.g64 2.6 MB/s | 245 kB 00:00 2024-04-19T03:33:18.267 INFO:teuthology.orchestra.run.smithi129.stdout:(31/136): ceph-mgr-rook-18.2.2-1237.g646b8c7d.e 846 kB/s | 49 kB 00:00 2024-04-19T03:33:18.314 INFO:teuthology.orchestra.run.smithi057.stdout:(28/136): ceph-osd-18.2.2-1237.g646b8c7d.el8.x8 1.3 MB/s | 18 MB 00:14 2024-04-19T03:33:18.325 INFO:teuthology.orchestra.run.smithi129.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1237.g6 262 kB/s | 15 kB 00:00 2024-04-19T03:33:18.413 INFO:teuthology.orchestra.run.smithi005.stdout:(36/136): liboath-2.6.2-3.el8.x86_64.rpm 191 kB/s | 59 kB 00:00 2024-04-19T03:33:18.434 INFO:teuthology.orchestra.run.smithi129.stdout:(33/136): ceph-volume-18.2.2-1237.g646b8c7d.el8 2.4 MB/s | 263 kB 00:00 2024-04-19T03:33:18.455 INFO:teuthology.orchestra.run.smithi005.stdout:(37/136): gperftools-libs-2.7-9.el8.x86_64.rpm 692 kB/s | 306 kB 00:00 2024-04-19T03:33:18.509 INFO:teuthology.orchestra.run.smithi129.stdout:(34/136): cephadm-18.2.2-1237.g646b8c7d.el8.noa 2.2 MB/s | 170 kB 00:00 2024-04-19T03:33:18.514 INFO:teuthology.orchestra.run.smithi005.stdout:(38/136): libunwind-1.3.1-3.el8.x86_64.rpm 746 kB/s | 75 kB 00:00 2024-04-19T03:33:18.590 INFO:teuthology.orchestra.run.smithi005.stdout:(39/136): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2024-04-19T03:33:18.601 INFO:teuthology.orchestra.run.smithi129.stdout:(35/136): ceph-mgr-dashboard-18.2.2-1237.g646b8 1.3 MB/s | 3.5 MB 00:02 2024-04-19T03:33:18.614 INFO:teuthology.orchestra.run.smithi005.stdout:(40/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 435 kB/s | 44 kB 00:00 2024-04-19T03:33:18.665 INFO:teuthology.orchestra.run.smithi005.stdout:(41/136): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2024-04-19T03:33:18.690 INFO:teuthology.orchestra.run.smithi005.stdout:(42/136): python3-cachetools-3.1.1-4.el8.noarch 439 kB/s | 33 kB 00:00 2024-04-19T03:33:18.749 INFO:teuthology.orchestra.run.smithi005.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 195 kB/s | 16 kB 00:00 2024-04-19T03:33:18.751 INFO:teuthology.orchestra.run.smithi129.stdout:(36/136): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2024-04-19T03:33:18.777 INFO:teuthology.orchestra.run.smithi129.stdout:(37/136): liboath-2.6.2-3.el8.x86_64.rpm 335 kB/s | 59 kB 00:00 2024-04-19T03:33:18.811 INFO:teuthology.orchestra.run.smithi129.stdout:(38/136): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2024-04-19T03:33:18.824 INFO:teuthology.orchestra.run.smithi005.stdout:(44/136): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2024-04-19T03:33:18.849 INFO:teuthology.orchestra.run.smithi005.stdout:(45/136): python3-cherrypy-18.4.0-1.el8.noarch. 3.8 MB/s | 384 kB 00:00 2024-04-19T03:33:18.894 INFO:teuthology.orchestra.run.smithi129.stdout:(39/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 525 kB/s | 44 kB 00:00 2024-04-19T03:33:18.899 INFO:teuthology.orchestra.run.smithi005.stdout:(46/136): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2024-04-19T03:33:18.925 INFO:teuthology.orchestra.run.smithi005.stdout:(47/136): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2024-04-19T03:33:18.961 INFO:teuthology.orchestra.run.smithi129.stdout:(40/136): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2024-04-19T03:33:18.967 INFO:teuthology.orchestra.run.smithi005.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 263 kB/s | 18 kB 00:00 2024-04-19T03:33:19.012 INFO:teuthology.orchestra.run.smithi129.stdout:(41/136): python3-asyncssh-2.7.0-2.el8.noarch.r 2.0 MB/s | 476 kB 00:00 2024-04-19T03:33:19.033 INFO:teuthology.orchestra.run.smithi005.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 732 kB/s | 49 kB 00:00 2024-04-19T03:33:19.037 INFO:teuthology.orchestra.run.smithi129.stdout:(42/136): python3-cachetools-3.1.1-4.el8.noarch 438 kB/s | 33 kB 00:00 2024-04-19T03:33:19.086 INFO:teuthology.orchestra.run.smithi129.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 222 kB/s | 16 kB 00:00 2024-04-19T03:33:19.101 INFO:teuthology.orchestra.run.smithi005.stdout:(50/136): python3-more-itertools-7.2.0-3.el8.no 883 kB/s | 59 kB 00:00 2024-04-19T03:33:19.121 INFO:teuthology.orchestra.run.smithi129.stdout:(44/136): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2024-04-19T03:33:19.134 INFO:teuthology.orchestra.run.smithi005.stdout:(51/136): python3-kubernetes-11.0.0-6.el8.noarc 5.6 MB/s | 1.2 MB 00:00 2024-04-19T03:33:19.163 INFO:teuthology.orchestra.run.smithi129.stdout:(45/136): python3-cherrypy-18.4.0-1.el8.noarch. 4.9 MB/s | 384 kB 00:00 2024-04-19T03:33:19.180 INFO:teuthology.orchestra.run.smithi129.stdout:(46/136): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2024-04-19T03:33:19.189 INFO:teuthology.orchestra.run.smithi005.stdout:(52/136): python3-natsort-7.1.1-2.el8.noarch.rp 683 kB/s | 60 kB 00:00 2024-04-19T03:33:19.214 INFO:teuthology.orchestra.run.smithi129.stdout:(47/136): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2024-04-19T03:33:19.226 INFO:teuthology.orchestra.run.smithi005.stdout:(53/136): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2024-04-19T03:33:19.239 INFO:teuthology.orchestra.run.smithi129.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 299 kB/s | 18 kB 00:00 2024-04-19T03:33:19.252 INFO:teuthology.orchestra.run.smithi005.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 251 kB/s | 16 kB 00:00 2024-04-19T03:33:19.285 INFO:teuthology.orchestra.run.smithi005.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 575 kB/s | 34 kB 00:00 2024-04-19T03:33:19.323 INFO:teuthology.orchestra.run.smithi129.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 585 kB/s | 49 kB 00:00 2024-04-19T03:33:19.327 INFO:teuthology.orchestra.run.smithi005.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2024-04-19T03:33:19.353 INFO:teuthology.orchestra.run.smithi005.stdout:(57/136): python3-rsa-4.9-2.el8.noarch.rpm 958 kB/s | 64 kB 00:00 2024-04-19T03:33:19.364 INFO:teuthology.orchestra.run.smithi129.stdout:(50/136): python3-kubernetes-11.0.0-6.el8.noarc 7.8 MB/s | 1.2 MB 00:00 2024-04-19T03:33:19.386 INFO:teuthology.orchestra.run.smithi005.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 321 kB/s | 19 kB 00:00 2024-04-19T03:33:19.390 INFO:teuthology.orchestra.run.smithi129.stdout:(51/136): python3-more-itertools-7.2.0-3.el8.no 879 kB/s | 59 kB 00:00 2024-04-19T03:33:19.411 INFO:teuthology.orchestra.run.smithi005.stdout:(59/136): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2024-04-19T03:33:19.415 INFO:teuthology.orchestra.run.smithi129.stdout:(52/136): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2024-04-19T03:33:19.454 INFO:teuthology.orchestra.run.smithi005.stdout:(60/136): python3-tempora-1.14.1-5.el8.noarch.r 436 kB/s | 29 kB 00:00 2024-04-19T03:33:19.465 INFO:teuthology.orchestra.run.smithi129.stdout:(53/136): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2024-04-19T03:33:19.471 INFO:teuthology.orchestra.run.smithi005.stdout:(61/136): python3-trustme-0.6.0-4.el8.noarch.rp 468 kB/s | 27 kB 00:00 2024-04-19T03:33:19.490 INFO:teuthology.orchestra.run.smithi087.stdout:(29/136): ceph-mgr-dashboard-18.2.2-1237.g646b8 1.4 MB/s | 3.5 MB 00:02 2024-04-19T03:33:19.491 INFO:teuthology.orchestra.run.smithi129.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2024-04-19T03:33:19.524 INFO:teuthology.orchestra.run.smithi129.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 574 kB/s | 34 kB 00:00 2024-04-19T03:33:19.537 INFO:teuthology.orchestra.run.smithi005.stdout:(62/136): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-04-19T03:33:19.563 INFO:teuthology.orchestra.run.smithi005.stdout:(63/136): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2024-04-19T03:33:19.573 INFO:teuthology.orchestra.run.smithi087.stdout:(30/136): ceph-mgr-diskprediction-local-18.2.2- 2.8 MB/s | 7.4 MB 00:02 2024-04-19T03:33:19.584 INFO:teuthology.orchestra.run.smithi129.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2024-04-19T03:33:19.608 INFO:teuthology.orchestra.run.smithi129.stdout:(57/136): python3-rsa-4.9-2.el8.noarch.rpm 769 kB/s | 64 kB 00:00 2024-04-19T03:33:19.613 INFO:teuthology.orchestra.run.smithi005.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 815 kB/s | 61 kB 00:00 2024-04-19T03:33:19.625 INFO:teuthology.orchestra.run.smithi129.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 447 kB/s | 19 kB 00:00 2024-04-19T03:33:19.632 INFO:teuthology.orchestra.run.smithi087.stdout:(31/136): ceph-mgr-rook-18.2.2-1237.g646b8c7d.e 848 kB/s | 49 kB 00:00 2024-04-19T03:33:19.651 INFO:teuthology.orchestra.run.smithi129.stdout:(59/136): python3-singledispatch-3.4.0.3-18.el8 572 kB/s | 24 kB 00:00 2024-04-19T03:33:19.659 INFO:teuthology.orchestra.run.smithi005.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 889 kB/s | 85 kB 00:00 2024-04-19T03:33:19.667 INFO:teuthology.orchestra.run.smithi129.stdout:(60/136): python3-tempora-1.14.1-5.el8.noarch.r 695 kB/s | 29 kB 00:00 2024-04-19T03:33:19.689 INFO:teuthology.orchestra.run.smithi005.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2024-04-19T03:33:19.690 INFO:teuthology.orchestra.run.smithi087.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1237.g6 261 kB/s | 15 kB 00:00 2024-04-19T03:33:19.693 INFO:teuthology.orchestra.run.smithi129.stdout:(61/136): python3-trustme-0.6.0-4.el8.noarch.rp 656 kB/s | 27 kB 00:00 2024-04-19T03:33:19.714 INFO:teuthology.orchestra.run.smithi057.stdout:(29/136): ceph-mgr-dashboard-18.2.2-1237.g646b8 2.2 MB/s | 3.5 MB 00:01 2024-04-19T03:33:19.714 INFO:teuthology.orchestra.run.smithi005.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-04-19T03:33:19.727 INFO:teuthology.orchestra.run.smithi129.stdout:(62/136): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2024-04-19T03:33:19.749 INFO:teuthology.orchestra.run.smithi087.stdout:(33/136): ceph-mgr-modules-core-18.2.2-1237.g64 949 kB/s | 245 kB 00:00 2024-04-19T03:33:19.773 INFO:teuthology.orchestra.run.smithi005.stdout:(68/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 308 kB/s | 18 kB 00:00 2024-04-19T03:33:19.796 INFO:teuthology.orchestra.run.smithi129.stdout:(63/136): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2024-04-19T03:33:19.815 INFO:teuthology.orchestra.run.smithi005.stdout:(69/136): thrift-0.13.0-2.el8.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2024-04-19T03:33:19.816 INFO:teuthology.orchestra.run.smithi087.stdout:(34/136): ceph-volume-18.2.2-1237.g646b8c7d.el8 2.1 MB/s | 263 kB 00:00 2024-04-19T03:33:19.829 INFO:teuthology.orchestra.run.smithi129.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 599 kB/s | 61 kB 00:00 2024-04-19T03:33:19.840 INFO:teuthology.orchestra.run.smithi005.stdout:(70/136): python3-jwt-1.6.1-2.el8.noarch.rpm 638 kB/s | 43 kB 00:00 2024-04-19T03:33:19.848 INFO:teuthology.orchestra.run.smithi057.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1237.g64 1.8 MB/s | 245 kB 00:00 2024-04-19T03:33:19.855 INFO:teuthology.orchestra.run.smithi129.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2024-04-19T03:33:19.880 INFO:teuthology.orchestra.run.smithi129.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2024-04-19T03:33:19.890 INFO:teuthology.orchestra.run.smithi005.stdout:(71/136): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2024-04-19T03:33:19.897 INFO:teuthology.orchestra.run.smithi129.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2024-04-19T03:33:19.900 INFO:teuthology.orchestra.run.smithi087.stdout:(35/136): cephadm-18.2.2-1237.g646b8c7d.el8.noa 1.1 MB/s | 170 kB 00:00 2024-04-19T03:33:19.915 INFO:teuthology.orchestra.run.smithi057.stdout:(31/136): ceph-mgr-rook-18.2.2-1237.g646b8c7d.e 739 kB/s | 49 kB 00:00 2024-04-19T03:33:19.916 INFO:teuthology.orchestra.run.smithi005.stdout:(72/136): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-04-19T03:33:19.941 INFO:teuthology.orchestra.run.smithi005.stdout:(73/136): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2024-04-19T03:33:19.956 INFO:teuthology.orchestra.run.smithi129.stdout:(68/136): python3-jsonpointer-1.10-11.el8.noarc 344 kB/s | 20 kB 00:00 2024-04-19T03:33:19.966 INFO:teuthology.orchestra.run.smithi005.stdout:(74/136): libaio-devel-0.3.112-1.el8.x86_64.rpm 373 kB/s | 19 kB 00:00 2024-04-19T03:33:19.990 INFO:teuthology.orchestra.run.smithi057.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1237.g6 203 kB/s | 15 kB 00:00 2024-04-19T03:33:19.991 INFO:teuthology.orchestra.run.smithi005.stdout:(75/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 877 kB/s | 44 kB 00:00 2024-04-19T03:33:20.025 INFO:teuthology.orchestra.run.smithi005.stdout:(76/136): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2024-04-19T03:33:20.033 INFO:teuthology.orchestra.run.smithi129.stdout:(69/136): thrift-0.13.0-2.el8.x86_64.rpm 9.7 MB/s | 1.7 MB 00:00 2024-04-19T03:33:20.050 INFO:teuthology.orchestra.run.smithi005.stdout:(77/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-04-19T03:33:20.064 INFO:teuthology.orchestra.run.smithi129.stdout:(70/136): python3-prettytable-0.7.2-14.el8.noar 405 kB/s | 44 kB 00:00 2024-04-19T03:33:20.076 INFO:teuthology.orchestra.run.smithi005.stdout:(78/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-19T03:33:20.115 INFO:teuthology.orchestra.run.smithi129.stdout:(71/136): python3-jsonpatch-1.21-2.el8.noarch.r 596 kB/s | 27 kB 00:00 2024-04-19T03:33:20.135 INFO:teuthology.orchestra.run.smithi005.stdout:(79/136): libselinux-devel-2.9-5.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2024-04-19T03:33:20.140 INFO:teuthology.orchestra.run.smithi057.stdout:(33/136): ceph-volume-18.2.2-1237.g646b8c7d.el8 1.7 MB/s | 263 kB 00:00 2024-04-19T03:33:20.140 INFO:teuthology.orchestra.run.smithi129.stdout:(72/136): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2024-04-19T03:33:20.160 INFO:teuthology.orchestra.run.smithi005.stdout:(80/136): keyutils-libs-devel-1.5.10-9.el8.x86_ 575 kB/s | 48 kB 00:00 2024-04-19T03:33:20.165 INFO:teuthology.orchestra.run.smithi129.stdout:(73/136): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2024-04-19T03:33:20.185 INFO:teuthology.orchestra.run.smithi005.stdout:(81/136): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-04-19T03:33:20.199 INFO:teuthology.orchestra.run.smithi129.stdout:(74/136): python3-werkzeug-0.12.2-4.el8.noarch. 7.6 MB/s | 457 kB 00:00 2024-04-19T03:33:20.222 INFO:teuthology.orchestra.run.smithi005.stdout:(82/136): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-04-19T03:33:20.244 INFO:teuthology.orchestra.run.smithi005.stdout:(83/136): libcom_err-devel-1.45.6-4.el8.x86_64. 660 kB/s | 39 kB 00:00 2024-04-19T03:33:20.262 INFO:teuthology.orchestra.run.smithi129.stdout:(75/136): bison-3.0.4-10.el8.x86_64.rpm 7.0 MB/s | 688 kB 00:00 2024-04-19T03:33:20.269 INFO:teuthology.orchestra.run.smithi005.stdout:(84/136): fuse-2.9.7-17.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-04-19T03:33:20.281 INFO:teuthology.orchestra.run.smithi087.stdout:(36/136): liboath-2.6.2-3.el8.x86_64.rpm 154 kB/s | 59 kB 00:00 2024-04-19T03:33:20.290 INFO:teuthology.orchestra.run.smithi057.stdout:(34/136): cephadm-18.2.2-1237.g646b8c7d.el8.noa 1.1 MB/s | 170 kB 00:00 2024-04-19T03:33:20.291 INFO:teuthology.orchestra.run.smithi129.stdout:(76/136): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2024-04-19T03:33:20.305 INFO:teuthology.orchestra.run.smithi005.stdout:(85/136): libgfortran-8.5.0-20.el8.x86_64.rpm 11 MB/s | 645 kB 00:00 2024-04-19T03:33:20.325 INFO:teuthology.orchestra.run.smithi129.stdout:(77/136): libtool-2.4.6-25.el8.x86_64.rpm 11 MB/s | 709 kB 00:00 2024-04-19T03:33:20.328 INFO:teuthology.orchestra.run.smithi005.stdout:(86/136): libquadmath-8.5.0-20.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2024-04-19T03:33:20.350 INFO:teuthology.orchestra.run.smithi129.stdout:(78/136): python3-markupsafe-0.23-19.el8.x86_64 663 kB/s | 39 kB 00:00 2024-04-19T03:33:20.353 INFO:teuthology.orchestra.run.smithi005.stdout:(87/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2024-04-19T03:33:20.370 INFO:teuthology.orchestra.run.smithi005.stdout:(88/136): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.7 MB/s | 73 kB 00:00 2024-04-19T03:33:20.376 INFO:teuthology.orchestra.run.smithi129.stdout:(79/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2024-04-19T03:33:20.393 INFO:teuthology.orchestra.run.smithi129.stdout:(80/136): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2024-04-19T03:33:20.396 INFO:teuthology.orchestra.run.smithi005.stdout:(89/136): elfutils-libelf-devel-0.189-3.el8.x86 1.4 MB/s | 62 kB 00:00 2024-04-19T03:33:20.408 INFO:teuthology.orchestra.run.smithi087.stdout:(37/136): gperftools-libs-2.7-9.el8.x86_64.rpm 517 kB/s | 306 kB 00:00 2024-04-19T03:33:20.429 INFO:teuthology.orchestra.run.smithi005.stdout:(90/136): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 9.4 MB/s | 562 kB 00:00 2024-04-19T03:33:20.432 INFO:teuthology.orchestra.run.smithi057.stdout:(35/136): ceph-mgr-diskprediction-local-18.2.2- 3.5 MB/s | 7.4 MB 00:02 2024-04-19T03:33:20.443 INFO:teuthology.orchestra.run.smithi129.stdout:(81/136): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2024-04-19T03:33:20.471 INFO:teuthology.orchestra.run.smithi005.stdout:(91/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-19T03:33:20.507 INFO:teuthology.orchestra.run.smithi057.stdout:(36/136): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2024-04-19T03:33:20.530 INFO:teuthology.orchestra.run.smithi005.stdout:(92/136): openssl-devel-1.1.1k-12.el8_9.x86_64. 17 MB/s | 2.3 MB 00:00 2024-04-19T03:33:20.543 INFO:teuthology.orchestra.run.smithi129.stdout:(82/136): python3-babel-2.5.1-7.el8.noarch.rpm 29 MB/s | 4.8 MB 00:00 2024-04-19T03:33:20.557 INFO:teuthology.orchestra.run.smithi057.stdout:(37/136): liboath-2.6.2-3.el8.x86_64.rpm 473 kB/s | 59 kB 00:00 2024-04-19T03:33:20.585 INFO:teuthology.orchestra.run.smithi129.stdout:(83/136): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2024-04-19T03:33:20.591 INFO:teuthology.orchestra.run.smithi057.stdout:(38/136): libunwind-1.3.1-3.el8.x86_64.rpm 900 kB/s | 75 kB 00:00 2024-04-19T03:33:20.598 INFO:teuthology.orchestra.run.smithi005.stdout:(93/136): python3-cryptography-3.2.1-7.el8_9.x8 4.3 MB/s | 559 kB 00:00 2024-04-19T03:33:20.625 INFO:teuthology.orchestra.run.smithi057.stdout:(39/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2024-04-19T03:33:20.631 INFO:teuthology.orchestra.run.smithi005.stdout:(94/136): libuuid-devel-2.32.1-44.el8_9.1.x86_6 991 kB/s | 100 kB 00:00 2024-04-19T03:33:20.634 INFO:teuthology.orchestra.run.smithi087.stdout:(38/136): libunwind-1.3.1-3.el8.x86_64.rpm 213 kB/s | 75 kB 00:00 2024-04-19T03:33:20.644 INFO:teuthology.orchestra.run.smithi129.stdout:(84/136): python3-numpy-1.14.3-10.el8.x86_64.rp 19 MB/s | 3.7 MB 00:00 2024-04-19T03:33:20.648 INFO:teuthology.orchestra.run.smithi005.stdout:(95/136): python3-packaging-16.8-9.el8.noarch.r 983 kB/s | 48 kB 00:00 2024-04-19T03:33:20.665 INFO:teuthology.orchestra.run.smithi005.stdout:(96/136): python3-jsonpointer-1.10-11.el8.noarc 597 kB/s | 20 kB 00:00 2024-04-19T03:33:20.669 INFO:teuthology.orchestra.run.smithi129.stdout:(85/136): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.6 MB/s | 225 kB 00:00 2024-04-19T03:33:20.682 INFO:teuthology.orchestra.run.smithi005.stdout:(97/136): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2024-04-19T03:33:20.683 INFO:teuthology.orchestra.run.smithi057.stdout:(40/136): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2024-04-19T03:33:20.699 INFO:teuthology.orchestra.run.smithi005.stdout:(98/136): python3-pyasn1-modules-0.3.7-6.el8.no 3.2 MB/s | 110 kB 00:00 2024-04-19T03:33:20.709 INFO:teuthology.orchestra.run.smithi057.stdout:(41/136): python3-asyncssh-2.7.0-2.el8.noarch.r 3.1 MB/s | 476 kB 00:00 2024-04-19T03:33:20.724 INFO:teuthology.orchestra.run.smithi005.stdout:(99/136): python3-jsonpatch-1.21-2.el8.noarch.r 633 kB/s | 27 kB 00:00 2024-04-19T03:33:20.734 INFO:teuthology.orchestra.run.smithi057.stdout:(42/136): python3-cachetools-3.1.1-4.el8.noarch 658 kB/s | 33 kB 00:00 2024-04-19T03:33:20.736 INFO:teuthology.orchestra.run.smithi129.stdout:(86/136): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2024-04-19T03:33:20.749 INFO:teuthology.orchestra.run.smithi005.stdout:(100/136): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2024-04-19T03:33:20.760 INFO:teuthology.orchestra.run.smithi057.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2024-04-19T03:33:20.778 INFO:teuthology.orchestra.run.smithi129.stdout:(87/136): python3-mako-1.0.6-14.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2024-04-19T03:33:20.783 INFO:teuthology.orchestra.run.smithi005.stdout:(101/136): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2024-04-19T03:33:20.785 INFO:teuthology.orchestra.run.smithi057.stdout:(44/136): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2024-04-19T03:33:20.825 INFO:teuthology.orchestra.run.smithi005.stdout:(102/136): bison-3.0.4-10.el8.x86_64.rpm 9.0 MB/s | 688 kB 00:00 2024-04-19T03:33:20.858 INFO:teuthology.orchestra.run.smithi005.stdout:(103/136): flex-2.6.1-9.el8.x86_64.rpm 4.1 MB/s | 320 kB 00:00 2024-04-19T03:33:20.868 INFO:teuthology.orchestra.run.smithi057.stdout:(45/136): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2024-04-19T03:33:20.878 INFO:teuthology.orchestra.run.smithi129.stdout:(88/136): openblas-threads-0.3.15-6.el8.x86_64. 25 MB/s | 5.2 MB 00:00 2024-04-19T03:33:20.885 INFO:teuthology.orchestra.run.smithi057.stdout:(46/136): python3-google-auth-1.1.1-10.el8.noar 811 kB/s | 81 kB 00:00 2024-04-19T03:33:20.892 INFO:teuthology.orchestra.run.smithi005.stdout:(104/136): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2024-04-19T03:33:20.911 INFO:teuthology.orchestra.run.smithi057.stdout:(47/136): python3-jaraco-6.2-6.el8.noarch.rpm 266 kB/s | 11 kB 00:00 2024-04-19T03:33:20.917 INFO:teuthology.orchestra.run.smithi005.stdout:(105/136): python3-markupsafe-0.23-19.el8.x86_6 666 kB/s | 39 kB 00:00 2024-04-19T03:33:20.936 INFO:teuthology.orchestra.run.smithi057.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2024-04-19T03:33:20.943 INFO:teuthology.orchestra.run.smithi005.stdout:(106/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2024-04-19T03:33:20.968 INFO:teuthology.orchestra.run.smithi005.stdout:(107/136): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2024-04-19T03:33:20.970 INFO:teuthology.orchestra.run.smithi129.stdout:(89/136): automake-1.16.1-8.el8.noarch.rpm 7.6 MB/s | 714 kB 00:00 2024-04-19T03:33:20.978 INFO:teuthology.orchestra.run.smithi057.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 1.2 MB/s | 49 kB 00:00 2024-04-19T03:33:20.992 INFO:teuthology.orchestra.run.smithi087.stdout:(39/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 122 kB/s | 44 kB 00:00 2024-04-19T03:33:21.018 INFO:teuthology.orchestra.run.smithi005.stdout:(108/136): python3-jinja2-2.10.1-3.el8.noarch.r 11 MB/s | 538 kB 00:00 2024-04-19T03:33:21.020 INFO:teuthology.orchestra.run.smithi057.stdout:(50/136): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2024-04-19T03:33:21.039 INFO:teuthology.orchestra.run.smithi129.stdout:(90/136): openblas-0.3.15-6.el8.x86_64.rpm 19 MB/s | 5.0 MB 00:00 2024-04-19T03:33:21.043 INFO:teuthology.orchestra.run.smithi087.stdout:(40/136): python3-asyncssh-2.7.0-2.el8.noarch.r 750 kB/s | 476 kB 00:00 2024-04-19T03:33:21.062 INFO:teuthology.orchestra.run.smithi057.stdout:(51/136): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2024-04-19T03:33:21.062 INFO:teuthology.orchestra.run.smithi129.stdout:(91/136): jq-1.6-7.el8.x86_64.rpm 2.2 MB/s | 202 kB 00:00 2024-04-19T03:33:21.088 INFO:teuthology.orchestra.run.smithi129.stdout:(92/136): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2024-04-19T03:33:21.135 INFO:teuthology.orchestra.run.smithi005.stdout:(109/136): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2024-04-19T03:33:21.160 INFO:teuthology.orchestra.run.smithi129.stdout:(93/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 2.6 MB/s | 188 kB 00:00 2024-04-19T03:33:21.162 INFO:teuthology.orchestra.run.smithi057.stdout:(52/136): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2024-04-19T03:33:21.205 INFO:teuthology.orchestra.run.smithi129.stdout:(94/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 397 kB/s | 18 kB 00:00 2024-04-19T03:33:21.212 INFO:teuthology.orchestra.run.smithi057.stdout:(53/136): python3-kubernetes-11.0.0-6.el8.noarc 3.9 MB/s | 1.2 MB 00:00 2024-04-19T03:33:21.238 INFO:teuthology.orchestra.run.smithi057.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2024-04-19T03:33:21.247 INFO:teuthology.orchestra.run.smithi129.stdout:(95/136): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2024-04-19T03:33:21.252 INFO:teuthology.orchestra.run.smithi005.stdout:(110/136): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2024-04-19T03:33:21.263 INFO:teuthology.orchestra.run.smithi057.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 672 kB/s | 34 kB 00:00 2024-04-19T03:33:21.289 INFO:teuthology.orchestra.run.smithi129.stdout:(96/136): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2024-04-19T03:33:21.305 INFO:teuthology.orchestra.run.smithi057.stdout:(56/136): python3-rsa-4.9-2.el8.noarch.rpm 1.5 MB/s | 64 kB 00:00 2024-04-19T03:33:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:(41/136): python3-cachetools-3.1.1-4.el8.noarch 124 kB/s | 33 kB 00:00 2024-04-19T03:33:21.330 INFO:teuthology.orchestra.run.smithi057.stdout:(57/136): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2024-04-19T03:33:21.331 INFO:teuthology.orchestra.run.smithi129.stdout:(97/136): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2024-04-19T03:33:21.355 INFO:teuthology.orchestra.run.smithi057.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2024-04-19T03:33:21.397 INFO:teuthology.orchestra.run.smithi057.stdout:(59/136): python3-tempora-1.14.1-5.el8.noarch.r 702 kB/s | 29 kB 00:00 2024-04-19T03:33:21.398 INFO:teuthology.orchestra.run.smithi129.stdout:(98/136): python3-requests-oauthlib-1.0.0-1.el8 642 kB/s | 43 kB 00:00 2024-04-19T03:33:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:(42/136): python3-beautifulsoup4-4.6.3-2.el8.1. 435 kB/s | 185 kB 00:00 2024-04-19T03:33:21.440 INFO:teuthology.orchestra.run.smithi129.stdout:(99/136): libaio-devel-0.3.112-1.el8.x86_64.rpm 448 kB/s | 19 kB 00:00 2024-04-19T03:33:21.447 INFO:teuthology.orchestra.run.smithi057.stdout:(60/136): python3-singledispatch-3.4.0.3-18.el8 206 kB/s | 24 kB 00:00 2024-04-19T03:33:21.481 INFO:teuthology.orchestra.run.smithi057.stdout:(61/136): python3-trustme-0.6.0-4.el8.noarch.rp 330 kB/s | 27 kB 00:00 2024-04-19T03:33:21.531 INFO:teuthology.orchestra.run.smithi057.stdout:(62/136): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-04-19T03:33:21.557 INFO:teuthology.orchestra.run.smithi057.stdout:(63/136): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2024-04-19T03:33:21.560 INFO:teuthology.orchestra.run.smithi005.stdout:(111/136): python3-numpy-1.14.3-10.el8.x86_64.r 6.9 MB/s | 3.7 MB 00:00 2024-04-19T03:33:21.582 INFO:teuthology.orchestra.run.smithi057.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2024-04-19T03:33:21.585 INFO:teuthology.orchestra.run.smithi087.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 59 kB/s | 16 kB 00:00 2024-04-19T03:33:21.607 INFO:teuthology.orchestra.run.smithi057.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2024-04-19T03:33:21.609 INFO:teuthology.orchestra.run.smithi129.stdout:(100/136): python3-scipy-1.0.0-21.module+el8.9. 25 MB/s | 14 MB 00:00 2024-04-19T03:33:21.633 INFO:teuthology.orchestra.run.smithi057.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 459 kB/s | 23 kB 00:00 2024-04-19T03:33:21.641 INFO:teuthology.orchestra.run.smithi129.stdout:(101/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 219 kB/s | 44 kB 00:00 2024-04-19T03:33:21.644 INFO:teuthology.orchestra.run.smithi005.stdout:(112/136): python3-numpy-f2py-1.14.3-10.el8.x86 575 kB/s | 225 kB 00:00 2024-04-19T03:33:21.658 INFO:teuthology.orchestra.run.smithi057.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-04-19T03:33:21.675 INFO:teuthology.orchestra.run.smithi129.stdout:(102/136): pcre2-devel-10.32-2.el8.x86_64.rpm 9.1 MB/s | 605 kB 00:00 2024-04-19T03:33:21.678 INFO:teuthology.orchestra.run.smithi005.stdout:(113/136): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2024-04-19T03:33:21.708 INFO:teuthology.orchestra.run.smithi129.stdout:(103/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2024-04-19T03:33:21.716 INFO:teuthology.orchestra.run.smithi057.stdout:(68/136): python3-packaging-16.8-9.el8.noarch.r 828 kB/s | 48 kB 00:00 2024-04-19T03:33:21.720 INFO:teuthology.orchestra.run.smithi005.stdout:(114/136): python3-mako-1.0.6-14.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2024-04-19T03:33:21.733 INFO:teuthology.orchestra.run.smithi129.stdout:(104/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2024-04-19T03:33:21.759 INFO:teuthology.orchestra.run.smithi129.stdout:(105/136): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2024-04-19T03:33:21.783 INFO:teuthology.orchestra.run.smithi057.stdout:(69/136): python3-jsonpointer-1.10-11.el8.noarc 300 kB/s | 20 kB 00:00 2024-04-19T03:33:21.784 INFO:teuthology.orchestra.run.smithi129.stdout:(106/136): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2024-04-19T03:33:21.826 INFO:teuthology.orchestra.run.smithi057.stdout:(70/136): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2024-04-19T03:33:21.843 INFO:teuthology.orchestra.run.smithi129.stdout:(107/136): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-04-19T03:33:21.845 INFO:teuthology.orchestra.run.smithi005.stdout:(115/136): openblas-threads-0.3.15-6.el8.x86_64 26 MB/s | 5.2 MB 00:00 2024-04-19T03:33:21.860 INFO:teuthology.orchestra.run.smithi057.stdout:(71/136): python3-pyasn1-modules-0.3.7-6.el8.no 3.2 MB/s | 110 kB 00:00 2024-04-19T03:33:21.868 INFO:teuthology.orchestra.run.smithi129.stdout:(108/136): zlib-devel-1.2.11-18.el8_5.x86_64.rp 689 kB/s | 58 kB 00:00 2024-04-19T03:33:21.885 INFO:teuthology.orchestra.run.smithi129.stdout:(109/136): libcom_err-devel-1.45.6-4.el8.x86_64 922 kB/s | 39 kB 00:00 2024-04-19T03:33:21.895 INFO:teuthology.orchestra.run.smithi005.stdout:(116/136): automake-1.16.1-8.el8.noarch.rpm 14 MB/s | 714 kB 00:00 2024-04-19T03:33:21.901 INFO:teuthology.orchestra.run.smithi057.stdout:(72/136): python3-jsonpatch-1.21-2.el8.noarch.r 642 kB/s | 27 kB 00:00 2024-04-19T03:33:21.902 INFO:teuthology.orchestra.run.smithi129.stdout:(110/136): fuse-2.9.7-17.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2024-04-19T03:33:21.936 INFO:teuthology.orchestra.run.smithi129.stdout:(111/136): libgfortran-8.5.0-20.el8.x86_64.rpm 13 MB/s | 645 kB 00:00 2024-04-19T03:33:21.943 INFO:teuthology.orchestra.run.smithi057.stdout:(73/136): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2024-04-19T03:33:21.961 INFO:teuthology.orchestra.run.smithi129.stdout:(112/136): libquadmath-8.5.0-20.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2024-04-19T03:33:21.962 INFO:teuthology.orchestra.run.smithi005.stdout:(117/136): openblas-0.3.15-6.el8.x86_64.rpm 21 MB/s | 5.0 MB 00:00 2024-04-19T03:33:21.986 INFO:teuthology.orchestra.run.smithi129.stdout:(113/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2024-04-19T03:33:21.987 INFO:teuthology.orchestra.run.smithi005.stdout:(118/136): jq-1.6-7.el8.x86_64.rpm 2.2 MB/s | 202 kB 00:00 2024-04-19T03:33:21.993 INFO:teuthology.orchestra.run.smithi057.stdout:(74/136): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2024-04-19T03:33:22.011 INFO:teuthology.orchestra.run.smithi129.stdout:(114/136): xfsprogs-devel-5.0.0-12.el8.x86_64.r 1.4 MB/s | 73 kB 00:00 2024-04-19T03:33:22.013 INFO:teuthology.orchestra.run.smithi005.stdout:(119/136): python3-pytz-2017.2-11.el8.noarch.rp 1.1 MB/s | 54 kB 00:00 2024-04-19T03:33:22.027 INFO:teuthology.orchestra.run.smithi087.stdout:(44/136): ceph-test-18.2.2-1237.g646b8c7d.el8.x 2.3 MB/s | 47 MB 00:20 2024-04-19T03:33:22.044 INFO:teuthology.orchestra.run.smithi087.stdout:(45/136): python3-cheroot-8.5.2-1.el8.noarch.rp 276 kB/s | 173 kB 00:00 2024-04-19T03:33:22.071 INFO:teuthology.orchestra.run.smithi129.stdout:(115/136): elfutils-libelf-devel-0.189-3.el8.x8 726 kB/s | 62 kB 00:00 2024-04-19T03:33:22.080 INFO:teuthology.orchestra.run.smithi005.stdout:(120/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-19T03:33:22.112 INFO:teuthology.orchestra.run.smithi129.stdout:(116/136): krb5-devel-1.18.2-26.el8_9.x86_64.rp 5.5 MB/s | 562 kB 00:00 2024-04-19T03:33:22.160 INFO:teuthology.orchestra.run.smithi057.stdout:(75/136): bison-3.0.4-10.el8.x86_64.rpm 4.0 MB/s | 688 kB 00:00 2024-04-19T03:33:22.163 INFO:teuthology.orchestra.run.smithi129.stdout:(117/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 938 kB/s | 47 kB 00:00 2024-04-19T03:33:22.221 INFO:teuthology.orchestra.run.smithi129.stdout:(118/136): openssl-devel-1.1.1k-12.el8_9.x86_64 16 MB/s | 2.3 MB 00:00 2024-04-19T03:33:22.228 INFO:teuthology.orchestra.run.smithi087.stdout:(46/136): python3-jaraco-6.2-6.el8.noarch.rpm 60 kB/s | 11 kB 00:00 2024-04-19T03:33:22.255 INFO:teuthology.orchestra.run.smithi129.stdout:(119/136): python3-cryptography-3.2.1-7.el8_9.x 5.9 MB/s | 559 kB 00:00 2024-04-19T03:33:22.308 INFO:teuthology.orchestra.run.smithi129.stdout:(120/136): libuuid-devel-2.32.1-44.el8_9.1.x86_ 1.1 MB/s | 100 kB 00:00 2024-04-19T03:33:22.339 INFO:teuthology.orchestra.run.smithi129.stdout:(121/136): python3-packaging-16.8-9.el8.noarch. 578 kB/s | 48 kB 00:00 2024-04-19T03:33:22.369 INFO:teuthology.orchestra.run.smithi057.stdout:(76/136): thrift-0.13.0-2.el8.x86_64.rpm 2.3 MB/s | 1.7 MB 00:00 2024-04-19T03:33:22.369 INFO:teuthology.orchestra.run.smithi087.stdout:(47/136): python3-google-auth-1.1.1-10.el8.noar 238 kB/s | 81 kB 00:00 2024-04-19T03:33:22.381 INFO:teuthology.orchestra.run.smithi005.stdout:(121/136): python3-scipy-1.0.0-21.module+el8.9. 35 MB/s | 14 MB 00:00 2024-04-19T03:33:22.403 INFO:teuthology.orchestra.run.smithi057.stdout:(77/136): flex-2.6.1-9.el8.x86_64.rpm 1.3 MB/s | 320 kB 00:00 2024-04-19T03:33:22.453 INFO:teuthology.orchestra.run.smithi057.stdout:(78/136): python3-markupsafe-0.23-19.el8.x86_64 946 kB/s | 39 kB 00:00 2024-04-19T03:33:22.453 INFO:teuthology.orchestra.run.smithi087.stdout:(48/136): python3-cherrypy-18.4.0-1.el8.noarch. 443 kB/s | 384 kB 00:00 2024-04-19T03:33:22.487 INFO:teuthology.orchestra.run.smithi057.stdout:(79/136): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2024-04-19T03:33:22.487 INFO:teuthology.orchestra.run.smithi087.stdout:(49/136): python3-jaraco-functools-2.0-4.el8.no 68 kB/s | 18 kB 00:00 2024-04-19T03:33:22.528 INFO:teuthology.orchestra.run.smithi057.stdout:(80/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2024-04-19T03:33:22.554 INFO:teuthology.orchestra.run.smithi057.stdout:(81/136): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2024-04-19T03:33:22.612 INFO:teuthology.orchestra.run.smithi057.stdout:(82/136): python3-jinja2-2.10.1-3.el8.noarch.rp 9.0 MB/s | 538 kB 00:00 2024-04-19T03:33:22.729 INFO:teuthology.orchestra.run.smithi057.stdout:(83/136): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2024-04-19T03:33:22.804 INFO:teuthology.orchestra.run.smithi057.stdout:(84/136): python3-numpy-1.14.3-10.el8.x86_64.rp 19 MB/s | 3.7 MB 00:00 2024-04-19T03:33:22.806 INFO:teuthology.orchestra.run.smithi129.stdout:(122/136): ceph-test-18.2.2-1237.g646b8c7d.el8. 3.4 MB/s | 47 MB 00:13 2024-04-19T03:33:22.812 INFO:teuthology.orchestra.run.smithi087.stdout:(50/136): python3-logutils-0.3.5-11.el8.noarch. 136 kB/s | 49 kB 00:00 2024-04-19T03:33:22.829 INFO:teuthology.orchestra.run.smithi087.stdout:(51/136): python3-more-itertools-7.2.0-3.el8.no 172 kB/s | 59 kB 00:00 2024-04-19T03:33:22.829 INFO:teuthology.orchestra.run.smithi057.stdout:(85/136): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2024-04-19T03:33:22.848 INFO:teuthology.orchestra.run.smithi129.stdout:(123/136): elfutils-libelf-0.189-3.el8.x86_64.r 5.5 MB/s | 232 kB 00:00 2024-04-19T03:33:22.863 INFO:teuthology.orchestra.run.smithi057.stdout:(86/136): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2024-04-19T03:33:22.890 INFO:teuthology.orchestra.run.smithi129.stdout:(124/136): elfutils-libs-0.189-3.el8.x86_64.rpm 7.2 MB/s | 303 kB 00:00 2024-04-19T03:33:22.923 INFO:teuthology.orchestra.run.smithi005.stdout:(122/136): librbd1-18.2.2-1237.g646b8c7d.el8.x8 6.6 MB/s | 3.6 MB 00:00 2024-04-19T03:33:22.965 INFO:teuthology.orchestra.run.smithi129.stdout:(125/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 9.2 MB/s | 711 kB 00:00 2024-04-19T03:33:23.023 INFO:teuthology.orchestra.run.smithi005.stdout:(123/136): librados2-18.2.2-1237.g646b8c7d.el8. 3.9 MB/s | 3.7 MB 00:00 2024-04-19T03:33:23.024 INFO:teuthology.orchestra.run.smithi129.stdout:(126/136): librbd1-18.2.2-1237.g646b8c7d.el8.x8 5.2 MB/s | 3.6 MB 00:00 2024-04-19T03:33:23.036 INFO:teuthology.orchestra.run.smithi057.stdout:(87/136): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2024-04-19T03:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:(124/136): elfutils-libelf-0.189-3.el8.x86_64.r 1.7 MB/s | 232 kB 00:00 2024-04-19T03:33:23.074 INFO:teuthology.orchestra.run.smithi129.stdout:(127/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 14 MB/s | 1.5 MB 00:00 2024-04-19T03:33:23.089 INFO:teuthology.orchestra.run.smithi057.stdout:(88/136): python3-mako-1.0.6-14.el8.noarch.rpm 2.9 MB/s | 157 kB 00:00 2024-04-19T03:33:23.090 INFO:teuthology.orchestra.run.smithi005.stdout:(125/136): elfutils-libs-0.189-3.el8.x86_64.rpm 4.4 MB/s | 303 kB 00:00 2024-04-19T03:33:23.116 INFO:teuthology.orchestra.run.smithi129.stdout:(128/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-04-19T03:33:23.124 INFO:teuthology.orchestra.run.smithi005.stdout:(126/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 10 MB/s | 711 kB 00:00 2024-04-19T03:33:23.133 INFO:teuthology.orchestra.run.smithi129.stdout:(129/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 3.7 MB/s | 221 kB 00:00 2024-04-19T03:33:23.137 INFO:teuthology.orchestra.run.smithi087.stdout:(52/136): python3-kubernetes-11.0.0-6.el8.noarc 1.5 MB/s | 1.2 MB 00:00 2024-04-19T03:33:23.154 INFO:teuthology.orchestra.run.smithi087.stdout:(53/136): python3-natsort-7.1.1-2.el8.noarch.rp 176 kB/s | 60 kB 00:00 2024-04-19T03:33:23.158 INFO:teuthology.orchestra.run.smithi129.stdout:(130/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 5.9 MB/s | 254 kB 00:00 2024-04-19T03:33:23.174 INFO:teuthology.orchestra.run.smithi005.stdout:(127/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 18 MB/s | 1.5 MB 00:00 2024-04-19T03:33:23.208 INFO:teuthology.orchestra.run.smithi129.stdout:(131/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 3.1 MB/s | 237 kB 00:00 2024-04-19T03:33:23.216 INFO:teuthology.orchestra.run.smithi005.stdout:(128/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-04-19T03:33:23.222 INFO:teuthology.orchestra.run.smithi057.stdout:(89/136): openblas-threads-0.3.15-6.el8.x86_64. 15 MB/s | 5.2 MB 00:00 2024-04-19T03:33:23.241 INFO:teuthology.orchestra.run.smithi005.stdout:(129/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 3.2 MB/s | 221 kB 00:00 2024-04-19T03:33:23.242 INFO:teuthology.orchestra.run.smithi129.stdout:(132/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 2.1 MB/s | 180 kB 00:00 2024-04-19T03:33:23.266 INFO:teuthology.orchestra.run.smithi005.stdout:(130/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 4.9 MB/s | 254 kB 00:00 2024-04-19T03:33:23.267 INFO:teuthology.orchestra.run.smithi129.stdout:(133/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2024-04-19T03:33:23.281 INFO:teuthology.orchestra.run.smithi057.stdout:(90/136): automake-1.16.1-8.el8.noarch.rpm 12 MB/s | 714 kB 00:00 2024-04-19T03:33:23.292 INFO:teuthology.orchestra.run.smithi005.stdout:(131/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 4.6 MB/s | 237 kB 00:00 2024-04-19T03:33:23.317 INFO:teuthology.orchestra.run.smithi005.stdout:(132/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 3.5 MB/s | 180 kB 00:00 2024-04-19T03:33:23.319 INFO:teuthology.orchestra.run.smithi129.stdout:(134/136): util-linux-user-2.32.1-44.el8_9.1.x8 2.0 MB/s | 103 kB 00:00 2024-04-19T03:33:23.342 INFO:teuthology.orchestra.run.smithi005.stdout:(133/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-04-19T03:33:23.346 INFO:teuthology.orchestra.run.smithi087.stdout:(54/136): python3-pecan-1.3.2-9.el8.noarch.rpm 546 kB/s | 283 kB 00:00 2024-04-19T03:33:23.360 INFO:teuthology.orchestra.run.smithi129.stdout:(135/136): util-linux-2.32.1-44.el8_9.1.x86_64. 21 MB/s | 2.5 MB 00:00 2024-04-19T03:33:23.381 INFO:teuthology.orchestra.run.smithi057.stdout:(91/136): openblas-0.3.15-6.el8.x86_64.rpm 17 MB/s | 5.0 MB 00:00 2024-04-19T03:33:23.384 INFO:teuthology.orchestra.run.smithi005.stdout:(134/136): util-linux-user-2.32.1-44.el8_9.1.x8 2.4 MB/s | 103 kB 00:00 2024-04-19T03:33:23.405 INFO:teuthology.orchestra.run.smithi087.stdout:(55/136): python3-portend-2.6-1.el8.noarch.rpm 58 kB/s | 16 kB 00:00 2024-04-19T03:33:23.407 INFO:teuthology.orchestra.run.smithi057.stdout:(92/136): jq-1.6-7.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2024-04-19T03:33:23.431 INFO:teuthology.orchestra.run.smithi087.stdout:(56/136): python3-repoze-lru-0.7-6.el8.noarch.r 122 kB/s | 34 kB 00:00 2024-04-19T03:33:23.432 INFO:teuthology.orchestra.run.smithi057.stdout:(93/136): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2024-04-19T03:33:23.468 INFO:teuthology.orchestra.run.smithi005.stdout:(135/136): util-linux-2.32.1-44.el8_9.1.x86_64. 16 MB/s | 2.5 MB 00:00 2024-04-19T03:33:23.474 INFO:teuthology.orchestra.run.smithi057.stdout:(94/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-04-19T03:33:23.516 INFO:teuthology.orchestra.run.smithi057.stdout:(95/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 431 kB/s | 18 kB 00:00 2024-04-19T03:33:23.558 INFO:teuthology.orchestra.run.smithi057.stdout:(96/136): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2024-04-19T03:33:23.623 INFO:teuthology.orchestra.run.smithi057.stdout:(97/136): python3-oauthlib-2.1.0-1.el8.noarch.r 2.4 MB/s | 155 kB 00:00 2024-04-19T03:33:23.666 INFO:teuthology.orchestra.run.smithi057.stdout:(98/136): python3-pycparser-2.14-14.el8.noarch. 2.3 MB/s | 109 kB 00:00 2024-04-19T03:33:23.706 INFO:teuthology.orchestra.run.smithi087.stdout:(57/136): python3-simplegeneric-0.8.1-17.el8.no 68 kB/s | 19 kB 00:00 2024-04-19T03:33:23.709 INFO:teuthology.orchestra.run.smithi057.stdout:(99/136): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2024-04-19T03:33:23.748 INFO:teuthology.orchestra.run.smithi087.stdout:(58/136): python3-rsa-4.9-2.el8.noarch.rpm 188 kB/s | 64 kB 00:00 2024-04-19T03:33:23.751 INFO:teuthology.orchestra.run.smithi057.stdout:(100/136): libaio-devel-0.3.112-1.el8.x86_64.rp 450 kB/s | 19 kB 00:00 2024-04-19T03:33:23.790 INFO:teuthology.orchestra.run.smithi087.stdout:(59/136): python3-routes-2.4.1-12.el8.noarch.rp 444 kB/s | 196 kB 00:00 2024-04-19T03:33:23.793 INFO:teuthology.orchestra.run.smithi057.stdout:(101/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-04-19T03:33:23.843 INFO:teuthology.orchestra.run.smithi057.stdout:(102/136): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2024-04-19T03:33:23.885 INFO:teuthology.orchestra.run.smithi057.stdout:(103/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2024-04-19T03:33:23.902 INFO:teuthology.orchestra.run.smithi129.stdout:(136/136): librados2-18.2.2-1237.g646b8c7d.el8. 2.3 MB/s | 3.7 MB 00:01 2024-04-19T03:33:23.905 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-04-19T03:33:23.905 INFO:teuthology.orchestra.run.smithi129.stdout:Total 6.5 MB/s | 206 MB 00:31 2024-04-19T03:33:23.944 INFO:teuthology.orchestra.run.smithi057.stdout:(104/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2024-04-19T03:33:23.982 INFO:teuthology.orchestra.run.smithi087.stdout:(60/136): python3-singledispatch-3.4.0.3-18.el8 87 kB/s | 24 kB 00:00 2024-04-19T03:33:24.015 INFO:teuthology.orchestra.run.smithi087.stdout:(61/136): python3-tempora-1.14.1-5.el8.noarch.r 109 kB/s | 29 kB 00:00 2024-04-19T03:33:24.057 INFO:teuthology.orchestra.run.smithi087.stdout:(62/136): python3-trustme-0.6.0-4.el8.noarch.rp 103 kB/s | 27 kB 00:00 2024-04-19T03:33:24.077 INFO:teuthology.orchestra.run.smithi057.stdout:(105/136): python3-scipy-1.0.0-21.module+el8.9. 20 MB/s | 14 MB 00:00 2024-04-19T03:33:24.102 INFO:teuthology.orchestra.run.smithi057.stdout:(106/136): libselinux-devel-2.9-5.el8.x86_64.rp 1.2 MB/s | 200 kB 00:00 2024-04-19T03:33:24.128 INFO:teuthology.orchestra.run.smithi057.stdout:(107/136): keyutils-libs-devel-1.5.10-9.el8.x86 961 kB/s | 48 kB 00:00 2024-04-19T03:33:24.153 INFO:teuthology.orchestra.run.smithi057.stdout:(108/136): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-04-19T03:33:24.178 INFO:teuthology.orchestra.run.smithi057.stdout:(109/136): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2024-04-19T03:33:24.229 INFO:teuthology.orchestra.run.smithi057.stdout:(110/136): libcom_err-devel-1.45.6-4.el8.x86_64 507 kB/s | 39 kB 00:00 2024-04-19T03:33:24.262 INFO:teuthology.orchestra.run.smithi057.stdout:(111/136): fuse-2.9.7-17.el8.x86_64.rpm 995 kB/s | 83 kB 00:00 2024-04-19T03:33:24.296 INFO:teuthology.orchestra.run.smithi057.stdout:(112/136): libgfortran-8.5.0-20.el8.x86_64.rpm 9.5 MB/s | 645 kB 00:00 2024-04-19T03:33:24.321 INFO:teuthology.orchestra.run.smithi057.stdout:(113/136): libquadmath-8.5.0-20.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2024-04-19T03:33:24.355 INFO:teuthology.orchestra.run.smithi057.stdout:(114/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2024-04-19T03:33:24.380 INFO:teuthology.orchestra.run.smithi057.stdout:(115/136): xfsprogs-devel-5.0.0-12.el8.x86_64.r 1.2 MB/s | 73 kB 00:00 2024-04-19T03:33:24.406 INFO:teuthology.orchestra.run.smithi057.stdout:(116/136): elfutils-libelf-devel-0.189-3.el8.x8 1.2 MB/s | 62 kB 00:00 2024-04-19T03:33:24.408 INFO:teuthology.orchestra.run.smithi087.stdout:(63/136): python3-websocket-client-0.56.0-5.el8 175 kB/s | 61 kB 00:00 2024-04-19T03:33:24.439 INFO:teuthology.orchestra.run.smithi057.stdout:(117/136): krb5-devel-1.18.2-26.el8_9.x86_64.rp 9.4 MB/s | 562 kB 00:00 2024-04-19T03:33:24.481 INFO:teuthology.orchestra.run.smithi057.stdout:(118/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-19T03:33:24.508 INFO:teuthology.orchestra.run.smithi087.stdout:(64/136): python3-waitress-1.4.3-1.el8.noarch.r 486 kB/s | 255 kB 00:00 2024-04-19T03:33:24.533 INFO:teuthology.orchestra.run.smithi087.stdout:(65/136): python3-webob-1.8.5-1.el8.1.noarch.rp 485 kB/s | 251 kB 00:00 2024-04-19T03:33:24.581 INFO:teuthology.orchestra.run.smithi057.stdout:(119/136): openssl-devel-1.1.1k-12.el8_9.x86_64 13 MB/s | 2.3 MB 00:00 2024-04-19T03:33:24.614 INFO:teuthology.orchestra.run.smithi057.stdout:(120/136): python3-cryptography-3.2.1-7.el8_9.x 4.1 MB/s | 559 kB 00:00 2024-04-19T03:33:24.640 INFO:teuthology.orchestra.run.smithi057.stdout:(121/136): libuuid-devel-2.32.1-44.el8_9.1.x86_ 1.7 MB/s | 100 kB 00:00 2024-04-19T03:33:24.783 INFO:teuthology.orchestra.run.smithi087.stdout:(66/136): python3-webtest-2.0.33-1.el8.noarch.r 227 kB/s | 85 kB 00:00 2024-04-19T03:33:24.808 INFO:teuthology.orchestra.run.smithi087.stdout:(67/136): python3-zc-lockfile-2.0-2.el8.noarch. 76 kB/s | 23 kB 00:00 2024-04-19T03:33:24.825 INFO:teuthology.orchestra.run.smithi087.stdout:(68/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2024-04-19T03:33:24.848 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-04-19T03:33:24.904 INFO:teuthology.orchestra.run.smithi087.stdout:(69/136): python3-packaging-16.8-9.el8.noarch.r 505 kB/s | 48 kB 00:00 2024-04-19T03:33:24.934 INFO:teuthology.orchestra.run.smithi087.stdout:(70/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 174 kB/s | 18 kB 00:00 2024-04-19T03:33:24.960 INFO:teuthology.orchestra.run.smithi087.stdout:(71/136): python3-jwt-1.6.1-2.el8.noarch.rpm 777 kB/s | 43 kB 00:00 2024-04-19T03:33:24.985 INFO:teuthology.orchestra.run.smithi087.stdout:(72/136): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2024-04-19T03:33:25.002 INFO:teuthology.orchestra.run.smithi087.stdout:(73/136): python3-pycparser-2.14-14.el8.noarch. 2.5 MB/s | 109 kB 00:00 2024-04-19T03:33:25.027 INFO:teuthology.orchestra.run.smithi087.stdout:(74/136): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2024-04-19T03:33:25.052 INFO:teuthology.orchestra.run.smithi087.stdout:(75/136): libaio-devel-0.3.112-1.el8.x86_64.rpm 373 kB/s | 19 kB 00:00 2024-04-19T03:33:25.078 INFO:teuthology.orchestra.run.smithi087.stdout:(76/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 873 kB/s | 44 kB 00:00 2024-04-19T03:33:25.111 INFO:teuthology.orchestra.run.smithi087.stdout:(77/136): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2024-04-19T03:33:25.118 INFO:teuthology.orchestra.run.smithi057.stdout:(122/136): librados2-18.2.2-1237.g646b8c7d.el8. 7.3 MB/s | 3.7 MB 00:00 2024-04-19T03:33:25.137 INFO:teuthology.orchestra.run.smithi087.stdout:(78/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-04-19T03:33:25.165 INFO:teuthology.orchestra.run.smithi057.stdout:(123/136): elfutils-libelf-0.189-3.el8.x86_64.r 4.9 MB/s | 232 kB 00:00 2024-04-19T03:33:25.187 INFO:teuthology.orchestra.run.smithi087.stdout:(79/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2024-04-19T03:33:25.207 INFO:teuthology.orchestra.run.smithi057.stdout:(124/136): elfutils-libs-0.189-3.el8.x86_64.rpm 7.2 MB/s | 303 kB 00:00 2024-04-19T03:33:25.212 INFO:teuthology.orchestra.run.smithi087.stdout:(80/136): libselinux-devel-2.9-5.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2024-04-19T03:33:25.238 INFO:teuthology.orchestra.run.smithi087.stdout:(81/136): keyutils-libs-devel-1.5.10-9.el8.x86_ 958 kB/s | 48 kB 00:00 2024-04-19T03:33:25.238 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-04-19T03:33:25.238 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-04-19T03:33:25.263 INFO:teuthology.orchestra.run.smithi087.stdout:(82/136): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-04-19T03:33:25.266 INFO:teuthology.orchestra.run.smithi057.stdout:(125/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 12 MB/s | 711 kB 00:00 2024-04-19T03:33:25.288 INFO:teuthology.orchestra.run.smithi087.stdout:(83/136): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-19T03:33:25.322 INFO:teuthology.orchestra.run.smithi087.stdout:(84/136): libcom_err-devel-1.45.6-4.el8.x86_64. 659 kB/s | 39 kB 00:00 2024-04-19T03:33:25.333 INFO:teuthology.orchestra.run.smithi057.stdout:(126/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 22 MB/s | 1.5 MB 00:00 2024-04-19T03:33:25.347 INFO:teuthology.orchestra.run.smithi087.stdout:(85/136): fuse-2.9.7-17.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-04-19T03:33:25.391 INFO:teuthology.orchestra.run.smithi057.stdout:(127/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-04-19T03:33:25.436 INFO:teuthology.orchestra.run.smithi087.stdout:(86/136): thrift-0.13.0-2.el8.x86_64.rpm 1.9 MB/s | 1.7 MB 00:00 2024-04-19T03:33:25.450 INFO:teuthology.orchestra.run.smithi057.stdout:(128/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 3.7 MB/s | 221 kB 00:00 2024-04-19T03:33:25.492 INFO:teuthology.orchestra.run.smithi057.stdout:(129/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 6.0 MB/s | 254 kB 00:00 2024-04-19T03:33:25.526 INFO:teuthology.orchestra.run.smithi057.stdout:(130/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 7.0 MB/s | 237 kB 00:00 2024-04-19T03:33:25.531 INFO:teuthology.orchestra.run.smithi087.stdout:(87/136): libquadmath-8.5.0-20.el8.x86_64.rpm 939 kB/s | 172 kB 00:00 2024-04-19T03:33:25.560 INFO:teuthology.orchestra.run.smithi005.stdout:(136/136): ceph-test-18.2.2-1237.g646b8c7d.el8. 2.3 MB/s | 47 MB 00:20 2024-04-19T03:33:25.563 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-19T03:33:25.563 INFO:teuthology.orchestra.run.smithi005.stdout:Total 7.3 MB/s | 206 MB 00:28 2024-04-19T03:33:25.568 INFO:teuthology.orchestra.run.smithi057.stdout:(131/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 4.2 MB/s | 180 kB 00:00 2024-04-19T03:33:25.573 INFO:teuthology.orchestra.run.smithi087.stdout:(88/136): libgfortran-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 645 kB 00:00 2024-04-19T03:33:25.599 INFO:teuthology.orchestra.run.smithi087.stdout:(89/136): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 73 kB 00:00 2024-04-19T03:33:25.610 INFO:teuthology.orchestra.run.smithi057.stdout:(132/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 2.3 MB/s | 99 kB 00:00 2024-04-19T03:33:25.616 INFO:teuthology.orchestra.run.smithi087.stdout:(90/136): elfutils-libelf-devel-0.189-3.el8.x86 1.4 MB/s | 62 kB 00:00 2024-04-19T03:33:25.641 INFO:teuthology.orchestra.run.smithi087.stdout:(91/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.1 MB/s | 238 kB 00:00 2024-04-19T03:33:25.674 INFO:teuthology.orchestra.run.smithi087.stdout:(92/136): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 7.3 MB/s | 562 kB 00:00 2024-04-19T03:33:25.691 INFO:teuthology.orchestra.run.smithi087.stdout:(93/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-04-19T03:33:25.724 INFO:teuthology.orchestra.run.smithi057.stdout:(133/136): util-linux-2.32.1-44.el8_9.1.x86_64. 22 MB/s | 2.5 MB 00:00 2024-04-19T03:33:25.746 INFO:teuthology.orchestra.run.smithi087.stdout:(94/136): python3-cryptography-3.2.1-7.el8_9.x8 7.7 MB/s | 559 kB 00:00 2024-04-19T03:33:25.769 INFO:teuthology.orchestra.run.smithi057.stdout:(134/136): util-linux-user-2.32.1-44.el8_9.1.x8 2.3 MB/s | 103 kB 00:00 2024-04-19T03:33:25.783 INFO:teuthology.orchestra.run.smithi087.stdout:(95/136): libuuid-devel-2.32.1-44.el8_9.1.x86_6 1.1 MB/s | 100 kB 00:00 2024-04-19T03:33:25.809 INFO:teuthology.orchestra.run.smithi087.stdout:(96/136): python3-jsonpointer-1.10-11.el8.noarc 320 kB/s | 20 kB 00:00 2024-04-19T03:33:25.819 INFO:teuthology.orchestra.run.smithi057.stdout:(135/136): librbd1-18.2.2-1237.g646b8c7d.el8.x8 3.0 MB/s | 3.6 MB 00:01 2024-04-19T03:33:25.834 INFO:teuthology.orchestra.run.smithi087.stdout:(97/136): python3-prettytable-0.7.2-14.el8.noar 879 kB/s | 44 kB 00:00 2024-04-19T03:33:25.859 INFO:teuthology.orchestra.run.smithi087.stdout:(98/136): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2024-04-19T03:33:25.885 INFO:teuthology.orchestra.run.smithi087.stdout:(99/136): python3-jsonpatch-1.21-2.el8.noarch.r 528 kB/s | 27 kB 00:00 2024-04-19T03:33:25.901 INFO:teuthology.orchestra.run.smithi087.stdout:(100/136): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.9 MB/s | 126 kB 00:00 2024-04-19T03:33:25.938 INFO:teuthology.orchestra.run.smithi087.stdout:(101/136): python3-werkzeug-0.12.2-4.el8.noarch 8.9 MB/s | 457 kB 00:00 2024-04-19T03:33:25.985 INFO:teuthology.orchestra.run.smithi087.stdout:(102/136): openssl-devel-1.1.1k-12.el8_9.x86_64 6.3 MB/s | 2.3 MB 00:00 2024-04-19T03:33:26.052 INFO:teuthology.orchestra.run.smithi087.stdout:(103/136): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2024-04-19T03:33:26.077 INFO:teuthology.orchestra.run.smithi087.stdout:(104/136): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2024-04-19T03:33:26.103 INFO:teuthology.orchestra.run.smithi087.stdout:(105/136): python3-markupsafe-0.23-19.el8.x86_6 774 kB/s | 39 kB 00:00 2024-04-19T03:33:26.128 INFO:teuthology.orchestra.run.smithi087.stdout:(106/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2024-04-19T03:33:26.153 INFO:teuthology.orchestra.run.smithi087.stdout:(107/136): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2024-04-19T03:33:26.187 INFO:teuthology.orchestra.run.smithi087.stdout:(108/136): libtool-2.4.6-25.el8.x86_64.rpm 3.4 MB/s | 709 kB 00:00 2024-04-19T03:33:26.221 INFO:teuthology.orchestra.run.smithi087.stdout:(109/136): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2024-04-19T03:33:26.253 INFO:teuthology.orchestra.run.smithi057.stdout:(136/136): ceph-test-18.2.2-1237.g646b8c7d.el8. 2.5 MB/s | 47 MB 00:19 2024-04-19T03:33:26.256 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-19T03:33:26.256 INFO:teuthology.orchestra.run.smithi057.stdout:Total 7.0 MB/s | 206 MB 00:29 2024-04-19T03:33:26.293 INFO:teuthology.orchestra.run.smithi087.stdout:(110/136): socat-1.7.4.1-1.el8.x86_64.rpm 4.4 MB/s | 323 kB 00:00 2024-04-19T03:33:26.347 INFO:teuthology.orchestra.run.smithi087.stdout:(111/136): python3-numpy-f2py-1.14.3-10.el8.x86 4.2 MB/s | 225 kB 00:00 2024-04-19T03:33:26.365 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-04-19T03:33:26.376 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-04-19T03:33:26.397 INFO:teuthology.orchestra.run.smithi087.stdout:(112/136): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2024-04-19T03:33:26.455 INFO:teuthology.orchestra.run.smithi087.stdout:(113/136): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2024-04-19T03:33:26.522 INFO:teuthology.orchestra.run.smithi087.stdout:(114/136): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2024-04-19T03:33:26.567 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-19T03:33:26.572 INFO:teuthology.orchestra.run.smithi087.stdout:(115/136): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2024-04-19T03:33:26.631 INFO:teuthology.orchestra.run.smithi087.stdout:(116/136): automake-1.16.1-8.el8.noarch.rpm 12 MB/s | 714 kB 00:00 2024-04-19T03:33:26.673 INFO:teuthology.orchestra.run.smithi087.stdout:(117/136): jq-1.6-7.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2024-04-19T03:33:26.715 INFO:teuthology.orchestra.run.smithi087.stdout:(118/136): python3-pytz-2017.2-11.el8.noarch.rp 1.3 MB/s | 54 kB 00:00 2024-04-19T03:33:26.824 INFO:teuthology.orchestra.run.smithi087.stdout:(119/136): openblas-threads-0.3.15-6.el8.x86_64 12 MB/s | 5.2 MB 00:00 2024-04-19T03:33:26.891 INFO:teuthology.orchestra.run.smithi087.stdout:(120/136): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-04-19T03:33:26.916 INFO:teuthology.orchestra.run.smithi087.stdout:(121/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-19T03:33:27.014 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-19T03:33:27.014 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-19T03:33:27.208 INFO:teuthology.orchestra.run.smithi087.stdout:(122/136): python3-scipy-1.0.0-21.module+el8.9. 28 MB/s | 14 MB 00:00 2024-04-19T03:33:27.242 INFO:teuthology.orchestra.run.smithi087.stdout:(123/136): elfutils-libelf-0.189-3.el8.x86_64.r 6.8 MB/s | 232 kB 00:00 2024-04-19T03:33:27.259 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-19T03:33:27.283 INFO:teuthology.orchestra.run.smithi087.stdout:(124/136): elfutils-libs-0.189-3.el8.x86_64.rpm 7.1 MB/s | 303 kB 00:00 2024-04-19T03:33:27.355 INFO:teuthology.orchestra.run.smithi087.stdout:(125/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 9.7 MB/s | 711 kB 00:00 2024-04-19T03:33:27.417 INFO:teuthology.orchestra.run.smithi087.stdout:(126/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 24 MB/s | 1.5 MB 00:00 2024-04-19T03:33:27.476 INFO:teuthology.orchestra.run.smithi087.stdout:(127/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-04-19T03:33:27.518 INFO:teuthology.orchestra.run.smithi087.stdout:(128/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 5.2 MB/s | 221 kB 00:00 2024-04-19T03:33:27.560 INFO:teuthology.orchestra.run.smithi087.stdout:(129/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 6.0 MB/s | 254 kB 00:00 2024-04-19T03:33:27.625 INFO:teuthology.orchestra.run.smithi087.stdout:(130/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 3.5 MB/s | 237 kB 00:00 2024-04-19T03:33:27.669 INFO:teuthology.orchestra.run.smithi087.stdout:(131/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 4.1 MB/s | 180 kB 00:00 2024-04-19T03:33:27.702 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-19T03:33:27.702 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-19T03:33:27.728 INFO:teuthology.orchestra.run.smithi087.stdout:(132/136): librados2-18.2.2-1237.g646b8c7d.el8. 4.4 MB/s | 3.7 MB 00:00 2024-04-19T03:33:27.753 INFO:teuthology.orchestra.run.smithi087.stdout:(133/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 1.2 MB/s | 99 kB 00:00 2024-04-19T03:33:27.803 INFO:teuthology.orchestra.run.smithi087.stdout:(134/136): util-linux-user-2.32.1-44.el8_9.1.x8 2.0 MB/s | 103 kB 00:00 2024-04-19T03:33:27.845 INFO:teuthology.orchestra.run.smithi087.stdout:(135/136): util-linux-2.32.1-44.el8_9.1.x86_64. 21 MB/s | 2.5 MB 00:00 2024-04-19T03:33:28.045 INFO:teuthology.orchestra.run.smithi087.stdout:(136/136): librbd1-18.2.2-1237.g646b8c7d.el8.x8 3.2 MB/s | 3.6 MB 00:01 2024-04-19T03:33:28.047 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-04-19T03:33:28.047 INFO:teuthology.orchestra.run.smithi087.stdout:Total 5.7 MB/s | 206 MB 00:36 2024-04-19T03:33:28.247 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-19T03:33:28.257 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-19T03:33:28.940 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-19T03:33:28.942 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-04-19T03:33:28.951 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-19T03:33:29.328 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-04-19T03:33:29.328 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-04-19T03:33:30.445 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-04-19T03:33:30.455 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-04-19T03:33:32.055 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-04-19T03:33:32.190 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-19T03:33:32.526 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-19T03:33:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-19T03:33:32.902 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-19T03:33:33.082 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-19T03:33:33.195 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-19T03:33:33.394 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-19T03:33:33.473 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-19T03:33:33.596 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-19T03:33:33.721 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-19T03:33:33.743 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-19T03:33:33.915 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-19T03:33:33.965 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-19T03:33:34.014 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-19T03:33:34.175 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/150 2024-04-19T03:33:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-19T03:33:34.372 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-19T03:33:34.390 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-19T03:33:34.399 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-19T03:33:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-19T03:33:34.536 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-19T03:33:34.605 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-19T03:33:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-19T03:33:34.794 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-19T03:33:34.857 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-19T03:33:34.953 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-19T03:33:35.023 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:33:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-19T03:33:35.176 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-19T03:33:35.256 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/150 2024-04-19T03:33:35.374 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-19T03:33:35.395 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-19T03:33:35.418 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:33:35.485 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-19T03:33:35.552 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-19T03:33:35.615 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:33:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-19T03:33:35.686 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-19T03:33:35.764 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:33:35.816 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-19T03:33:35.899 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-19T03:33:35.931 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:33:36.003 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-04-19T03:33:36.028 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:33:36.104 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-19T03:33:36.134 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-19T03:33:36.136 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-19T03:33:36.243 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/150 2024-04-19T03:33:36.277 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-19T03:33:36.328 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:33:36.349 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-19T03:33:36.421 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-19T03:33:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-19T03:33:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/150 2024-04-19T03:33:36.652 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-19T03:33:36.661 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-19T03:33:36.766 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:33:36.781 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:33:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-19T03:33:36.844 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-19T03:33:36.894 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:33:36.936 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:33:36.998 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-19T03:33:37.048 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 16/150 2024-04-19T03:33:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:33:37.105 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-19T03:33:37.220 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:33:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-19T03:33:37.237 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 16/150 2024-04-19T03:33:37.273 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-19T03:33:37.322 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:33:37.365 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-19T03:33:37.508 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/150 2024-04-19T03:33:37.514 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-19T03:33:37.544 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-19T03:33:37.577 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:33:37.595 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-19T03:33:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-19T03:33:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/150 2024-04-19T03:33:37.820 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-19T03:33:37.841 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-19T03:33:37.948 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-19T03:33:37.981 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-19T03:33:37.994 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:33:38.005 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:33:38.046 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-19T03:33:38.107 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:33:38.108 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-19T03:33:38.194 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:33:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 16/150 2024-04-19T03:33:38.257 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-19T03:33:38.323 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-19T03:33:38.331 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:33:38.445 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 16/150 2024-04-19T03:33:38.469 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:33:38.572 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:33:38.652 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-19T03:33:38.671 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-19T03:33:38.747 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-19T03:33:38.791 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/150 2024-04-19T03:33:38.882 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:33:38.953 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-19T03:33:38.983 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-19T03:33:39.099 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-19T03:33:39.101 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 19/150 2024-04-19T03:33:39.173 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-19T03:33:39.240 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-19T03:33:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:33:39.359 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 20/150 2024-04-19T03:33:39.393 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:33:39.473 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:33:39.508 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:33:39.685 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:33:39.685 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 16/150 2024-04-19T03:33:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/150 2024-04-19T03:33:39.685 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-19T03:33:39.777 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-19T03:33:39.799 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:33:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-19T03:33:39.878 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 16/150 2024-04-19T03:33:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:33:39.931 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-0.3.15-6.el8.x86_64 22/150 2024-04-19T03:33:39.944 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-19T03:33:40.101 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-19T03:33:40.135 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/150 2024-04-19T03:33:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-19T03:33:40.301 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-19T03:33:40.400 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-19T03:33:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-19T03:33:40.543 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-19T03:33:40.606 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:33:40.627 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-19T03:33:40.659 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 22/150 2024-04-19T03:33:40.677 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-19T03:33:40.695 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:33:40.811 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-19T03:33:40.815 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 16/150 2024-04-19T03:33:40.851 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-19T03:33:40.945 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/150 2024-04-19T03:33:41.006 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 16/150 2024-04-19T03:33:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/150 2024-04-19T03:33:41.231 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-19T03:33:41.301 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 25/150 2024-04-19T03:33:41.312 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-19T03:33:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-19T03:33:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-19T03:33:41.545 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-19T03:33:41.667 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/150 2024-04-19T03:33:41.692 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.15-6.el8.x86_64 25/150 2024-04-19T03:33:41.726 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 19/150 2024-04-19T03:33:41.768 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-19T03:33:41.963 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/150 2024-04-19T03:33:41.983 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 20/150 2024-04-19T03:33:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/150 2024-04-19T03:33:42.232 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-19T03:33:42.365 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-19T03:33:42.429 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 29/150 2024-04-19T03:33:42.433 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-19T03:33:42.466 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 25/150 2024-04-19T03:33:42.500 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-19T03:33:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 30/150 2024-04-19T03:33:42.631 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-19T03:33:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.15-6.el8.x86_64 22/150 2024-04-19T03:33:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/150 2024-04-19T03:33:42.859 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 31/150 2024-04-19T03:33:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 27/150 2024-04-19T03:33:43.230 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-19T03:33:43.261 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-19T03:33:43.406 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-19T03:33:43.409 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 29/150 2024-04-19T03:33:43.480 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 22/150 2024-04-19T03:33:43.699 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 30/150 2024-04-19T03:33:43.831 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/150 2024-04-19T03:33:43.883 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/150 2024-04-19T03:33:43.943 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 31/150 2024-04-19T03:33:44.018 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-19T03:33:44.052 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/150 2024-04-19T03:33:44.150 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-19T03:33:44.194 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/150 2024-04-19T03:33:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.15-6.el8.x86_64 25/150 2024-04-19T03:33:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 25/150 2024-04-19T03:33:44.500 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/150 2024-04-19T03:33:44.542 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/150 2024-04-19T03:33:44.742 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-19T03:33:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/150 2024-04-19T03:33:44.919 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 25/150 2024-04-19T03:33:45.155 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-19T03:33:45.195 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/150 2024-04-19T03:33:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 27/150 2024-04-19T03:33:45.467 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 29/150 2024-04-19T03:33:45.606 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 30/150 2024-04-19T03:33:45.666 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-19T03:33:45.862 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 29/150 2024-04-19T03:33:45.881 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 31/150 2024-04-19T03:33:46.067 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 30/150 2024-04-19T03:33:46.110 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-19T03:33:46.345 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 31/150 2024-04-19T03:33:46.490 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-19T03:33:46.515 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 33/150 2024-04-19T03:33:46.627 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-19T03:33:46.847 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 36/150 2024-04-19T03:33:46.994 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/150 2024-04-19T03:33:47.066 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-19T03:33:47.257 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-19T03:33:47.485 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/150 2024-04-19T03:33:47.495 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 39/150 2024-04-19T03:33:47.567 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/150 2024-04-19T03:33:47.704 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 40/150 2024-04-19T03:33:47.758 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/150 2024-04-19T03:33:47.884 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/150 2024-04-19T03:33:47.922 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-19T03:33:48.032 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-19T03:33:48.099 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/150 2024-04-19T03:33:48.103 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-19T03:33:48.272 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-19T03:33:48.342 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-19T03:33:48.345 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-19T03:33:48.370 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-19T03:33:48.525 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-19T03:33:48.592 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-19T03:33:48.741 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 33/150 2024-04-19T03:33:48.742 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 39/150 2024-04-19T03:33:48.845 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-19T03:33:48.952 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 40/150 2024-04-19T03:33:49.055 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-19T03:33:49.159 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-19T03:33:49.281 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-19T03:33:49.493 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-19T03:33:49.500 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-19T03:33:49.549 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-19T03:33:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/150 2024-04-19T03:33:49.794 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-19T03:33:49.872 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-19T03:33:49.898 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-19T03:33:50.002 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-19T03:33:50.061 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/150 2024-04-19T03:33:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-19T03:33:50.081 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-packaging-16.8-9.el8.noarch 47/150 2024-04-19T03:33:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-19T03:33:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/150 2024-04-19T03:33:50.292 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fuse-2.9.7-17.el8.x86_64 48/150 2024-04-19T03:33:50.478 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 49/150 2024-04-19T03:33:50.524 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-19T03:33:50.575 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 36/150 2024-04-19T03:33:50.685 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 50/150 2024-04-19T03:33:50.686 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-19T03:33:50.749 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-19T03:33:50.779 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-19T03:33:50.899 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 51/150 2024-04-19T03:33:50.960 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-19T03:33:50.977 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 39/150 2024-04-19T03:33:50.992 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-19T03:33:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-19T03:33:51.133 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 52/150 2024-04-19T03:33:51.159 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-19T03:33:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 40/150 2024-04-19T03:33:51.233 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 39/150 2024-04-19T03:33:51.247 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-19T03:33:51.418 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 40/150 2024-04-19T03:33:51.438 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-19T03:33:51.473 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/150 2024-04-19T03:33:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.6-7.el8.x86_64 48/150 2024-04-19T03:33:51.513 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-19T03:33:51.666 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-19T03:33:51.730 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-19T03:33:51.736 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-19T03:33:51.752 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.1-8.el8.noarch 49/150 2024-04-19T03:33:51.768 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/150 2024-04-19T03:33:51.799 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-19T03:33:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-19T03:33:52.001 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/150 2024-04-19T03:33:52.014 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-19T03:33:52.026 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-19T03:33:52.050 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 50/150 2024-04-19T03:33:52.191 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 56/150 2024-04-19T03:33:52.251 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-19T03:33:52.270 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 51/150 2024-04-19T03:33:52.277 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-19T03:33:52.439 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 57/150 2024-04-19T03:33:52.456 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 52/150 2024-04-19T03:33:52.491 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-19T03:33:52.497 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-19T03:33:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-16.8-9.el8.noarch 53/150 2024-04-19T03:33:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-19T03:33:52.811 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 58/150 2024-04-19T03:33:52.856 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.7-17.el8.x86_64 54/150 2024-04-19T03:33:52.937 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-19T03:33:53.110 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 55/150 2024-04-19T03:33:53.124 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 59/150 2024-04-19T03:33:53.192 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-19T03:33:53.274 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 56/150 2024-04-19T03:33:53.289 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-19T03:33:53.316 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-19T03:33:53.445 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 60/150 2024-04-19T03:33:53.488 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-19T03:33:53.489 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 57/150 2024-04-19T03:33:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-19T03:33:53.553 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-19T03:33:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-19T03:33:53.670 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 61/150 2024-04-19T03:33:53.681 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 58/150 2024-04-19T03:33:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.7-17.el8.x86_64 47/150 2024-04-19T03:33:53.841 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : jq-1.6-7.el8.x86_64 48/150 2024-04-19T03:33:53.906 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-19T03:33:53.984 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 59/150 2024-04-19T03:33:54.026 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/150 2024-04-19T03:33:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.1-8.el8.noarch 49/150 2024-04-19T03:33:54.142 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/150 2024-04-19T03:33:54.245 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 50/150 2024-04-19T03:33:54.262 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 60/150 2024-04-19T03:33:54.273 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 49/150 2024-04-19T03:33:54.416 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/150 2024-04-19T03:33:54.454 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 50/150 2024-04-19T03:33:54.478 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 51/150 2024-04-19T03:33:54.490 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 61/150 2024-04-19T03:33:54.640 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 52/150 2024-04-19T03:33:54.654 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/150 2024-04-19T03:33:54.661 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 62/150 2024-04-19T03:33:54.689 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 51/150 2024-04-19T03:33:54.860 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.7-17.el8.x86_64 53/150 2024-04-19T03:33:54.860 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 63/150 2024-04-19T03:33:54.864 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 66/150 2024-04-19T03:33:55.025 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 52/150 2024-04-19T03:33:55.042 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 67/150 2024-04-19T03:33:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 54/150 2024-04-19T03:33:55.211 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 64/150 2024-04-19T03:33:55.310 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 55/150 2024-04-19T03:33:55.323 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 68/150 2024-04-19T03:33:55.354 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/150 2024-04-19T03:33:55.470 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 69/150 2024-04-19T03:33:55.507 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 65/150 2024-04-19T03:33:55.541 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 56/150 2024-04-19T03:33:55.562 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 69/150 2024-04-19T03:33:55.713 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 54/150 2024-04-19T03:33:55.750 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 57/150 2024-04-19T03:33:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 66/150 2024-04-19T03:33:55.846 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : jq-1.6-7.el8.x86_64 70/150 2024-04-19T03:33:55.918 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 55/150 2024-04-19T03:33:56.002 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 67/150 2024-04-19T03:33:56.078 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : automake-1.16.1-8.el8.noarch 71/150 2024-04-19T03:33:56.083 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 58/150 2024-04-19T03:33:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 56/150 2024-04-19T03:33:56.173 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 68/150 2024-04-19T03:33:56.302 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 72/150 2024-04-19T03:33:56.435 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 69/150 2024-04-19T03:33:56.502 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 73/150 2024-04-19T03:33:56.541 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 57/150 2024-04-19T03:33:56.685 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/150 2024-04-19T03:33:56.730 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 74/150 2024-04-19T03:33:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 59/150 2024-04-19T03:33:56.847 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 58/150 2024-04-19T03:33:56.870 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-19T03:33:56.928 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/150 2024-04-19T03:33:57.027 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 60/150 2024-04-19T03:33:57.090 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-19T03:33:57.094 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 72/150 2024-04-19T03:33:57.176 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 59/150 2024-04-19T03:33:57.220 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 61/150 2024-04-19T03:33:57.298 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 73/150 2024-04-19T03:33:57.371 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-19T03:33:57.392 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 60/150 2024-04-19T03:33:57.426 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 62/150 2024-04-19T03:33:57.571 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/150 2024-04-19T03:33:57.610 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-19T03:33:57.761 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 74/150 2024-04-19T03:33:57.793 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 63/150 2024-04-19T03:33:57.832 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 62/150 2024-04-19T03:33:57.841 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-19T03:33:57.926 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-19T03:33:58.039 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-19T03:33:58.092 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 63/150 2024-04-19T03:33:58.099 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 64/150 2024-04-19T03:33:58.115 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-19T03:33:58.227 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-19T03:33:58.318 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 64/150 2024-04-19T03:33:58.397 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-19T03:33:58.421 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 65/150 2024-04-19T03:33:58.456 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-19T03:33:58.585 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 65/150 2024-04-19T03:33:58.591 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-19T03:33:58.662 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-19T03:33:58.670 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 66/150 2024-04-19T03:33:58.782 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/150 2024-04-19T03:33:58.813 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-19T03:33:58.847 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/150 2024-04-19T03:33:58.959 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-19T03:33:58.970 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-19T03:33:59.046 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 67/150 2024-04-19T03:33:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/150 2024-04-19T03:33:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-19T03:33:59.212 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-19T03:33:59.215 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 68/150 2024-04-19T03:33:59.302 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 68/150 2024-04-19T03:33:59.367 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/150 2024-04-19T03:33:59.370 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-19T03:33:59.414 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-19T03:33:59.597 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-19T03:33:59.613 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/150 2024-04-19T03:33:59.617 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-7.el8.x86_64 69/150 2024-04-19T03:33:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-19T03:33:59.792 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-19T03:33:59.803 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-19T03:33:59.831 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/150 2024-04-19T03:33:59.858 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : automake-1.16.1-8.el8.noarch 70/150 2024-04-19T03:33:59.947 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-19T03:34:00.016 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 71/150 2024-04-19T03:34:00.068 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 72/150 2024-04-19T03:34:00.094 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-19T03:34:00.200 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-19T03:34:00.216 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 72/150 2024-04-19T03:34:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-19T03:34:00.356 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 73/150 2024-04-19T03:34:00.412 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 73/150 2024-04-19T03:34:00.413 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-19T03:34:00.568 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-19T03:34:00.572 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-16.8-9.el8.noarch 74/150 2024-04-19T03:34:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-packaging-16.8-9.el8.noarch 74/150 2024-04-19T03:34:00.622 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-19T03:34:00.729 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-19T03:34:00.775 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-19T03:34:00.811 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-19T03:34:00.896 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-19T03:34:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-19T03:34:00.973 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-19T03:34:01.150 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-19T03:34:01.226 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-19T03:34:01.229 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-19T03:34:01.342 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-19T03:34:01.456 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-19T03:34:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-19T03:34:01.570 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-19T03:34:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-19T03:34:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-19T03:34:01.828 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-19T03:34:01.891 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-19T03:34:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-19T03:34:02.078 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-19T03:34:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-19T03:34:02.248 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-19T03:34:02.330 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-19T03:34:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-19T03:34:02.477 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-19T03:34:02.513 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-19T03:34:02.619 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-19T03:34:02.685 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-19T03:34:02.730 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-19T03:34:02.810 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-19T03:34:02.815 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-19T03:34:02.871 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-19T03:34:02.976 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-19T03:34:03.112 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-19T03:34:03.134 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-19T03:34:03.233 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-19T03:34:03.244 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-19T03:34:03.302 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-19T03:34:03.320 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-19T03:34:03.466 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-19T03:34:03.479 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-19T03:34:03.572 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-19T03:34:03.668 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-19T03:34:03.813 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-19T03:34:03.919 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-19T03:34:04.078 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-19T03:34:04.110 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-19T03:34:04.144 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-19T03:34:04.211 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-19T03:34:04.295 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-19T03:34:04.360 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-19T03:34:04.499 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-19T03:34:04.603 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-19T03:34:04.644 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/150 2024-04-19T03:34:04.702 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/150 2024-04-19T03:34:04.733 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-19T03:34:04.920 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/150 2024-04-19T03:34:04.926 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-19T03:34:05.146 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-19T03:34:05.307 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/150 2024-04-19T03:34:05.372 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/150 2024-04-19T03:34:05.574 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/150 2024-04-19T03:34:05.685 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-19T03:34:06.032 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-19T03:34:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-19T03:34:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-19T03:34:06.434 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-19T03:34:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-19T03:34:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-19T03:34:07.020 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-19T03:34:07.039 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-19T03:34:07.252 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-19T03:34:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-19T03:34:07.561 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-19T03:34:08.061 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-19T03:34:08.203 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/150 2024-04-19T03:34:08.313 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/150 2024-04-19T03:34:08.437 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-19T03:34:08.513 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/150 2024-04-19T03:34:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/150 2024-04-19T03:34:08.717 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 100/150 2024-04-19T03:34:08.758 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:08.931 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 101/150 2024-04-19T03:34:09.027 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:09.616 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:09.778 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:10.048 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:10.709 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:11.018 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/150 2024-04-19T03:34:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/150 2024-04-19T03:34:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/150 2024-04-19T03:34:11.288 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/150 2024-04-19T03:34:11.377 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/150 2024-04-19T03:34:11.585 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/150 2024-04-19T03:34:12.189 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:12.744 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:13.199 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:13.464 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/150 2024-04-19T03:34:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/150 2024-04-19T03:34:13.936 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/150 2024-04-19T03:34:14.125 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 102/150 2024-04-19T03:34:14.431 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/150 2024-04-19T03:34:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 103/150 2024-04-19T03:34:14.721 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/150 2024-04-19T03:34:31.093 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/150 2024-04-19T03:34:31.093 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /sys 2024-04-19T03:34:31.093 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /proc 2024-04-19T03:34:31.093 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /dev 2024-04-19T03:34:31.093 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /run 2024-04-19T03:34:31.093 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /mnt 2024-04-19T03:34:31.093 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /var/tmp 2024-04-19T03:34:31.093 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /home 2024-04-19T03:34:31.093 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /tmp 2024-04-19T03:34:31.094 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /dev 2024-04-19T03:34:31.094 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:34:31.458 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 105/150 2024-04-19T03:34:33.090 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 105/150 2024-04-19T03:34:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 106/150 2024-04-19T03:34:33.504 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 106/150 2024-04-19T03:34:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/150 2024-04-19T03:34:33.506 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-04-19T03:34:33.506 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-04-19T03:34:33.506 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /dev 2024-04-19T03:34:33.506 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /run 2024-04-19T03:34:33.506 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-04-19T03:34:33.507 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-04-19T03:34:33.507 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-04-19T03:34:33.507 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-04-19T03:34:33.507 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /dev 2024-04-19T03:34:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:34:33.682 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 107/150 2024-04-19T03:34:33.696 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/150 2024-04-19T03:34:33.696 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-04-19T03:34:33.696 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-04-19T03:34:33.696 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2024-04-19T03:34:33.696 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /run 2024-04-19T03:34:33.696 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-04-19T03:34:33.696 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-04-19T03:34:33.696 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-04-19T03:34:33.697 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-04-19T03:34:33.697 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2024-04-19T03:34:33.697 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:34:33.909 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 105/150 2024-04-19T03:34:34.062 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 105/150 2024-04-19T03:34:34.157 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 107/150 2024-04-19T03:34:34.332 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 108/150 2024-04-19T03:34:34.350 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 108/150 2024-04-19T03:34:35.545 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 105/150 2024-04-19T03:34:35.806 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 106/150 2024-04-19T03:34:35.877 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 105/150 2024-04-19T03:34:36.025 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 106/150 2024-04-19T03:34:36.106 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 106/150 2024-04-19T03:34:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 107/150 2024-04-19T03:34:36.327 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 109/150 2024-04-19T03:34:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 106/150 2024-04-19T03:34:36.470 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 109/150 2024-04-19T03:34:36.613 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 110/150 2024-04-19T03:34:36.658 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 107/150 2024-04-19T03:34:36.661 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 107/150 2024-04-19T03:34:36.858 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 108/150 2024-04-19T03:34:36.858 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 111/150 2024-04-19T03:34:36.875 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 108/150 2024-04-19T03:34:37.082 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 112/150 2024-04-19T03:34:37.192 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 107/150 2024-04-19T03:34:37.336 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 108/150 2024-04-19T03:34:37.357 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 108/150 2024-04-19T03:34:37.814 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 104/150 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /run 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2024-04-19T03:34:37.815 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:34:38.112 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 112/150 2024-04-19T03:34:38.210 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 105/150 2024-04-19T03:34:38.392 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 113/150 2024-04-19T03:34:38.635 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 109/150 2024-04-19T03:34:38.800 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 109/150 2024-04-19T03:34:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 110/150 2024-04-19T03:34:39.180 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 111/150 2024-04-19T03:34:39.360 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 113/150 2024-04-19T03:34:39.399 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 112/150 2024-04-19T03:34:39.437 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 109/150 2024-04-19T03:34:39.581 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 114/150 2024-04-19T03:34:39.625 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 109/150 2024-04-19T03:34:39.674 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 114/150 2024-04-19T03:34:39.727 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 110/150 2024-04-19T03:34:40.018 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 105/150 2024-04-19T03:34:40.088 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 115/150 2024-04-19T03:34:40.090 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 111/150 2024-04-19T03:34:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 106/150 2024-04-19T03:34:40.302 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 112/150 2024-04-19T03:34:40.309 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 116/150 2024-04-19T03:34:40.348 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 116/150 2024-04-19T03:34:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 112/150 2024-04-19T03:34:40.506 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 106/150 2024-04-19T03:34:40.539 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 117/150 2024-04-19T03:34:40.551 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 117/150 2024-04-19T03:34:40.667 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 107/150 2024-04-19T03:34:40.696 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 113/150 2024-04-19T03:34:41.194 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 107/150 2024-04-19T03:34:41.392 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 108/150 2024-04-19T03:34:41.415 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 108/150 2024-04-19T03:34:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 112/150 2024-04-19T03:34:41.663 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 113/150 2024-04-19T03:34:41.688 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 113/150 2024-04-19T03:34:41.815 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 114/150 2024-04-19T03:34:41.849 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/150 2024-04-19T03:34:41.909 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 114/150 2024-04-19T03:34:42.017 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 119/150 2024-04-19T03:34:42.051 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 119/150 2024-04-19T03:34:42.223 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 120/150 2024-04-19T03:34:42.291 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 115/150 2024-04-19T03:34:42.530 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 116/150 2024-04-19T03:34:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8 120/150 2024-04-19T03:34:42.570 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 116/150 2024-04-19T03:34:42.756 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 121/150 2024-04-19T03:34:42.765 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 117/150 2024-04-19T03:34:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 113/150 2024-04-19T03:34:42.778 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 117/150 2024-04-19T03:34:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 114/150 2024-04-19T03:34:43.043 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 114/150 2024-04-19T03:34:43.426 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 109/150 2024-04-19T03:34:43.442 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 115/150 2024-04-19T03:34:43.613 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 109/150 2024-04-19T03:34:43.629 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 116/150 2024-04-19T03:34:43.676 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 116/150 2024-04-19T03:34:43.767 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 110/150 2024-04-19T03:34:43.868 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 117/150 2024-04-19T03:34:43.883 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 117/150 2024-04-19T03:34:43.980 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 111/150 2024-04-19T03:34:44.035 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/150 2024-04-19T03:34:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 119/150 2024-04-19T03:34:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 119/150 2024-04-19T03:34:44.225 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 112/150 2024-04-19T03:34:44.407 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 120/150 2024-04-19T03:34:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8 120/150 2024-04-19T03:34:44.940 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 121/150 2024-04-19T03:34:45.273 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/150 2024-04-19T03:34:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 112/150 2024-04-19T03:34:45.437 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 119/150 2024-04-19T03:34:45.478 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 119/150 2024-04-19T03:34:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 113/150 2024-04-19T03:34:45.652 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 120/150 2024-04-19T03:34:46.041 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8 120/150 2024-04-19T03:34:46.185 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 121/150 2024-04-19T03:34:46.708 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 113/150 2024-04-19T03:34:46.925 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 114/150 2024-04-19T03:34:47.039 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 114/150 2024-04-19T03:34:47.204 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 121/150 2024-04-19T03:34:47.437 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 115/150 2024-04-19T03:34:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 122/150 2024-04-19T03:34:47.701 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 116/150 2024-04-19T03:34:47.747 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/150 2024-04-19T03:34:47.749 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 116/150 2024-04-19T03:34:47.916 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 117/150 2024-04-19T03:34:47.932 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 117/150 2024-04-19T03:34:48.425 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/150 2024-04-19T03:34:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 124/150 2024-04-19T03:34:48.987 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 125/150 2024-04-19T03:34:49.161 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 126/150 2024-04-19T03:34:49.364 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 118/150 2024-04-19T03:34:49.389 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 121/150 2024-04-19T03:34:49.407 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-19T03:34:49.584 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 119/150 2024-04-19T03:34:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 119/150 2024-04-19T03:34:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-19T03:34:49.825 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 120/150 2024-04-19T03:34:49.910 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 129/150 2024-04-19T03:34:50.199 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-19T03:34:50.211 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1237.g646b8 120/150 2024-04-19T03:34:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 122/150 2024-04-19T03:34:50.371 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 131/150 2024-04-19T03:34:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 121/150 2024-04-19T03:34:50.635 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/150 2024-04-19T03:34:50.647 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 132/150 2024-04-19T03:34:50.913 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/150 2024-04-19T03:34:50.922 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-19T03:34:51.125 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 121/150 2024-04-19T03:34:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/150 2024-04-19T03:34:51.167 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 134/150 2024-04-19T03:34:51.388 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flex-2.6.1-9.el8.x86_64 135/150 2024-04-19T03:34:51.406 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/150 2024-04-19T03:34:51.420 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/150 2024-04-19T03:34:51.464 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 135/150 2024-04-19T03:34:51.650 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-19T03:34:51.763 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : bison-3.0.4-10.el8.x86_64 136/150 2024-04-19T03:34:51.776 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 136/150 2024-04-19T03:34:51.851 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-19T03:34:51.928 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-19T03:34:52.046 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 129/150 2024-04-19T03:34:52.133 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-19T03:34:52.133 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-19T03:34:52.197 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 122/150 2024-04-19T03:34:52.279 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-19T03:34:52.434 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-19T03:34:52.434 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-19T03:34:52.439 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/150 2024-04-19T03:34:52.489 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 131/150 2024-04-19T03:34:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-19T03:34:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-19T03:34:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/150 2024-04-19T03:34:52.777 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 132/150 2024-04-19T03:34:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-19T03:34:52.944 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/150 2024-04-19T03:34:53.072 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-19T03:34:53.084 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-19T03:34:53.283 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/150 2024-04-19T03:34:53.288 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.1-9.el8.x86_64 134/150 2024-04-19T03:34:53.300 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/150 2024-04-19T03:34:53.364 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-19T03:34:53.364 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:34:53.366 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 134/150 2024-04-19T03:34:53.538 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-19T03:34:53.597 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.0.4-10.el8.x86_64 135/150 2024-04-19T03:34:53.598 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:34:53.598 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-19T03:34:53.610 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 135/150 2024-04-19T03:34:53.742 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-19T03:34:53.808 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 136/150 2024-04-19T03:34:53.848 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-19T03:34:53.848 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:34:53.934 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 129/150 2024-04-19T03:34:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-19T03:34:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:34:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-19T03:34:54.154 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-19T03:34:54.161 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-19T03:34:54.162 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-19T03:34:54.352 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 131/150 2024-04-19T03:34:54.365 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-19T03:34:54.365 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:34:54.458 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-19T03:34:54.458 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-19T03:34:54.624 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:34:54.624 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-19T03:34:54.637 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 132/150 2024-04-19T03:34:54.701 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-19T03:34:54.701 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-19T03:34:54.893 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-19T03:34:54.918 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-19T03:34:54.974 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-19T03:34:55.063 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-19T03:34:55.091 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.1-9.el8.x86_64 134/150 2024-04-19T03:34:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-19T03:34:55.178 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 134/150 2024-04-19T03:34:55.318 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 121/150 2024-04-19T03:34:55.365 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-19T03:34:55.366 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:34:55.416 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.0.4-10.el8.x86_64 135/150 2024-04-19T03:34:55.432 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 135/150 2024-04-19T03:34:55.602 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 136/150 2024-04-19T03:34:55.625 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:34:55.625 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-19T03:34:55.643 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 122/150 2024-04-19T03:34:55.680 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-19T03:34:55.680 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/150 2024-04-19T03:34:55.680 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/150 2024-04-19T03:34:55.680 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/150 2024-04-19T03:34:55.680 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/150 2024-04-19T03:34:55.680 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 5/150 2024-04-19T03:34:55.680 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/150 2024-04-19T03:34:55.680 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 8/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 13/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 14/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 16/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 18/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 19/150 2024-04-19T03:34:55.681 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 20/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 21/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 25/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 26/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 27/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 28/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 29/150 2024-04-19T03:34:55.682 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 30/150 2024-04-19T03:34:55.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 31/150 2024-04-19T03:34:55.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 32/150 2024-04-19T03:34:55.693 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 33/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 34/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 35/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 36/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-19T03:34:55.694 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-19T03:34:55.695 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 70/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 71/150 2024-04-19T03:34:55.696 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 72/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 73/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 74/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 75/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flex-2.6.1-9.el8.x86_64 77/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 78/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 80/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 81/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 82/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 83/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 84/150 2024-04-19T03:34:55.697 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 85/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 86/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 87/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 88/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 89/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 90/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : automake-1.16.1-8.el8.noarch 91/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : jq-1.6-7.el8.x86_64 92/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 93/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 94/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 95/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 96/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 97/150 2024-04-19T03:34:55.698 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 98/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 99/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 100/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 101/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 102/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 103/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 105/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 106/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 109/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 110/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 111/150 2024-04-19T03:34:55.699 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 112/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 113/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 114/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 115/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 116/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 117/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 118/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 119/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 120/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 121/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 122/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-19T03:34:55.700 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-19T03:34:55.701 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-19T03:34:55.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-19T03:34:55.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-19T03:34:55.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:34:55.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-19T03:34:55.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:34:55.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-19T03:34:55.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:34:55.702 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-19T03:34:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-19T03:34:55.840 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/150 2024-04-19T03:34:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-19T03:34:55.883 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:34:55.971 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-19T03:34:55.971 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-19T03:34:56.116 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:34:56.116 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-19T03:34:56.211 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-19T03:34:56.211 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-19T03:34:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-19T03:34:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:34:56.437 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-19T03:34:56.437 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-19T03:34:56.617 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:34:56.617 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-19T03:34:56.669 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/150 2024-04-19T03:34:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-19T03:34:56.863 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-19T03:34:56.889 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-19T03:34:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 124/150 2024-04-19T03:34:57.072 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-19T03:34:57.085 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-19T03:34:57.085 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:34:57.239 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 125/150 2024-04-19T03:34:57.352 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:34:57.352 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-19T03:34:57.456 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 126/150 2024-04-19T03:34:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-19T03:34:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:34:57.653 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-19T03:34:57.672 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-19T03:34:57.672 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/150 2024-04-19T03:34:57.672 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/150 2024-04-19T03:34:57.672 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 5/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 8/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 13/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 14/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:34:57.673 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 16/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 18/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 19/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 20/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 21/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 25/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 26/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 27/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 28/150 2024-04-19T03:34:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 29/150 2024-04-19T03:34:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 30/150 2024-04-19T03:34:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 31/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 32/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 33/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 34/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 35/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 36/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-19T03:34:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-19T03:34:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 70/150 2024-04-19T03:34:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 71/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 73/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 74/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 76/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 78/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 79/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 80/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 81/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 82/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 83/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 84/150 2024-04-19T03:34:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 85/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 86/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 87/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 88/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 91/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 92/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 93/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 94/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 95/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 96/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 97/150 2024-04-19T03:34:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 98/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 101/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 102/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.0.4-10.el8.x86_64 103/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.1-9.el8.x86_64 104/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 105/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 106/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 107/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 108/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 110/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 111/150 2024-04-19T03:34:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 112/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 113/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 114/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 115/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 116/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 117/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.1-8.el8.noarch 118/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : jq-1.6-7.el8.x86_64 119/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 120/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 121/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 122/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-19T03:34:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-19T03:34:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-19T03:34:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-19T03:34:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-19T03:34:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:34:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-19T03:34:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:34:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-19T03:34:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:34:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-19T03:34:57.777 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:34:57.777 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-19T03:34:57.884 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-19T03:34:57.977 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-19T03:34:57.977 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:34:58.107 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 129/150 2024-04-19T03:34:58.228 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:34:58.228 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-19T03:34:58.350 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-19T03:34:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-19T03:34:58.591 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 131/150 2024-04-19T03:34:58.600 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-19T03:34:58.912 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 132/150 2024-04-19T03:34:59.182 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-19T03:34:59.290 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-19T03:34:59.290 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/150 2024-04-19T03:34:59.290 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/150 2024-04-19T03:34:59.290 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/150 2024-04-19T03:34:59.290 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/150 2024-04-19T03:34:59.290 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 5/150 2024-04-19T03:34:59.290 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 8/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 13/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 14/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 16/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 18/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 19/150 2024-04-19T03:34:59.291 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 20/150 2024-04-19T03:34:59.292 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 21/150 2024-04-19T03:34:59.292 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/150 2024-04-19T03:34:59.292 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/150 2024-04-19T03:34:59.292 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/150 2024-04-19T03:34:59.292 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 25/150 2024-04-19T03:34:59.292 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 26/150 2024-04-19T03:34:59.292 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 27/150 2024-04-19T03:34:59.305 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 28/150 2024-04-19T03:34:59.305 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 29/150 2024-04-19T03:34:59.305 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 30/150 2024-04-19T03:34:59.305 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 31/150 2024-04-19T03:34:59.305 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 32/150 2024-04-19T03:34:59.305 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 33/150 2024-04-19T03:34:59.306 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 34/150 2024-04-19T03:34:59.306 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 35/150 2024-04-19T03:34:59.306 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 36/150 2024-04-19T03:34:59.306 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-19T03:34:59.306 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-19T03:34:59.306 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-19T03:34:59.306 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-19T03:34:59.306 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-19T03:34:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-19T03:34:59.308 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 70/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 71/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 72/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 73/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 76/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 77/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 79/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 80/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 81/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 82/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 83/150 2024-04-19T03:34:59.309 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 84/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 85/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 86/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 87/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 88/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 90/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 91/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 92/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 93/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 94/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 95/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 96/150 2024-04-19T03:34:59.310 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 97/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 98/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 101/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 102/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.0.4-10.el8.x86_64 103/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.1-9.el8.x86_64 104/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 105/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 106/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 107/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 108/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 110/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 111/150 2024-04-19T03:34:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 112/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 113/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 114/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 115/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 116/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 117/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.1-8.el8.noarch 118/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.6-7.el8.x86_64 119/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 120/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 121/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 122/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-19T03:34:59.312 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-19T03:34:59.313 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-19T03:34:59.314 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-19T03:34:59.314 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-19T03:34:59.314 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-19T03:34:59.314 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:34:59.314 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-19T03:34:59.314 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:34:59.314 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-19T03:34:59.314 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:34:59.314 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-19T03:34:59.382 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 134/150 2024-04-19T03:34:59.589 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flex-2.6.1-9.el8.x86_64 135/150 2024-04-19T03:34:59.678 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 135/150 2024-04-19T03:34:59.906 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : bison-3.0.4-10.el8.x86_64 136/150 2024-04-19T03:34:59.922 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 136/150 2024-04-19T03:35:00.120 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-19T03:35:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-19T03:35:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-19T03:35:00.584 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-19T03:35:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-19T03:35:00.802 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-19T03:35:00.802 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-19T03:35:01.084 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-19T03:35:01.250 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-19T03:35:01.475 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-19T03:35:01.475 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:35:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:35:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-19T03:35:01.967 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-19T03:35:01.967 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:35:02.061 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-19T03:35:02.061 INFO:teuthology.orchestra.run.smithi129.stdout:Installed products updated. 2024-04-19T03:35:02.208 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:35:02.209 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-19T03:35:02.433 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-19T03:35:02.433 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:35:02.634 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:35:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-19T03:35:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:02.681 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2024-04-19T03:35:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-19T03:35:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-19T03:35:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: automake-1.16.1-8.el8.noarch 2024-04-19T03:35:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: bison-3.0.4-10.el8.x86_64 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: flex-2.6.1-9.el8.x86_64 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-19T03:35:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: jq-1.6-7.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-19T03:35:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T03:35:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T03:35:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T03:35:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-19T03:35:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T03:35:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T03:35:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-19T03:35:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T03:35:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-19T03:35:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:02.692 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-04-19T03:35:02.918 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-19T03:35:02.937 DEBUG:teuthology.parallel:result is None 2024-04-19T03:35:03.115 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-19T03:35:03.770 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-19T03:35:03.770 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 1/150 2024-04-19T03:35:03.770 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 3/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 4/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1237.g646b8 5/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 6/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 7/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 8/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 9/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 10/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 11/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 12/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_ 13/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 14/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 15/150 2024-04-19T03:35:03.771 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_6 16/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86 17/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 18/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el 19/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8. 20/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_6 21/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 22/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 23/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 24/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 25/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 26/150 2024-04-19T03:35:03.772 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 27/150 2024-04-19T03:35:03.783 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d. 28/150 2024-04-19T03:35:03.783 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noa 29/150 2024-04-19T03:35:03.783 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.n 30/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1237.g646 31/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el 32/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 33/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.e 34/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 35/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 36/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-19T03:35:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-19T03:35:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 70/150 2024-04-19T03:35:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 71/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 72/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 75/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 76/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : bison-3.0.4-10.el8.x86_64 77/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flex-2.6.1-9.el8.x86_64 78/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 79/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 80/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 82/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 84/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/150 2024-04-19T03:35:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 86/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 88/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 89/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 90/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 91/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : automake-1.16.1-8.el8.noarch 92/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-7.el8.x86_64 93/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 94/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 95/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 96/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 97/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/150 2024-04-19T03:35:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 100/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 101/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 102/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 103/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 104/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 105/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 107/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 108/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 109/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 110/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 111/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 112/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 113/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 114/150 2024-04-19T03:35:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 115/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 116/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 117/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 118/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 119/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 120/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 121/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 122/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 123/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 125/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-19T03:35:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-19T03:35:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-19T03:35:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-19T03:35:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-19T03:35:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-19T03:35:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-19T03:35:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-19T03:35:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-19T03:35:03.803 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-19T03:35:03.803 INFO:teuthology.orchestra.run.smithi087.stdout:Installed products updated. 2024-04-19T03:35:04.422 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:04.423 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.1-8.el8.noarch 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.0.4-10.el8.x86_64 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:04.424 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.1-9.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: jq-1.6-7.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-19T03:35:04.426 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-19T03:35:04.427 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.428 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T03:35:04.429 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T03:35:04.430 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T03:35:04.431 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:04.432 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T03:35:04.433 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T03:35:04.433 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-19T03:35:04.433 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T03:35:04.433 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-19T03:35:04.433 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:04.433 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-04-19T03:35:04.664 DEBUG:teuthology.parallel:result is None 2024-04-19T03:35:06.199 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-19T03:35:06.199 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2024-04-19T03:35:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-19T03:35:06.870 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-19T03:35:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.1-8.el8.noarch 2024-04-19T03:35:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.0.4-10.el8.x86_64 2024-04-19T03:35:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.1-9.el8.x86_64 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T03:35:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: jq-1.6-7.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-19T03:35:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T03:35:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T03:35:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T03:35:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-19T03:35:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T03:35:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-19T03:35:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:06.880 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-19T03:35:07.115 DEBUG:teuthology.parallel:result is None 2024-04-19T03:35:17.818 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-19T03:35:17.818 INFO:teuthology.orchestra.run.smithi057.stdout:Installed products updated. 2024-04-19T03:35:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:18.515 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-04-19T03:35:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-19T03:35:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-19T03:35:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: automake-1.16.1-8.el8.noarch 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: bison-3.0.4-10.el8.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.516 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.517 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:18.2.2-1237.g646b8c7d.el8.noarch 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: flex-2.6.1-9.el8.x86_64 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: jq-1.6-7.el8.x86_64 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-19T03:35:18.518 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-19T03:35:18.519 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-19T03:35:18.520 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-19T03:35:18.521 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-19T03:35:18.522 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-19T03:35:18.523 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-19T03:35:18.523 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-19T03:35:18.523 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-19T03:35:18.523 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-19T03:35:18.523 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-19T03:35:18.523 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-2.6-1.el8.noarch 2024-04-19T03:35:18.523 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-19T03:35:18.523 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-19T03:35:18.524 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-19T03:35:18.524 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-19T03:35:18.524 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-19T03:35:18.524 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-19T03:35:18.524 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.524 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.524 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-19T03:35:18.524 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-19T03:35:18.524 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.525 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-19T03:35:18.525 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-19T03:35:18.525 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-19T03:35:18.525 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-19T03:35:18.525 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-19T03:35:18.525 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-19T03:35:18.525 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-19T03:35:18.525 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-19T03:35:18.525 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-19T03:35:18.526 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-19T03:35:18.526 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-19T03:35:18.526 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-19T03:35:18.526 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-19T03:35:18.526 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.526 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.526 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:18.2.2-1237.g646b8c7d.el8.x86_64 2024-04-19T03:35:18.526 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-19T03:35:18.530 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-19T03:35:18.530 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-19T03:35:18.530 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-19T03:35:18.530 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-19T03:35:18.531 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:18.531 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-19T03:35:18.737 DEBUG:teuthology.parallel:result is None 2024-04-19T03:35:18.738 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:35:18.970 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T03:35:19.001 INFO:teuthology.orchestra.run.smithi005.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T03:35:19.001 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T03:35:19.002 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T03:35:19.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:35:19.235 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T03:35:19.264 INFO:teuthology.orchestra.run.smithi057.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T03:35:19.265 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T03:35:19.265 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T03:35:19.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:35:19.479 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T03:35:19.506 INFO:teuthology.orchestra.run.smithi087.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T03:35:19.507 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T03:35:19.507 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T03:35:19.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:35:19.726 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-19T03:35:19.754 INFO:teuthology.orchestra.run.smithi129.stdout:18.2.2-1237.g646b8c7d.el8 2024-04-19T03:35:19.755 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237.g646b8c7d.el8 2024-04-19T03:35:19.755 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237.g646b8c7d is installed. 2024-04-19T03:35:19.757 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-19T03:35:19.757 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:19.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T03:35:19.812 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:35:19.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T03:35:19.866 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:35:19.866 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T03:35:19.915 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:35:19.915 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T03:35:19.963 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-19T03:35:19.964 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:19.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T03:35:19.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T03:35:20.075 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:35:20.075 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T03:35:20.110 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T03:35:20.185 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:35:20.185 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T03:35:20.217 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T03:35:20.287 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:35:20.287 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T03:35:20.320 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T03:35:20.391 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-19T03:35:20.391 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:20.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T03:35:20.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T03:35:20.500 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:35:20.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T03:35:20.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T03:35:20.611 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:35:20.611 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T03:35:20.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T03:35:20.714 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:35:20.714 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T03:35:20.746 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T03:35:20.825 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-19T03:35:20.825 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:20.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T03:35:20.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T03:35:20.935 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:35:20.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T03:35:20.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T03:35:21.046 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:35:21.046 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T03:35:21.077 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T03:35:21.150 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:35:21.150 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T03:35:21.182 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T03:35:21.252 INFO:teuthology.run_tasks:Running task ceph... 2024-04-19T03:35:21.340 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-19T03:35:21.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-04-19T03:35:21.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-04-19T03:35:21.345 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-04-19T03:35:21.348 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /var/log/ceph 2024-04-19T03:35:21.379 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-19T03:35:21.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T03:35:21.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T03:35:21.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T03:35:21.425 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T03:35:21.454 INFO:tasks.ceph:Creating extra log directories... 2024-04-19T03:35:21.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T03:35:21.492 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T03:35:21.497 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T03:35:21.499 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T03:35:21.540 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-19T03:35:21.541 INFO:tasks.ceph:config {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-19T03:35:21.541 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7662907', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 2879, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOzduFsuMMOkcxCvYjbzE/HRyBKUnw+tU/zvOtJi0DuBG8kdGBuFWJzEC9Qgy63eXWCRe0rCzHUkimJU7MgkAI=', 'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfEZMEnSgPHS/+BOHdD2oFGmCDoziS7reSa5TTXZVPk8RYqntJy99gI70G/bqF22yoRVVRfKMYcwL53vGFCZDo=', 'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0hKG5eyrNjtcTKxO929j5vBVQ60t5fX4e6cIVrL4Q7F2HRJPCqp4Iti8uZOa5uvnIlQwIHxl9k6yJETWaVS0Y=', 'smithi129.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG3xWBnZcXzlonvH63RiQHp+wW/V64a6ahACt9k11UqI6LJGuUEZnYtO9xdk3fYZMvol5yxFci3asSYlOVcwoxU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsync-tester.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-18_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-19T03:35:21.541 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T03:35:21.567 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T03:35:21.572 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T03:35:21.574 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T03:35:21.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:35:21.629 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:35:21.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:35:21.636 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:35:21.667 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:35:21.667 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T03:35:21.729 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T03:35:21.729 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-04-19T03:35:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T03:35:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:21.792 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 180591 Links: 1 2024-04-19T03:35:21.792 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:21.792 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:21.792 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-19 03:35:03.347362111 +0000 2024-04-19T03:35:21.792 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-19 03:31:33.027784035 +0000 2024-04-19T03:35:21.792 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-19 03:31:33.027784035 +0000 2024-04-19T03:35:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-19T03:35:21.792 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T03:35:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-19T03:35:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-19T03:35:21.865 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000291983 s, 1.8 MB/s 2024-04-19T03:35:21.866 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T03:35:21.930 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-04-19T03:35:21.992 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T03:35:21.992 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:21.992 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 181645 Links: 1 2024-04-19T03:35:21.992 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:21.993 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:21.993 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-19 03:35:03.347362111 +0000 2024-04-19T03:35:21.993 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-19 03:31:33.408778394 +0000 2024-04-19T03:35:21.993 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-19 03:31:33.408778394 +0000 2024-04-19T03:35:21.993 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-19T03:35:21.993 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T03:35:22.065 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-19T03:35:22.065 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-19T03:35:22.065 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000306016 s, 1.7 MB/s 2024-04-19T03:35:22.067 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T03:35:22.130 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-04-19T03:35:22.192 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T03:35:22.192 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:22.192 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 175000 Links: 1 2024-04-19T03:35:22.192 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:22.192 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:22.192 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-19 03:35:03.348362096 +0000 2024-04-19T03:35:22.193 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-19 03:31:33.794772679 +0000 2024-04-19T03:35:22.193 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-19 03:31:33.794772679 +0000 2024-04-19T03:35:22.193 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-19T03:35:22.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T03:35:22.265 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-19T03:35:22.265 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-19T03:35:22.265 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000371547 s, 1.4 MB/s 2024-04-19T03:35:22.266 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T03:35:22.328 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-04-19T03:35:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T03:35:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 180786 Links: 1 2024-04-19T03:35:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-19 03:35:03.348362096 +0000 2024-04-19T03:35:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-19 03:31:34.202766638 +0000 2024-04-19T03:35:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-19 03:31:34.202766638 +0000 2024-04-19T03:35:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-19T03:35:22.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T03:35:22.464 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-19T03:35:22.464 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-19T03:35:22.464 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000343639 s, 1.5 MB/s 2024-04-19T03:35:22.465 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T03:35:22.528 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T03:35:22.528 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:35:22.529 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T03:35:22.549 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T03:35:22.549 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-04-19T03:35:22.609 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T03:35:22.609 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:22.609 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 180775 Links: 1 2024-04-19T03:35:22.610 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:22.610 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:22.610 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-19 03:34:57.330427501 +0000 2024-04-19T03:35:22.610 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-19 03:30:32.009826210 +0000 2024-04-19T03:35:22.610 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-19 03:30:32.009826210 +0000 2024-04-19T03:35:22.610 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-04-19T03:35:22.610 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T03:35:22.680 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-19T03:35:22.680 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-19T03:35:22.680 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000349867 s, 1.5 MB/s 2024-04-19T03:35:22.681 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T03:35:22.741 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-04-19T03:35:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T03:35:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:22.801 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 180831 Links: 1 2024-04-19T03:35:22.801 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:22.801 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:22.801 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-19 03:34:57.330427501 +0000 2024-04-19T03:35:22.801 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-19 03:30:32.361818579 +0000 2024-04-19T03:35:22.801 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-19 03:30:32.361818579 +0000 2024-04-19T03:35:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-04-19T03:35:22.801 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T03:35:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-19T03:35:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-19T03:35:22.870 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000277787 s, 1.8 MB/s 2024-04-19T03:35:22.871 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T03:35:22.932 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-04-19T03:35:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T03:35:22.991 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:22.991 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 182602 Links: 1 2024-04-19T03:35:22.991 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:22.992 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:22.992 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-19 03:34:57.330427501 +0000 2024-04-19T03:35:22.992 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-19 03:30:32.714810927 +0000 2024-04-19T03:35:22.992 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-19 03:30:32.714810927 +0000 2024-04-19T03:35:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-04-19T03:35:22.992 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T03:35:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-19T03:35:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-19T03:35:23.060 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000278475 s, 1.8 MB/s 2024-04-19T03:35:23.061 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T03:35:23.120 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-04-19T03:35:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T03:35:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:23.179 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 184326 Links: 1 2024-04-19T03:35:23.179 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:23.179 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:23.179 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-19 03:34:57.330427501 +0000 2024-04-19T03:35:23.179 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-19 03:30:33.070803210 +0000 2024-04-19T03:35:23.179 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-19 03:30:33.070803210 +0000 2024-04-19T03:35:23.179 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-04-19T03:35:23.180 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T03:35:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-19T03:35:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-19T03:35:23.246 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000233862 s, 2.2 MB/s 2024-04-19T03:35:23.247 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T03:35:23.307 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T03:35:23.307 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:35:23.307 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T03:35:23.327 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T03:35:23.328 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2024-04-19T03:35:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T03:35:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:23.388 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 180547 Links: 1 2024-04-19T03:35:23.388 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:23.388 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:23.388 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-04-19 03:34:55.311041752 +0000 2024-04-19T03:35:23.388 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-04-19 03:30:40.674578001 +0000 2024-04-19T03:35:23.388 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-04-19 03:30:40.674578001 +0000 2024-04-19T03:35:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-04-19T03:35:23.388 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T03:35:23.456 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-04-19T03:35:23.457 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-04-19T03:35:23.457 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000235043 s, 2.2 MB/s 2024-04-19T03:35:23.458 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T03:35:23.518 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2024-04-19T03:35:23.577 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T03:35:23.577 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:23.577 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 182356 Links: 1 2024-04-19T03:35:23.577 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:23.577 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:23.578 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-04-19 03:34:55.311041752 +0000 2024-04-19T03:35:23.578 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-04-19 03:30:41.038570177 +0000 2024-04-19T03:35:23.578 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-04-19 03:30:41.038570177 +0000 2024-04-19T03:35:23.578 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-04-19T03:35:23.578 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T03:35:23.645 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-04-19T03:35:23.645 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-04-19T03:35:23.645 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000241518 s, 2.1 MB/s 2024-04-19T03:35:23.647 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T03:35:23.706 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2024-04-19T03:35:23.766 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T03:35:23.766 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:23.766 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 181351 Links: 1 2024-04-19T03:35:23.766 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:23.766 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:23.766 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-04-19 03:34:55.311041752 +0000 2024-04-19T03:35:23.766 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-04-19 03:30:41.387562675 +0000 2024-04-19T03:35:23.766 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-04-19 03:30:41.387562675 +0000 2024-04-19T03:35:23.766 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-04-19T03:35:23.767 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T03:35:23.832 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-04-19T03:35:23.833 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-04-19T03:35:23.833 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000194035 s, 2.6 MB/s 2024-04-19T03:35:23.834 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T03:35:23.893 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2024-04-19T03:35:23.951 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T03:35:23.951 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:35:23.951 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 181415 Links: 1 2024-04-19T03:35:23.951 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:35:23.951 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-04-19T03:35:23.951 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-04-19 03:34:55.311041752 +0000 2024-04-19T03:35:23.952 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-04-19 03:30:41.771554422 +0000 2024-04-19T03:35:23.952 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-04-19 03:30:41.771554422 +0000 2024-04-19T03:35:23.952 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-04-19T03:35:23.952 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T03:35:24.017 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-04-19T03:35:24.017 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-04-19T03:35:24.017 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000318045 s, 1.6 MB/s 2024-04-19T03:35:24.018 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T03:35:24.076 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T03:35:24.076 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T03:35:24.076 INFO:tasks.ceph:Generating config... 2024-04-19T03:35:24.077 INFO:tasks.ceph:[global] osd_pg_log_dups_tracked = 10000 2024-04-19T03:35:24.077 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-19T03:35:24.078 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-19T03:35:24.078 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-19T03:35:24.078 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-19T03:35:24.078 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-19T03:35:24.078 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-19T03:35:24.078 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-19T03:35:24.078 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-19T03:35:24.078 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-19T03:35:24.078 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-19T03:35:24.078 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-19T03:35:24.078 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-19T03:35:24.078 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-19T03:35:24.078 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-19T03:35:24.079 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-19T03:35:24.079 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-19T03:35:24.079 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-19T03:35:24.079 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-19T03:35:24.079 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-19T03:35:24.079 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-19T03:35:24.079 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-04-19T03:35:24.079 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-19T03:35:24.079 INFO:tasks.ceph:Setting up mon.a... 2024-04-19T03:35:24.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-19T03:35:24.146 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-04-19T03:35:24.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-19T03:35:24.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:35:24.233 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]'), ('mon.c', '[v2:172.21.15.5:3302,v1:172.21.15.5:6791]')] 2024-04-19T03:35:24.234 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],[v2:172.21.15.5:3302,v1:172.21.15.5:6791]', 'osd_pg_log_dups_tracked': 10000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-19T03:35:24.235 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:24.235 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T03:35:24.294 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --addv b '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]' --addv c '[v2:172.21.15.5:3302,v1:172.21.15.5:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 094bb330-e26a-42d1-b1be-7931c5493f05 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 094bb330-e26a-42d1-b1be-7931c5493f05 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-04-19T03:35:24.392745+0000 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-19T03:35:24.392745+0000 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 16 (pacific) 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.b 2024-04-19T03:35:24.393 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.5:3302/0,v1:172.21.15.5:6791/0] mon.c 2024-04-19T03:35:24.394 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-19T03:35:24.395 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T03:35:24.415 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 094bb330-e26a-42d1-b1be-7931c5493f05... 2024-04-19T03:35:24.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T03:35:24.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T03:35:24.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T03:35:24.463 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T03:35:24.511 INFO:teuthology.orchestra.run.smithi129.stdout:[global] 2024-04-19T03:35:24.511 INFO:teuthology.orchestra.run.smithi129.stdout: chdir = "" 2024-04-19T03:35:24.511 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T03:35:24.511 INFO:teuthology.orchestra.run.smithi129.stdout: auth supported = cephx 2024-04-19T03:35:24.511 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.512 INFO:teuthology.orchestra.run.smithi129.stdout: filestore xattr use omap = true 2024-04-19T03:35:24.512 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.512 INFO:teuthology.orchestra.run.smithi129.stdout: mon clock drift allowed = 1.000 2024-04-19T03:35:24.512 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.512 INFO:teuthology.orchestra.run.smithi129.stdout: osd crush chooseleaf type = 0 2024-04-19T03:35:24.512 INFO:teuthology.orchestra.run.smithi129.stdout: auth debug = true 2024-04-19T03:35:24.513 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.513 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on old message = true 2024-04-19T03:35:24.513 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on bug = true 2024-04-19T03:35:24.513 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T03:35:24.513 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn max object skew = 0 2024-04-19T03:35:24.513 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.514 INFO:teuthology.orchestra.run.smithi129.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T03:35:24.514 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T03:35:24.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.514 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default size = 2 2024-04-19T03:35:24.514 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.514 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow primary affinity = true 2024-04-19T03:35:24.515 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow pg remap = true 2024-04-19T03:35:24.515 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on legacy crush tunables = false 2024-04-19T03:35:24.515 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on crush straw calc version zero = false 2024-04-19T03:35:24.515 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on no sortbitwise = false 2024-04-19T03:35:24.515 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = false 2024-04-19T03:35:24.515 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on too few osds = false 2024-04-19T03:35:24.515 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T03:35:24.516 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T03:35:24.516 INFO:teuthology.orchestra.run.smithi129.stdout: mon_allow_pool_size_one = true 2024-04-19T03:35:24.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.516 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T03:35:24.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.516 INFO:teuthology.orchestra.run.smithi129.stdout: osd default data pool replay window = 5 2024-04-19T03:35:24.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.516 INFO:teuthology.orchestra.run.smithi129.stdout: mon allow pool delete = true 2024-04-19T03:35:24.516 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.517 INFO:teuthology.orchestra.run.smithi129.stdout: mon cluster log file level = debug 2024-04-19T03:35:24.517 INFO:teuthology.orchestra.run.smithi129.stdout: debug asserts on shutdown = true 2024-04-19T03:35:24.517 INFO:teuthology.orchestra.run.smithi129.stdout: mon health detail to clog = false 2024-04-19T03:35:24.517 INFO:teuthology.orchestra.run.smithi129.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],[v2:172.21.15.5:3302,v1:172.21.15.5:6791]" 2024-04-19T03:35:24.517 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pg_log_dups_tracked = 10000 2024-04-19T03:35:24.517 INFO:teuthology.orchestra.run.smithi129.stdout: fsid = 094bb330-e26a-42d1-b1be-7931c5493f05 2024-04-19T03:35:24.517 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.517 INFO:teuthology.orchestra.run.smithi129.stdout:[osd] 2024-04-19T03:35:24.517 INFO:teuthology.orchestra.run.smithi129.stdout: osd journal size = 100 2024-04-19T03:35:24.518 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.518 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub load threshold = 5.0 2024-04-19T03:35:24.518 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub max interval = 600 2024-04-19T03:35:24.518 INFO:teuthology.orchestra.run.smithi129.stdout: osd mclock profile = high_recovery_ops 2024-04-19T03:35:24.518 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.518 INFO:teuthology.orchestra.run.smithi129.stdout: osd recover clone overlap = true 2024-04-19T03:35:24.519 INFO:teuthology.orchestra.run.smithi129.stdout: osd recovery max chunk = 1048576 2024-04-19T03:35:24.519 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.519 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug shutdown = true 2024-04-19T03:35:24.519 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug op order = true 2024-04-19T03:35:24.519 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug verify stray on activate = true 2024-04-19T03:35:24.519 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.519 INFO:teuthology.orchestra.run.smithi129.stdout: osd open classes on start = true 2024-04-19T03:35:24.520 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug pg log writeout = true 2024-04-19T03:35:24.520 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.520 INFO:teuthology.orchestra.run.smithi129.stdout: osd deep scrub update digest min age = 30 2024-04-19T03:35:24.520 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.520 INFO:teuthology.orchestra.run.smithi129.stdout: osd map max advance = 10 2024-04-19T03:35:24.520 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.520 INFO:teuthology.orchestra.run.smithi129.stdout: journal zero on create = true 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: filestore ondisk finisher threads = 3 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: filestore apply finisher threads = 3 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: bdev debug aio = true 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug misdirected ops = true 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: bdev async discard = True 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: bdev enable discard = True 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore block size = 96636764160 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore fsck on mount = True 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluefs = 1/20 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluestore = 1/20 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: debug osd = 20 2024-04-19T03:35:24.521 INFO:teuthology.orchestra.run.smithi129.stdout: debug rocksdb = 4/10 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd full ratio = 0.9 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd nearfull ratio = 0.8 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: osd blocked scrub grace period = 3600 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: osd failsafe full ratio = 0.95 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: osd max markdown count = 1000 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: osd memory target = 1610612736 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: osd objectstore = bluestore 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr] 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: debug mgr = 20 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-04-19T03:35:24.522 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: mgr/telemetry/nag = false 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout:[mon] 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: debug paxos = 20 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: mon data avail warn = 5 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: mon mgr mkfs grace = 240 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd reporter subtree level = osd 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd prime pg temp = true 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:35:24.523 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: # 1m isn't quite enough 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: mon_down_mkfs_grace = 2m 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_filestore_osds = false 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout:[client] 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: rgw cache enabled = true 2024-04-19T03:35:24.524 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable ops log = true 2024-04-19T03:35:24.525 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable usage log = true 2024-04-19T03:35:24.525 INFO:teuthology.orchestra.run.smithi129.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T03:35:24.525 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T03:35:24.525 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.a] 2024-04-19T03:35:24.525 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.b] 2024-04-19T03:35:24.525 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.c] 2024-04-19T03:35:24.525 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2024-04-19T03:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-04-19T03:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-04-19T03:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T03:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-04-19T03:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-04-19T03:35:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T03:35:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],[v2:172.21.15.5:3302,v1:172.21.15.5:6791]" 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pg_log_dups_tracked = 10000 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 094bb330-e26a-42d1-b1be-7931c5493f05 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-04-19T03:35:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-04-19T03:35:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2024-04-19T03:35:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: osd blocked scrub grace period = 3600 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: osd max markdown count = 1000 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: osd memory target = 1610612736 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.532 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-04-19T03:35:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T03:35:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-04-19T03:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-04-19T03:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-04-19T03:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-19T03:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-04-19T03:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-04-19T03:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-04-19T03:35:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T03:35:24.536 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.537 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T03:35:24.538 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],[v2:172.21.15.5:3302,v1:172.21.15.5:6791]" 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pg_log_dups_tracked = 10000 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 094bb330-e26a-42d1-b1be-7931c5493f05 2024-04-19T03:35:24.539 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.540 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-04-19T03:35:24.541 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: osd blocked scrub grace period = 3600 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-04-19T03:35:24.542 INFO:teuthology.orchestra.run.smithi087.stdout: osd max markdown count = 1000 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: osd memory target = 1610612736 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-19T03:35:24.543 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T03:35:24.544 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-04-19T03:35:24.545 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-04-19T03:35:24.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-04-19T03:35:24.547 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-04-19T03:35:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],[v2:172.21.15.5:3302,v1:172.21.15.5:6791]" 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pg_log_dups_tracked = 10000 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 094bb330-e26a-42d1-b1be-7931c5493f05 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-04-19T03:35:24.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.550 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1/20 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T03:35:24.551 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: osd blocked scrub grace period = 3600 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: osd max markdown count = 1000 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: osd memory target = 1610612736 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:35:24.552 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T03:35:24.553 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-04-19T03:35:24.554 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-04-19T03:35:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T03:35:24.555 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T03:35:24.555 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-04-19T03:35:24.555 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-04-19T03:35:24.555 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-04-19T03:35:24.555 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-04-19T03:35:24.558 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-19T03:35:24.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-19T03:35:24.668 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-19T03:35:24.668 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:24.668 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-19T03:35:24.688 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:24.688 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-19T03:35:24.748 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-04-19T03:35:24.748 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:24.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T03:35:24.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:35:24.837 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:24.837 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:24.899 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-04-19T03:35:24.899 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:35:24.899 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T03:35:24.899 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:35:24.946 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:35:24.946 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:25.007 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-04-19T03:35:25.008 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:35:25.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T03:35:25.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:35:25.051 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:35:25.051 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:25.111 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi129.front.sepia.ceph.com 2024-04-19T03:35:25.111 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:35:25.111 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T03:35:25.111 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:35:25.156 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:35:25.156 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:25.216 INFO:tasks.ceph:Setting up mon nodes... 2024-04-19T03:35:25.216 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-19T03:35:25.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T03:35:25.284 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T03:35:25.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T03:35:25.351 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T03:35:25.354 INFO:tasks.ceph:Setting up mds nodes... 2024-04-19T03:35:25.354 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T03:35:25.418 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T03:35:25.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-19T03:35:25.452 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-19T03:35:25.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-19T03:35:25.545 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-19T03:35:25.560 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-19T03:35:25.560 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T03:35:25.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-19T03:35:25.595 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T03:35:25.595 INFO:tasks.ceph:role: osd.0 2024-04-19T03:35:25.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-19T03:35:25.595 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T03:35:25.698 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T03:35:25.698 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T03:35:25.698 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T03:35:25.698 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T03:35:25.698 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T03:35:25.698 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-19T03:35:25.698 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T03:35:25.698 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T03:35:25.699 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T03:35:25.699 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T03:35:26.994 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-19T03:35:26.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-19T03:35:26.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-19T03:35:27.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-19T03:35:27.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:27.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-19T03:35:27.206+0000 7fa9f31c97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-19T03:35:27.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-19T03:35:27.207+0000 7fa9f31c97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-19T03:35:27.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-19T03:35:27.207+0000 7fa9f31c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T03:35:27.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-19T03:35:27.207+0000 7fa9f31c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T03:35:27.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-19T03:35:27.207+0000 7fa9f31c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T03:35:27.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-19T03:35:27.207+0000 7fa9f31c97c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-19T03:35:30.064 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-19T03:35:30.098 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-19T03:35:30.131 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T03:35:30.131 INFO:tasks.ceph:role: osd.1 2024-04-19T03:35:30.131 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-19T03:35:30.132 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T03:35:30.210 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T03:35:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T03:35:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T03:35:30.210 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T03:35:30.211 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T03:35:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-19T03:35:30.211 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T03:35:30.211 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T03:35:30.211 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T03:35:30.211 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T03:35:30.647 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-19T03:35:30.649 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-19T03:35:30.650 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-19T03:35:30.826 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-19T03:35:30.860 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-19T03:35:30.964+0000 7f376d2a47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-19T03:35:30.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-19T03:35:30.965+0000 7f376d2a47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-19T03:35:30.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-19T03:35:30.965+0000 7f376d2a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T03:35:30.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-19T03:35:30.965+0000 7f376d2a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T03:35:30.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-19T03:35:30.965+0000 7f376d2a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T03:35:30.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-19T03:35:30.973+0000 7f376d2a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-19T03:35:33.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-19T03:35:33.875 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-19T03:35:33.908 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T03:35:33.908 INFO:tasks.ceph:role: osd.2 2024-04-19T03:35:33.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com 2024-04-19T03:35:33.908 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T03:35:33.986 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T03:35:33.986 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T03:35:33.986 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T03:35:33.986 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-19T03:35:33.986 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T03:35:33.986 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-04-19T03:35:33.987 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T03:35:33.987 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T03:35:33.987 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T03:35:33.987 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T03:35:34.413 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-04-19T03:35:34.415 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-04-19T03:35:34.415 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-19T03:35:34.602 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-19T03:35:34.640 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:34.734 INFO:teuthology.orchestra.run.smithi129.stderr:2024-04-19T03:35:34.734+0000 7f38018527c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-19T03:35:34.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-04-19T03:35:34.736+0000 7f38018527c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-19T03:35:34.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-04-19T03:35:34.736+0000 7f38018527c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T03:35:34.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-04-19T03:35:34.736+0000 7f38018527c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T03:35:34.736 INFO:teuthology.orchestra.run.smithi129.stderr:2024-04-19T03:35:34.736+0000 7f38018527c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T03:35:34.743 INFO:teuthology.orchestra.run.smithi129.stderr:2024-04-19T03:35:34.743+0000 7f38018527c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-19T03:35:37.594 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-19T03:35:37.626 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-19T03:35:37.626 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:37.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-19T03:35:37.662 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:37.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-19T03:35:37.742 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:37.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-19T03:35:37.817 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:35:37.817 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-19T03:35:37.853 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:35:37.853 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-19T03:35:37.886 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:35:37.886 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-19T03:35:37.918 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:35:37.918 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-19T03:35:37.941 INFO:tasks.ceph:Adding keys to all mons... 2024-04-19T03:35:37.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-19T03:35:38.014 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB95iFm1Ob1EBAAZZmWBuR35IhwumukePgCHw== 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB95iFmjnL2FBAAwOb+h8c2Eiad3gTgfk0bcw== 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB95iFmo3zyGBAAEDcrpd3CHcBvwS1PARoobA== 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB/5iFm+dxWDBAACwksXNhlbkZg+ANdfhJMYg== 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCC5iFm/8GHORAA5KmflHtyl4oBbpo3kHhqbA== 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCG5iFmWr3GKxAAWeLVCTqfVpoBP6eU9PxnbA== 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-19T03:35:38.015 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB95iFmE8h9IBAArUC6yA3qaxwO4uIjgfTbrg== 2024-04-19T03:35:38.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T03:35:38.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T03:35:38.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-19T03:35:38.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T03:35:38.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T03:35:38.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T03:35:38.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-19T03:35:38.493 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-19T03:35:38.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-19T03:35:38.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T03:35:38.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-19T03:35:38.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-19T03:35:38.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T03:35:38.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-19T03:35:38.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-19T03:35:38.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T03:35:39.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-19T03:35:39.107 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:35:39.169 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-19T03:35:39.170 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-19T03:35:39.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-19T03:35:39.212 INFO:tasks.ceph.mon.a:Started 2024-04-19T03:35:39.213 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-19T03:35:39.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-19T03:35:39.215 INFO:tasks.ceph.mon.b:Started 2024-04-19T03:35:39.215 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-19T03:35:39.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-19T03:35:39.217 INFO:tasks.ceph.mon.c:Started 2024-04-19T03:35:39.217 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-19T03:35:39.218 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-19T03:35:39.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-19T03:35:39.220 INFO:tasks.ceph.mgr.x:Started 2024-04-19T03:35:39.220 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-19T03:35:39.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-19T03:35:39.223 INFO:tasks.ceph.mgr.y:Started 2024-04-19T03:35:39.223 INFO:tasks.ceph:Setting crush tunables to default 2024-04-19T03:35:39.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-04-19T03:35:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-04-19T03:35:44.543 INFO:tasks.ceph:check_enable_crimson: False 2024-04-19T03:35:44.543 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-19T03:35:44.543 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-19T03:35:44.544 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-19T03:35:44.578 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-19T03:35:44.579 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-19T03:35:44.613 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-04-19T03:35:44.613 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-19T03:35:44.645 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new a7e36406-63c4-4d90-9e2d-6418a6750ec1 0 2024-04-19T03:35:44.908 INFO:teuthology.orchestra.run.smithi129.stdout:0 2024-04-19T03:35:44.920 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 098c6748-6099-4f21-8443-fa1806e634c1 1 2024-04-19T03:35:45.130 INFO:teuthology.orchestra.run.smithi129.stdout:1 2024-04-19T03:35:45.143 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 05fd0106-3888-443d-b028-e3735dc03df0 2 2024-04-19T03:35:45.356 INFO:teuthology.orchestra.run.smithi129.stdout:2 2024-04-19T03:35:45.368 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-19T03:35:45.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-19T03:35:45.371 INFO:tasks.ceph.osd.0:Started 2024-04-19T03:35:45.371 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-19T03:35:45.371 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-19T03:35:45.374 INFO:tasks.ceph.osd.1:Started 2024-04-19T03:35:45.374 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-19T03:35:45.374 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-19T03:35:45.376 INFO:tasks.ceph.osd.2:Started 2024-04-19T03:35:45.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:35:45.610 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:45.610 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:35:45.353224+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:35:45.625 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-19T03:35:45.625 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-19T03:35:45.839 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:45.838+0000 7f57cbeb1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T03:35:45.840 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:45.838+0000 7ff4c48ed200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T03:35:45.928 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T03:35:45.944 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:45.944+0000 7ff4c48ed200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T03:35:45.946 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:45.945+0000 7f57cbeb1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T03:35:45.964 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:35:45.963+0000 7fca2053e7c0 -1 Falling back to public interface 2024-04-19T03:35:45.978 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:35:45.977+0000 7f83df6647c0 -1 Falling back to public interface 2024-04-19T03:35:45.981 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:35:45.979+0000 7f3b6b38f7c0 -1 Falling back to public interface 2024-04-19T03:35:46.031 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:46.030+0000 7ff4c48ed200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T03:35:46.032 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:46.032+0000 7f57cbeb1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T03:35:46.115 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:46.114+0000 7ff4c48ed200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T03:35:46.117 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:46.116+0000 7f57cbeb1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T03:35:46.142 INFO:teuthology.misc.health.smithi005.stdout: 2024-04-19T03:35:46.142 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":5,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:35:45.353224+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:35:46.157 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-19T03:35:46.326 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:46.326+0000 7ff4c48ed200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T03:35:46.329 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:46.328+0000 7f57cbeb1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T03:35:46.518 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:46.517+0000 7ff4c48ed200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T03:35:46.518 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:46.517+0000 7f57cbeb1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T03:35:46.648 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:46.647+0000 7f57cbeb1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T03:35:46.648 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:46.647+0000 7ff4c48ed200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T03:35:46.757 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:46.756+0000 7ff4c48ed200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T03:35:46.757 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:46.756+0000 7f57cbeb1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T03:35:46.853 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:46.853+0000 7ff4c48ed200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T03:35:46.854 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:46.853+0000 7f57cbeb1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T03:35:47.121 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:47.120+0000 7f57cbeb1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T03:35:47.121 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:47.120+0000 7ff4c48ed200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T03:35:47.203 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:47.202+0000 7ff4c48ed200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T03:35:47.203 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:47.202+0000 7f57cbeb1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T03:35:47.635 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:47.634+0000 7f57cbeb1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T03:35:47.635 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:47.634+0000 7ff4c48ed200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T03:35:48.009 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:48.007+0000 7ff4c48ed200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T03:35:48.010 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:48.007+0000 7f57cbeb1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T03:35:48.192 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:48.191+0000 7f57cbeb1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T03:35:48.192 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:48.191+0000 7ff4c48ed200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-19T03:35:48.283 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:48.282+0000 7f57cbeb1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T03:35:48.284 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:48.282+0000 7ff4c48ed200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T03:35:49.098 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:49.096+0000 7f57cbeb1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T03:35:49.098 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:49.097+0000 7ff4c48ed200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T03:35:49.193 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:49.192+0000 7ff4c48ed200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T03:35:49.194 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:49.193+0000 7f57cbeb1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T03:35:49.347 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:49.346+0000 7ff4c48ed200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T03:35:49.347 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:49.346+0000 7f57cbeb1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T03:35:49.416 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:35:49.414+0000 7fca2053e7c0 -1 osd.2 0 log_to_monitors true 2024-04-19T03:35:49.420 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:35:49.420+0000 7f83df6647c0 -1 osd.1 0 log_to_monitors true 2024-04-19T03:35:49.459 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:35:49.457+0000 7f3b6b38f7c0 -1 osd.0 0 log_to_monitors true 2024-04-19T03:35:49.994 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:49.993+0000 7ff4c48ed200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T03:35:49.996 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:49.995+0000 7f57cbeb1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-19T03:35:50.290 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:50.289+0000 7ff4c48ed200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T03:35:50.291 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:50.289+0000 7f57cbeb1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T03:35:50.487 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:50.486+0000 7ff4c48ed200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T03:35:50.487 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:50.486+0000 7f57cbeb1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T03:35:51.360 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:35:51.359+0000 7f83d4a1c700 -1 osd.1 0 waiting for initial osdmap 2024-04-19T03:35:51.374 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:35:51.373+0000 7f83cb5f4700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T03:35:51.386 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:35:51.384+0000 7fca140f3700 -1 osd.2 0 waiting for initial osdmap 2024-04-19T03:35:51.400 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:35:51.399+0000 7fca0c4ce700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T03:35:51.438 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:51.437+0000 7f57cbeb1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T03:35:51.439 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:51.437+0000 7ff4c48ed200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T03:35:51.440 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:35:51.439+0000 7f3b5ef44700 -1 osd.0 0 waiting for initial osdmap 2024-04-19T03:35:51.456 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:35:51.455+0000 7f3b5731f700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T03:35:51.714 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:51.713+0000 7f57cbeb1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T03:35:51.714 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:51.713+0000 7ff4c48ed200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T03:35:51.800 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:51.799+0000 7f57cbeb1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T03:35:51.801 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:51.799+0000 7ff4c48ed200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T03:35:52.248 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-04-19T03:35:52.247+0000 7f57cbeb1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T03:35:52.249 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:52.247+0000 7ff4c48ed200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T03:35:52.459 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T03:35:52.674 INFO:teuthology.misc.health.smithi005.stdout: 2024-04-19T03:35:52.674 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":8,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:35:52.387428+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:35:52.686 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-19T03:35:52.686 INFO:tasks.ceph:Creating RBD pool 2024-04-19T03:35:52.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-19T03:35:53.278 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:53.277+0000 7ff47fb65700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-19T03:35:53.278 INFO:tasks.ceph.mgr.x.smithi005.stderr:2024-04-19T03:35:53.277+0000 7ff47fb65700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-19T03:35:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'rbd' created 2024-04-19T03:35:53.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-19T03:35:54.410 INFO:teuthology.orchestra.run.smithi005.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-19T03:35:54.424 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-19T03:35:54.424 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-19T03:35:54.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-19T03:35:54.427 INFO:tasks.ceph.mds.a:Started 2024-04-19T03:35:54.427 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-19T03:35:54.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:35:54.517 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-19T03:35:54.799 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:35:54.393544+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:35:54.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:35:52.932739+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:35:54.326287+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:35:54.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:35:55.186 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2024-04-19T03:35:55.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:35:55.577 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-19T03:35:55.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:35:56.044 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:56.044 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6803/2772249024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2772249024},{"type":"v1","addr":"172.21.15.5:6803","nonce":2772249024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-19T03:35:56.048 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-04-19T03:35:56.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:35:56.442 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:56.443 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":12,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:35:56.404400+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:35:56.458 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:35:52.932739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:35:54.326287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:35:56.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:35:56.822 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2024-04-19T03:35:56.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:35:57.207 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-19T03:35:57.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-19T03:35:57.589 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:35:57.589 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-04-19T03:35:57.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-19T03:35:57.589 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-04-19T03:35:57.589 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2024-04-19T03:35:57.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-19T03:35:57.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-04-19T03:35:57.590 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2024-04-19T03:35:57.590 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-04-19T03:35:57.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-19T03:35:57.590 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-04-19T03:35:57.605 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-19T03:35:57.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-19T03:35:58.422 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-04-19T03:35:58.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-19T03:35:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-04-19T03:35:59.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-19T03:35:59.868 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 3 and data pool 4 2024-04-19T03:35:59.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:36:00.245 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:00.246 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:35:59.859546+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:36:00.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:36:00.630 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:00.630 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:35:59.859546+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:36:00.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-19T03:36:01.887 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-19T03:36:01.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-19T03:36:02.892 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-19T03:36:02.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:36:03.395 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:03.396 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:35:59.859870+0000","modified":"2024-04-19T03:36:02.866201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6803/2772249024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2772249024},{"type":"v1","addr":"172.21.15.5:6803","nonce":2772249024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:36:03.399 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-19T03:36:03.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:36:03.776 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:03.776 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:36:00.861407+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:36:03.792 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-19T03:36:03.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:36:04.162 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:36:04.175 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-19T03:36:02.268738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87444,"kb_used_data":1472,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028076,"statfs":{"total":289910292480,"available":289820749824,"internally_reserved":0,"allocated":1507328,"data_stored":1272926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.852631"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-19T03:35:56.414540+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:35:56.414540+0000","last_peered":"2024-04-19T03:35:56.414540+0000","last_clean":"2024-04-19T03:35:56.414540+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:35:56.414540+0000","last_undegraded":"2024-04-19T03:35:56.414540+0000","last_fullsized":"2024-04-19T03:35:56.414540+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-19T03:35:56.414536+0000","last_change":"2024-04-19T03:35:54.405842+0000","last_active":"2024-04-19T03:35:56.414536+0000","last_peered":"2024-04-19T03:35:56.414536+0000","last_clean":"2024-04-19T03:35:56.414536+0000","last_became_active":"2024-04-19T03:35:54.405465+0000","last_became_peered":"2024-04-19T03:35:54.405465+0000","last_unstale":"2024-04-19T03:35:56.414536+0000","last_undegraded":"2024-04-19T03:35:56.414536+0000","last_fullsized":"2024-04-19T03:35:56.414536+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-19T03:35:56.411828+0000","last_change":"2024-04-19T03:35:54.404971+0000","last_active":"2024-04-19T03:35:56.411828+0000","last_peered":"2024-04-19T03:35:56.411828+0000","last_clean":"2024-04-19T03:35:56.411828+0000","last_became_active":"2024-04-19T03:35:54.404670+0000","last_became_peered":"2024-04-19T03:35:54.404670+0000","last_unstale":"2024-04-19T03:35:56.411828+0000","last_undegraded":"2024-04-19T03:35:56.411828+0000","last_fullsized":"2024-04-19T03:35:56.411828+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:47.049313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":206,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-19T03:35:56.411908+0000","last_change":"2024-04-19T03:35:55.405560+0000","last_active":"2024-04-19T03:35:56.411908+0000","last_peered":"2024-04-19T03:35:56.411908+0000","last_clean":"2024-04-19T03:35:56.411908+0000","last_became_active":"2024-04-19T03:35:55.405342+0000","last_became_peered":"2024-04-19T03:35:55.405342+0000","last_unstale":"2024-04-19T03:35:56.411908+0000","last_undegraded":"2024-04-19T03:35:56.411908+0000","last_fullsized":"2024-04-19T03:35:56.411908+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:27.418444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-19T03:35:56.411869+0000","last_change":"2024-04-19T03:35:54.408755+0000","last_active":"2024-04-19T03:35:56.411869+0000","last_peered":"2024-04-19T03:35:56.411869+0000","last_clean":"2024-04-19T03:35:56.411869+0000","last_became_active":"2024-04-19T03:35:54.408501+0000","last_became_peered":"2024-04-19T03:35:54.408501+0000","last_unstale":"2024-04-19T03:35:56.411869+0000","last_undegraded":"2024-04-19T03:35:56.411869+0000","last_fullsized":"2024-04-19T03:35:56.411869+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-19T03:35:56.411881+0000","last_change":"2024-04-19T03:35:54.405961+0000","last_active":"2024-04-19T03:35:56.411881+0000","last_peered":"2024-04-19T03:35:56.411881+0000","last_clean":"2024-04-19T03:35:56.411881+0000","last_became_active":"2024-04-19T03:35:54.405640+0000","last_became_peered":"2024-04-19T03:35:54.405640+0000","last_unstale":"2024-04-19T03:35:56.411881+0000","last_undegraded":"2024-04-19T03:35:56.411881+0000","last_fullsized":"2024-04-19T03:35:56.411881+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-19T03:35:56.414620+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:35:56.414620+0000","last_peered":"2024-04-19T03:35:56.414620+0000","last_clean":"2024-04-19T03:35:56.414620+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:35:56.414620+0000","last_undegraded":"2024-04-19T03:35:56.414620+0000","last_fullsized":"2024-04-19T03:35:56.414620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-19T03:35:56.414558+0000","last_change":"2024-04-19T03:35:54.405542+0000","last_active":"2024-04-19T03:35:56.414558+0000","last_peered":"2024-04-19T03:35:56.414558+0000","last_clean":"2024-04-19T03:35:56.414558+0000","last_became_active":"2024-04-19T03:35:54.405292+0000","last_became_peered":"2024-04-19T03:35:54.405292+0000","last_unstale":"2024-04-19T03:35:56.414558+0000","last_undegraded":"2024-04-19T03:35:56.414558+0000","last_fullsized":"2024-04-19T03:35:56.414558+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-04-19T03:35:56.411949+0000","last_change":"2024-04-19T03:35:54.405958+0000","last_active":"2024-04-19T03:35:56.411949+0000","last_peered":"2024-04-19T03:35:56.411949+0000","last_clean":"2024-04-19T03:35:56.411949+0000","last_became_active":"2024-04-19T03:35:54.405578+0000","last_became_peered":"2024-04-19T03:35:54.405578+0000","last_unstale":"2024-04-19T03:35:56.411949+0000","last_undegraded":"2024-04-19T03:35:56.411949+0000","last_fullsized":"2024-04-19T03:35:56.411949+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:11.280110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:58.410930+0000","last_change":"2024-04-19T03:35:58.410930+0000","last_active":"2024-04-19T03:35:58.410930+0000","last_peered":"2024-04-19T03:35:58.410930+0000","last_clean":"2024-04-19T03:35:58.410930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:58.410930+0000","last_undegraded":"2024-04-19T03:35:58.410930+0000","last_fullsized":"2024-04-19T03:35:58.410930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:35:59.415213+0000","last_change":"2024-04-19T03:35:59.415213+0000","last_active":"2024-04-19T03:35:59.415213+0000","last_peered":"2024-04-19T03:35:59.415213+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:35:59.415213+0000","last_undegraded":"2024-04-19T03:35:59.415213+0000","last_fullsized":"2024-04-19T03:35:59.415213+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":700416,"data_stored":621098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":700416,"data_stored":621098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":106496,"data_stored":30730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:36:04.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:36:04.590 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:36:04.604 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-19T03:36:04.269062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.852955"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869083+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:36:00.869083+0000","last_peered":"2024-04-19T03:36:00.869083+0000","last_clean":"2024-04-19T03:36:00.869083+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:36:00.869083+0000","last_undegraded":"2024-04-19T03:36:00.869083+0000","last_fullsized":"2024-04-19T03:36:00.869083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868676+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:36:00.868676+0000","last_peered":"2024-04-19T03:36:00.868676+0000","last_clean":"2024-04-19T03:36:00.868676+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:36:00.868676+0000","last_undegraded":"2024-04-19T03:36:00.868676+0000","last_fullsized":"2024-04-19T03:36:00.868676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868331+0000","last_change":"2024-04-19T03:35:59.886429+0000","last_active":"2024-04-19T03:36:00.868331+0000","last_peered":"2024-04-19T03:36:00.868331+0000","last_clean":"2024-04-19T03:36:00.868331+0000","last_became_active":"2024-04-19T03:35:59.886189+0000","last_became_peered":"2024-04-19T03:35:59.886189+0000","last_unstale":"2024-04-19T03:36:00.868331+0000","last_undegraded":"2024-04-19T03:36:00.868331+0000","last_fullsized":"2024-04-19T03:36:00.868331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867838+0000","last_change":"2024-04-19T03:35:59.878844+0000","last_active":"2024-04-19T03:36:00.867838+0000","last_peered":"2024-04-19T03:36:00.867838+0000","last_clean":"2024-04-19T03:36:00.867838+0000","last_became_active":"2024-04-19T03:35:59.878100+0000","last_became_peered":"2024-04-19T03:35:59.878100+0000","last_unstale":"2024-04-19T03:36:00.867838+0000","last_undegraded":"2024-04-19T03:36:00.867838+0000","last_fullsized":"2024-04-19T03:36:00.867838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868178+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:36:00.868178+0000","last_peered":"2024-04-19T03:36:00.868178+0000","last_clean":"2024-04-19T03:36:00.868178+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:36:00.868178+0000","last_undegraded":"2024-04-19T03:36:00.868178+0000","last_fullsized":"2024-04-19T03:36:00.868178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867527+0000","last_change":"2024-04-19T03:35:59.876553+0000","last_active":"2024-04-19T03:36:00.867527+0000","last_peered":"2024-04-19T03:36:00.867527+0000","last_clean":"2024-04-19T03:36:00.867527+0000","last_became_active":"2024-04-19T03:35:59.875201+0000","last_became_peered":"2024-04-19T03:35:59.875201+0000","last_unstale":"2024-04-19T03:36:00.867527+0000","last_undegraded":"2024-04-19T03:36:00.867527+0000","last_fullsized":"2024-04-19T03:36:00.867527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867483+0000","last_change":"2024-04-19T03:35:59.876305+0000","last_active":"2024-04-19T03:36:00.867483+0000","last_peered":"2024-04-19T03:36:00.867483+0000","last_clean":"2024-04-19T03:36:00.867483+0000","last_became_active":"2024-04-19T03:35:59.875093+0000","last_became_peered":"2024-04-19T03:35:59.875093+0000","last_unstale":"2024-04-19T03:36:00.867483+0000","last_undegraded":"2024-04-19T03:36:00.867483+0000","last_fullsized":"2024-04-19T03:36:00.867483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867184+0000","last_change":"2024-04-19T03:35:59.880058+0000","last_active":"2024-04-19T03:36:00.867184+0000","last_peered":"2024-04-19T03:36:00.867184+0000","last_clean":"2024-04-19T03:36:00.867184+0000","last_became_active":"2024-04-19T03:35:59.878691+0000","last_became_peered":"2024-04-19T03:35:59.878691+0000","last_unstale":"2024-04-19T03:36:00.867184+0000","last_undegraded":"2024-04-19T03:36:00.867184+0000","last_fullsized":"2024-04-19T03:36:00.867184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868945+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:36:00.868945+0000","last_peered":"2024-04-19T03:36:00.868945+0000","last_clean":"2024-04-19T03:36:00.868945+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:36:00.868945+0000","last_undegraded":"2024-04-19T03:36:00.868945+0000","last_fullsized":"2024-04-19T03:36:00.868945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868069+0000","last_change":"2024-04-19T03:35:59.878070+0000","last_active":"2024-04-19T03:36:00.868069+0000","last_peered":"2024-04-19T03:36:00.868069+0000","last_clean":"2024-04-19T03:36:00.868069+0000","last_became_active":"2024-04-19T03:35:59.876291+0000","last_became_peered":"2024-04-19T03:35:59.876291+0000","last_unstale":"2024-04-19T03:36:00.868069+0000","last_undegraded":"2024-04-19T03:36:00.868069+0000","last_fullsized":"2024-04-19T03:36:00.868069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868341+0000","last_change":"2024-04-19T03:35:59.883585+0000","last_active":"2024-04-19T03:36:00.868341+0000","last_peered":"2024-04-19T03:36:00.868341+0000","last_clean":"2024-04-19T03:36:00.868341+0000","last_became_active":"2024-04-19T03:35:59.883232+0000","last_became_peered":"2024-04-19T03:35:59.883232+0000","last_unstale":"2024-04-19T03:36:00.868341+0000","last_undegraded":"2024-04-19T03:36:00.868341+0000","last_fullsized":"2024-04-19T03:36:00.868341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867977+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:36:00.867977+0000","last_peered":"2024-04-19T03:36:00.867977+0000","last_clean":"2024-04-19T03:36:00.867977+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:36:00.867977+0000","last_undegraded":"2024-04-19T03:36:00.867977+0000","last_fullsized":"2024-04-19T03:36:00.867977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867945+0000","last_change":"2024-04-19T03:35:59.882444+0000","last_active":"2024-04-19T03:36:00.867945+0000","last_peered":"2024-04-19T03:36:00.867945+0000","last_clean":"2024-04-19T03:36:00.867945+0000","last_became_active":"2024-04-19T03:35:59.882075+0000","last_became_peered":"2024-04-19T03:35:59.882075+0000","last_unstale":"2024-04-19T03:36:00.867945+0000","last_undegraded":"2024-04-19T03:36:00.867945+0000","last_fullsized":"2024-04-19T03:36:00.867945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867610+0000","last_change":"2024-04-19T03:35:59.882604+0000","last_active":"2024-04-19T03:36:00.867610+0000","last_peered":"2024-04-19T03:36:00.867610+0000","last_clean":"2024-04-19T03:36:00.867610+0000","last_became_active":"2024-04-19T03:35:59.882330+0000","last_became_peered":"2024-04-19T03:35:59.882330+0000","last_unstale":"2024-04-19T03:36:00.867610+0000","last_undegraded":"2024-04-19T03:36:00.867610+0000","last_fullsized":"2024-04-19T03:36:00.867610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867199+0000","last_change":"2024-04-19T03:35:59.880349+0000","last_active":"2024-04-19T03:36:00.867199+0000","last_peered":"2024-04-19T03:36:00.867199+0000","last_clean":"2024-04-19T03:36:00.867199+0000","last_became_active":"2024-04-19T03:35:59.879119+0000","last_became_peered":"2024-04-19T03:35:59.879119+0000","last_unstale":"2024-04-19T03:36:00.867199+0000","last_undegraded":"2024-04-19T03:36:00.867199+0000","last_fullsized":"2024-04-19T03:36:00.867199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867891+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:36:00.867891+0000","last_peered":"2024-04-19T03:36:00.867891+0000","last_clean":"2024-04-19T03:36:00.867891+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:36:00.867891+0000","last_undegraded":"2024-04-19T03:36:00.867891+0000","last_fullsized":"2024-04-19T03:36:00.867891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868856+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868856+0000","last_peered":"2024-04-19T03:36:00.868856+0000","last_clean":"2024-04-19T03:36:00.868856+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:36:00.868856+0000","last_undegraded":"2024-04-19T03:36:00.868856+0000","last_fullsized":"2024-04-19T03:36:00.868856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867771+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:36:00.867771+0000","last_peered":"2024-04-19T03:36:00.867771+0000","last_clean":"2024-04-19T03:36:00.867771+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:36:00.867771+0000","last_undegraded":"2024-04-19T03:36:00.867771+0000","last_fullsized":"2024-04-19T03:36:00.867771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867992+0000","last_change":"2024-04-19T03:35:59.879234+0000","last_active":"2024-04-19T03:36:00.867992+0000","last_peered":"2024-04-19T03:36:00.867992+0000","last_clean":"2024-04-19T03:36:00.867992+0000","last_became_active":"2024-04-19T03:35:59.878820+0000","last_became_peered":"2024-04-19T03:35:59.878820+0000","last_unstale":"2024-04-19T03:36:00.867992+0000","last_undegraded":"2024-04-19T03:36:00.867992+0000","last_fullsized":"2024-04-19T03:36:00.867992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.877313+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.875350+0000","last_became_peered":"2024-04-19T03:35:59.875350+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868267+0000","last_change":"2024-04-19T03:35:59.881019+0000","last_active":"2024-04-19T03:36:00.868267+0000","last_peered":"2024-04-19T03:36:00.868267+0000","last_clean":"2024-04-19T03:36:00.868267+0000","last_became_active":"2024-04-19T03:35:59.880363+0000","last_became_peered":"2024-04-19T03:35:59.880363+0000","last_unstale":"2024-04-19T03:36:00.868267+0000","last_undegraded":"2024-04-19T03:36:00.868267+0000","last_fullsized":"2024-04-19T03:36:00.868267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867430+0000","last_change":"2024-04-19T03:35:59.872083+0000","last_active":"2024-04-19T03:36:00.867430+0000","last_peered":"2024-04-19T03:36:00.867430+0000","last_clean":"2024-04-19T03:36:00.867430+0000","last_became_active":"2024-04-19T03:35:59.871872+0000","last_became_peered":"2024-04-19T03:35:59.871872+0000","last_unstale":"2024-04-19T03:36:00.867430+0000","last_undegraded":"2024-04-19T03:36:00.867430+0000","last_fullsized":"2024-04-19T03:36:00.867430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868080+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:36:00.868080+0000","last_peered":"2024-04-19T03:36:00.868080+0000","last_clean":"2024-04-19T03:36:00.868080+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:36:00.868080+0000","last_undegraded":"2024-04-19T03:36:00.868080+0000","last_fullsized":"2024-04-19T03:36:00.868080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869076+0000","last_change":"2024-04-19T03:35:59.882017+0000","last_active":"2024-04-19T03:36:00.869076+0000","last_peered":"2024-04-19T03:36:00.869076+0000","last_clean":"2024-04-19T03:36:00.869076+0000","last_became_active":"2024-04-19T03:35:59.881048+0000","last_became_peered":"2024-04-19T03:35:59.881048+0000","last_unstale":"2024-04-19T03:36:00.869076+0000","last_undegraded":"2024-04-19T03:36:00.869076+0000","last_fullsized":"2024-04-19T03:36:00.869076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868233+0000","last_change":"2024-04-19T03:35:59.873199+0000","last_active":"2024-04-19T03:36:00.868233+0000","last_peered":"2024-04-19T03:36:00.868233+0000","last_clean":"2024-04-19T03:36:00.868233+0000","last_became_active":"2024-04-19T03:35:59.872661+0000","last_became_peered":"2024-04-19T03:35:59.872661+0000","last_unstale":"2024-04-19T03:36:00.868233+0000","last_undegraded":"2024-04-19T03:36:00.868233+0000","last_fullsized":"2024-04-19T03:36:00.868233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868190+0000","last_change":"2024-04-19T03:35:59.882737+0000","last_active":"2024-04-19T03:36:00.868190+0000","last_peered":"2024-04-19T03:36:00.868190+0000","last_clean":"2024-04-19T03:36:00.868190+0000","last_became_active":"2024-04-19T03:35:59.882537+0000","last_became_peered":"2024-04-19T03:35:59.882537+0000","last_unstale":"2024-04-19T03:36:00.868190+0000","last_undegraded":"2024-04-19T03:36:00.868190+0000","last_fullsized":"2024-04-19T03:36:00.868190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867954+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:36:00.867954+0000","last_peered":"2024-04-19T03:36:00.867954+0000","last_clean":"2024-04-19T03:36:00.867954+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:36:00.867954+0000","last_undegraded":"2024-04-19T03:36:00.867954+0000","last_fullsized":"2024-04-19T03:36:00.867954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868942+0000","last_change":"2024-04-19T03:35:59.882176+0000","last_active":"2024-04-19T03:36:00.868942+0000","last_peered":"2024-04-19T03:36:00.868942+0000","last_clean":"2024-04-19T03:36:00.868942+0000","last_became_active":"2024-04-19T03:35:59.881216+0000","last_became_peered":"2024-04-19T03:35:59.881216+0000","last_unstale":"2024-04-19T03:36:00.868942+0000","last_undegraded":"2024-04-19T03:36:00.868942+0000","last_fullsized":"2024-04-19T03:36:00.868942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867298+0000","last_change":"2024-04-19T03:35:59.429598+0000","last_active":"2024-04-19T03:36:00.867298+0000","last_peered":"2024-04-19T03:36:00.867298+0000","last_clean":"2024-04-19T03:36:00.867298+0000","last_became_active":"2024-04-19T03:35:59.429239+0000","last_became_peered":"2024-04-19T03:35:59.429239+0000","last_unstale":"2024-04-19T03:36:00.867298+0000","last_undegraded":"2024-04-19T03:36:00.867298+0000","last_fullsized":"2024-04-19T03:36:00.867298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868065+0000","last_change":"2024-04-19T03:35:59.872790+0000","last_active":"2024-04-19T03:36:00.868065+0000","last_peered":"2024-04-19T03:36:00.868065+0000","last_clean":"2024-04-19T03:36:00.868065+0000","last_became_active":"2024-04-19T03:35:59.872223+0000","last_became_peered":"2024-04-19T03:35:59.872223+0000","last_unstale":"2024-04-19T03:36:00.868065+0000","last_undegraded":"2024-04-19T03:36:00.868065+0000","last_fullsized":"2024-04-19T03:36:00.868065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867213+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:36:00.867213+0000","last_peered":"2024-04-19T03:36:00.867213+0000","last_clean":"2024-04-19T03:36:00.867213+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:36:00.867213+0000","last_undegraded":"2024-04-19T03:36:00.867213+0000","last_fullsized":"2024-04-19T03:36:00.867213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868970+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868970+0000","last_peered":"2024-04-19T03:36:00.868970+0000","last_clean":"2024-04-19T03:36:00.868970+0000","last_became_active":"2024-04-19T03:35:59.881795+0000","last_became_peered":"2024-04-19T03:35:59.881795+0000","last_unstale":"2024-04-19T03:36:00.868970+0000","last_undegraded":"2024-04-19T03:36:00.868970+0000","last_fullsized":"2024-04-19T03:36:00.868970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868091+0000","last_change":"2024-04-19T03:35:59.429529+0000","last_active":"2024-04-19T03:36:00.868091+0000","last_peered":"2024-04-19T03:36:00.868091+0000","last_clean":"2024-04-19T03:36:00.868091+0000","last_became_active":"2024-04-19T03:35:59.429121+0000","last_became_peered":"2024-04-19T03:35:59.429121+0000","last_unstale":"2024-04-19T03:36:00.868091+0000","last_undegraded":"2024-04-19T03:36:00.868091+0000","last_fullsized":"2024-04-19T03:36:00.868091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867146+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:36:00.867146+0000","last_peered":"2024-04-19T03:36:00.867146+0000","last_clean":"2024-04-19T03:36:00.867146+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:36:00.867146+0000","last_undegraded":"2024-04-19T03:36:00.867146+0000","last_fullsized":"2024-04-19T03:36:00.867146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868383+0000","last_change":"2024-04-19T03:35:59.434129+0000","last_active":"2024-04-19T03:36:00.868383+0000","last_peered":"2024-04-19T03:36:00.868383+0000","last_clean":"2024-04-19T03:36:00.868383+0000","last_became_active":"2024-04-19T03:35:59.433761+0000","last_became_peered":"2024-04-19T03:35:59.433761+0000","last_unstale":"2024-04-19T03:36:00.868383+0000","last_undegraded":"2024-04-19T03:36:00.868383+0000","last_fullsized":"2024-04-19T03:36:00.868383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867364+0000","last_change":"2024-04-19T03:35:59.872126+0000","last_active":"2024-04-19T03:36:00.867364+0000","last_peered":"2024-04-19T03:36:00.867364+0000","last_clean":"2024-04-19T03:36:00.867364+0000","last_became_active":"2024-04-19T03:35:59.871818+0000","last_became_peered":"2024-04-19T03:35:59.871818+0000","last_unstale":"2024-04-19T03:36:00.867364+0000","last_undegraded":"2024-04-19T03:36:00.867364+0000","last_fullsized":"2024-04-19T03:36:00.867364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:49:19.611505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868776+0000","last_change":"2024-04-19T03:35:59.431907+0000","last_active":"2024-04-19T03:36:00.868776+0000","last_peered":"2024-04-19T03:36:00.868776+0000","last_clean":"2024-04-19T03:36:00.868776+0000","last_became_active":"2024-04-19T03:35:59.431432+0000","last_became_peered":"2024-04-19T03:35:59.431432+0000","last_unstale":"2024-04-19T03:36:00.868776+0000","last_undegraded":"2024-04-19T03:36:00.868776+0000","last_fullsized":"2024-04-19T03:36:00.868776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867656+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:36:00.867656+0000","last_peered":"2024-04-19T03:36:00.867656+0000","last_clean":"2024-04-19T03:36:00.867656+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:36:00.867656+0000","last_undegraded":"2024-04-19T03:36:00.867656+0000","last_fullsized":"2024-04-19T03:36:00.867656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868141+0000","last_change":"2024-04-19T03:35:59.433961+0000","last_active":"2024-04-19T03:36:00.868141+0000","last_peered":"2024-04-19T03:36:00.868141+0000","last_clean":"2024-04-19T03:36:00.868141+0000","last_became_active":"2024-04-19T03:35:59.433506+0000","last_became_peered":"2024-04-19T03:35:59.433506+0000","last_unstale":"2024-04-19T03:36:00.868141+0000","last_undegraded":"2024-04-19T03:36:00.868141+0000","last_fullsized":"2024-04-19T03:36:00.868141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868192+0000","last_change":"2024-04-19T03:35:59.885493+0000","last_active":"2024-04-19T03:36:00.868192+0000","last_peered":"2024-04-19T03:36:00.868192+0000","last_clean":"2024-04-19T03:36:00.868192+0000","last_became_active":"2024-04-19T03:35:59.885107+0000","last_became_peered":"2024-04-19T03:35:59.885107+0000","last_unstale":"2024-04-19T03:36:00.868192+0000","last_undegraded":"2024-04-19T03:36:00.868192+0000","last_fullsized":"2024-04-19T03:36:00.868192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868108+0000","last_change":"2024-04-19T03:35:59.434133+0000","last_active":"2024-04-19T03:36:00.868108+0000","last_peered":"2024-04-19T03:36:00.868108+0000","last_clean":"2024-04-19T03:36:00.868108+0000","last_became_active":"2024-04-19T03:35:59.433755+0000","last_became_peered":"2024-04-19T03:35:59.433755+0000","last_unstale":"2024-04-19T03:36:00.868108+0000","last_undegraded":"2024-04-19T03:36:00.868108+0000","last_fullsized":"2024-04-19T03:36:00.868108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:17.507444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868452+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:36:00.868452+0000","last_peered":"2024-04-19T03:36:00.868452+0000","last_clean":"2024-04-19T03:36:00.868452+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:36:00.868452+0000","last_undegraded":"2024-04-19T03:36:00.868452+0000","last_fullsized":"2024-04-19T03:36:00.868452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867515+0000","last_change":"2024-04-19T03:35:59.428849+0000","last_active":"2024-04-19T03:36:00.867515+0000","last_peered":"2024-04-19T03:36:00.867515+0000","last_clean":"2024-04-19T03:36:00.867515+0000","last_became_active":"2024-04-19T03:35:59.428478+0000","last_became_peered":"2024-04-19T03:35:59.428478+0000","last_unstale":"2024-04-19T03:36:00.867515+0000","last_undegraded":"2024-04-19T03:36:00.867515+0000","last_fullsized":"2024-04-19T03:36:00.867515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869023+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:36:00.869023+0000","last_peered":"2024-04-19T03:36:00.869023+0000","last_clean":"2024-04-19T03:36:00.869023+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:36:00.869023+0000","last_undegraded":"2024-04-19T03:36:00.869023+0000","last_fullsized":"2024-04-19T03:36:00.869023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867937+0000","last_change":"2024-04-19T03:35:59.431877+0000","last_active":"2024-04-19T03:36:00.867937+0000","last_peered":"2024-04-19T03:36:00.867937+0000","last_clean":"2024-04-19T03:36:00.867937+0000","last_became_active":"2024-04-19T03:35:59.431343+0000","last_became_peered":"2024-04-19T03:35:59.431343+0000","last_unstale":"2024-04-19T03:36:00.867937+0000","last_undegraded":"2024-04-19T03:36:00.867937+0000","last_fullsized":"2024-04-19T03:36:00.867937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868161+0000","last_change":"2024-04-19T03:35:59.873111+0000","last_active":"2024-04-19T03:36:00.868161+0000","last_peered":"2024-04-19T03:36:00.868161+0000","last_clean":"2024-04-19T03:36:00.868161+0000","last_became_active":"2024-04-19T03:35:59.872468+0000","last_became_peered":"2024-04-19T03:35:59.872468+0000","last_unstale":"2024-04-19T03:36:00.868161+0000","last_undegraded":"2024-04-19T03:36:00.868161+0000","last_fullsized":"2024-04-19T03:36:00.868161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:30:15.469254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867684+0000","last_change":"2024-04-19T03:35:59.434023+0000","last_active":"2024-04-19T03:36:00.867684+0000","last_peered":"2024-04-19T03:36:00.867684+0000","last_clean":"2024-04-19T03:36:00.867684+0000","last_became_active":"2024-04-19T03:35:59.433542+0000","last_became_peered":"2024-04-19T03:35:59.433542+0000","last_unstale":"2024-04-19T03:36:00.867684+0000","last_undegraded":"2024-04-19T03:36:00.867684+0000","last_fullsized":"2024-04-19T03:36:00.867684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868203+0000","last_change":"2024-04-19T03:35:59.872558+0000","last_active":"2024-04-19T03:36:00.868203+0000","last_peered":"2024-04-19T03:36:00.868203+0000","last_clean":"2024-04-19T03:36:00.868203+0000","last_became_active":"2024-04-19T03:35:59.872302+0000","last_became_peered":"2024-04-19T03:35:59.872302+0000","last_unstale":"2024-04-19T03:36:00.868203+0000","last_undegraded":"2024-04-19T03:36:00.868203+0000","last_fullsized":"2024-04-19T03:36:00.868203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:14.886758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868499+0000","last_change":"2024-04-19T03:35:59.434430+0000","last_active":"2024-04-19T03:36:00.868499+0000","last_peered":"2024-04-19T03:36:00.868499+0000","last_clean":"2024-04-19T03:36:00.868499+0000","last_became_active":"2024-04-19T03:35:59.433885+0000","last_became_peered":"2024-04-19T03:35:59.433885+0000","last_unstale":"2024-04-19T03:36:00.868499+0000","last_undegraded":"2024-04-19T03:36:00.868499+0000","last_fullsized":"2024-04-19T03:36:00.868499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867570+0000","last_change":"2024-04-19T03:35:59.883449+0000","last_active":"2024-04-19T03:36:00.867570+0000","last_peered":"2024-04-19T03:36:00.867570+0000","last_clean":"2024-04-19T03:36:00.867570+0000","last_became_active":"2024-04-19T03:35:59.882794+0000","last_became_peered":"2024-04-19T03:35:59.882794+0000","last_unstale":"2024-04-19T03:36:00.867570+0000","last_undegraded":"2024-04-19T03:36:00.867570+0000","last_fullsized":"2024-04-19T03:36:00.867570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868576+0000","last_change":"2024-04-19T03:35:59.433568+0000","last_active":"2024-04-19T03:36:00.868576+0000","last_peered":"2024-04-19T03:36:00.868576+0000","last_clean":"2024-04-19T03:36:00.868576+0000","last_became_active":"2024-04-19T03:35:59.433247+0000","last_became_peered":"2024-04-19T03:35:59.433247+0000","last_unstale":"2024-04-19T03:36:00.868576+0000","last_undegraded":"2024-04-19T03:36:00.868576+0000","last_fullsized":"2024-04-19T03:36:00.868576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868220+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:36:00.868220+0000","last_peered":"2024-04-19T03:36:00.868220+0000","last_clean":"2024-04-19T03:36:00.868220+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:36:00.868220+0000","last_undegraded":"2024-04-19T03:36:00.868220+0000","last_fullsized":"2024-04-19T03:36:00.868220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868210+0000","last_change":"2024-04-19T03:35:59.433585+0000","last_active":"2024-04-19T03:36:00.868210+0000","last_peered":"2024-04-19T03:36:00.868210+0000","last_clean":"2024-04-19T03:36:00.868210+0000","last_became_active":"2024-04-19T03:35:59.433273+0000","last_became_peered":"2024-04-19T03:35:59.433273+0000","last_unstale":"2024-04-19T03:36:00.868210+0000","last_undegraded":"2024-04-19T03:36:00.868210+0000","last_fullsized":"2024-04-19T03:36:00.868210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867805+0000","last_change":"2024-04-19T03:35:59.876757+0000","last_active":"2024-04-19T03:36:00.867805+0000","last_peered":"2024-04-19T03:36:00.867805+0000","last_clean":"2024-04-19T03:36:00.867805+0000","last_became_active":"2024-04-19T03:35:59.876227+0000","last_became_peered":"2024-04-19T03:35:59.876227+0000","last_unstale":"2024-04-19T03:36:00.867805+0000","last_undegraded":"2024-04-19T03:36:00.867805+0000","last_fullsized":"2024-04-19T03:36:00.867805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867647+0000","last_change":"2024-04-19T03:35:59.431430+0000","last_active":"2024-04-19T03:36:00.867647+0000","last_peered":"2024-04-19T03:36:00.867647+0000","last_clean":"2024-04-19T03:36:00.867647+0000","last_became_active":"2024-04-19T03:35:59.431072+0000","last_became_peered":"2024-04-19T03:35:59.431072+0000","last_unstale":"2024-04-19T03:36:00.867647+0000","last_undegraded":"2024-04-19T03:36:00.867647+0000","last_fullsized":"2024-04-19T03:36:00.867647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867590+0000","last_change":"2024-04-19T03:35:59.876828+0000","last_active":"2024-04-19T03:36:00.867590+0000","last_peered":"2024-04-19T03:36:00.867590+0000","last_clean":"2024-04-19T03:36:00.867590+0000","last_became_active":"2024-04-19T03:35:59.876482+0000","last_became_peered":"2024-04-19T03:35:59.876482+0000","last_unstale":"2024-04-19T03:36:00.867590+0000","last_undegraded":"2024-04-19T03:36:00.867590+0000","last_fullsized":"2024-04-19T03:36:00.867590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:05.827809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867495+0000","last_change":"2024-04-19T03:35:59.429451+0000","last_active":"2024-04-19T03:36:00.867495+0000","last_peered":"2024-04-19T03:36:00.867495+0000","last_clean":"2024-04-19T03:36:00.867495+0000","last_became_active":"2024-04-19T03:35:59.429087+0000","last_became_peered":"2024-04-19T03:35:59.429087+0000","last_unstale":"2024-04-19T03:36:00.867495+0000","last_undegraded":"2024-04-19T03:36:00.867495+0000","last_fullsized":"2024-04-19T03:36:00.867495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:19.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867804+0000","last_change":"2024-04-19T03:35:59.879270+0000","last_active":"2024-04-19T03:36:00.867804+0000","last_peered":"2024-04-19T03:36:00.867804+0000","last_clean":"2024-04-19T03:36:00.867804+0000","last_became_active":"2024-04-19T03:35:59.878554+0000","last_became_peered":"2024-04-19T03:35:59.878554+0000","last_unstale":"2024-04-19T03:36:00.867804+0000","last_undegraded":"2024-04-19T03:36:00.867804+0000","last_fullsized":"2024-04-19T03:36:00.867804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867631+0000","last_change":"2024-04-19T03:35:59.431379+0000","last_active":"2024-04-19T03:36:00.867631+0000","last_peered":"2024-04-19T03:36:00.867631+0000","last_clean":"2024-04-19T03:36:00.867631+0000","last_became_active":"2024-04-19T03:35:59.431065+0000","last_became_peered":"2024-04-19T03:35:59.431065+0000","last_unstale":"2024-04-19T03:36:00.867631+0000","last_undegraded":"2024-04-19T03:36:00.867631+0000","last_fullsized":"2024-04-19T03:36:00.867631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868460+0000","last_change":"2024-04-19T03:35:59.885989+0000","last_active":"2024-04-19T03:36:00.868460+0000","last_peered":"2024-04-19T03:36:00.868460+0000","last_clean":"2024-04-19T03:36:00.868460+0000","last_became_active":"2024-04-19T03:35:59.885765+0000","last_became_peered":"2024-04-19T03:35:59.885765+0000","last_unstale":"2024-04-19T03:36:00.868460+0000","last_undegraded":"2024-04-19T03:36:00.868460+0000","last_fullsized":"2024-04-19T03:36:00.868460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867795+0000","last_change":"2024-04-19T03:35:59.431967+0000","last_active":"2024-04-19T03:36:00.867795+0000","last_peered":"2024-04-19T03:36:00.867795+0000","last_clean":"2024-04-19T03:36:00.867795+0000","last_became_active":"2024-04-19T03:35:59.431521+0000","last_became_peered":"2024-04-19T03:35:59.431521+0000","last_unstale":"2024-04-19T03:36:00.867795+0000","last_undegraded":"2024-04-19T03:36:00.867795+0000","last_fullsized":"2024-04-19T03:36:00.867795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868517+0000","last_change":"2024-04-19T03:35:59.885527+0000","last_active":"2024-04-19T03:36:00.868517+0000","last_peered":"2024-04-19T03:36:00.868517+0000","last_clean":"2024-04-19T03:36:00.868517+0000","last_became_active":"2024-04-19T03:35:59.885186+0000","last_became_peered":"2024-04-19T03:35:59.885186+0000","last_unstale":"2024-04-19T03:36:00.868517+0000","last_undegraded":"2024-04-19T03:36:00.868517+0000","last_fullsized":"2024-04-19T03:36:00.868517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867777+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:36:00.867777+0000","last_peered":"2024-04-19T03:36:00.867777+0000","last_clean":"2024-04-19T03:36:00.867777+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:36:00.867777+0000","last_undegraded":"2024-04-19T03:36:00.867777+0000","last_fullsized":"2024-04-19T03:36:00.867777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867975+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:36:00.867975+0000","last_peered":"2024-04-19T03:36:00.867975+0000","last_clean":"2024-04-19T03:36:00.867975+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:36:00.867975+0000","last_undegraded":"2024-04-19T03:36:00.867975+0000","last_fullsized":"2024-04-19T03:36:00.867975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867991+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:36:00.867991+0000","last_peered":"2024-04-19T03:36:00.867991+0000","last_clean":"2024-04-19T03:36:00.867991+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:36:00.867991+0000","last_undegraded":"2024-04-19T03:36:00.867991+0000","last_fullsized":"2024-04-19T03:36:00.867991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.874027+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:35:59.874027+0000","last_peered":"2024-04-19T03:35:59.874027+0000","last_clean":"2024-04-19T03:35:59.874027+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:35:59.874027+0000","last_undegraded":"2024-04-19T03:35:59.874027+0000","last_fullsized":"2024-04-19T03:35:59.874027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.866975+0000","last_change":"2024-04-19T03:35:59.878242+0000","last_active":"2024-04-19T03:36:00.866975+0000","last_peered":"2024-04-19T03:36:00.866975+0000","last_clean":"2024-04-19T03:36:00.866975+0000","last_became_active":"2024-04-19T03:35:59.877991+0000","last_became_peered":"2024-04-19T03:35:59.877991+0000","last_unstale":"2024-04-19T03:36:00.866975+0000","last_undegraded":"2024-04-19T03:36:00.866975+0000","last_fullsized":"2024-04-19T03:36:00.866975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:59:22.544717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873236+0000","last_change":"2024-04-19T03:35:54.405842+0000","last_active":"2024-04-19T03:35:59.873236+0000","last_peered":"2024-04-19T03:35:59.873236+0000","last_clean":"2024-04-19T03:35:59.873236+0000","last_became_active":"2024-04-19T03:35:54.405465+0000","last_became_peered":"2024-04-19T03:35:54.405465+0000","last_unstale":"2024-04-19T03:35:59.873236+0000","last_undegraded":"2024-04-19T03:35:59.873236+0000","last_fullsized":"2024-04-19T03:35:59.873236+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868054+0000","last_change":"2024-04-19T03:35:59.429504+0000","last_active":"2024-04-19T03:36:00.868054+0000","last_peered":"2024-04-19T03:36:00.868054+0000","last_clean":"2024-04-19T03:36:00.868054+0000","last_became_active":"2024-04-19T03:35:59.428445+0000","last_became_peered":"2024-04-19T03:35:59.428445+0000","last_unstale":"2024-04-19T03:36:00.868054+0000","last_undegraded":"2024-04-19T03:36:00.868054+0000","last_fullsized":"2024-04-19T03:36:00.868054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:36.587021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867969+0000","last_change":"2024-04-19T03:35:59.881612+0000","last_active":"2024-04-19T03:36:00.867969+0000","last_peered":"2024-04-19T03:36:00.867969+0000","last_clean":"2024-04-19T03:36:00.867969+0000","last_became_active":"2024-04-19T03:35:59.880798+0000","last_became_peered":"2024-04-19T03:35:59.880798+0000","last_unstale":"2024-04-19T03:36:00.867969+0000","last_undegraded":"2024-04-19T03:36:00.867969+0000","last_fullsized":"2024-04-19T03:36:00.867969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.863575+0000","last_change":"2024-04-19T03:35:54.404971+0000","last_active":"2024-04-19T03:35:59.863575+0000","last_peered":"2024-04-19T03:35:59.863575+0000","last_clean":"2024-04-19T03:35:59.863575+0000","last_became_active":"2024-04-19T03:35:54.404670+0000","last_became_peered":"2024-04-19T03:35:54.404670+0000","last_unstale":"2024-04-19T03:35:59.863575+0000","last_undegraded":"2024-04-19T03:35:59.863575+0000","last_fullsized":"2024-04-19T03:35:59.863575+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:47.049313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867265+0000","last_change":"2024-04-19T03:35:55.405560+0000","last_active":"2024-04-19T03:35:59.867265+0000","last_peered":"2024-04-19T03:35:59.867265+0000","last_clean":"2024-04-19T03:35:59.867265+0000","last_became_active":"2024-04-19T03:35:55.405342+0000","last_became_peered":"2024-04-19T03:35:55.405342+0000","last_unstale":"2024-04-19T03:35:59.867265+0000","last_undegraded":"2024-04-19T03:35:59.867265+0000","last_fullsized":"2024-04-19T03:35:59.867265+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:27.418444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867074+0000","last_change":"2024-04-19T03:35:59.430221+0000","last_active":"2024-04-19T03:36:00.867074+0000","last_peered":"2024-04-19T03:36:00.867074+0000","last_clean":"2024-04-19T03:36:00.867074+0000","last_became_active":"2024-04-19T03:35:59.429479+0000","last_became_peered":"2024-04-19T03:35:59.429479+0000","last_unstale":"2024-04-19T03:36:00.867074+0000","last_undegraded":"2024-04-19T03:36:00.867074+0000","last_fullsized":"2024-04-19T03:36:00.867074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868989+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:36:00.868989+0000","last_peered":"2024-04-19T03:36:00.868989+0000","last_clean":"2024-04-19T03:36:00.868989+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:36:00.868989+0000","last_undegraded":"2024-04-19T03:36:00.868989+0000","last_fullsized":"2024-04-19T03:36:00.868989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867797+0000","last_change":"2024-04-19T03:35:54.408755+0000","last_active":"2024-04-19T03:35:59.867797+0000","last_peered":"2024-04-19T03:35:59.867797+0000","last_clean":"2024-04-19T03:35:59.867797+0000","last_became_active":"2024-04-19T03:35:54.408501+0000","last_became_peered":"2024-04-19T03:35:54.408501+0000","last_unstale":"2024-04-19T03:35:59.867797+0000","last_undegraded":"2024-04-19T03:35:59.867797+0000","last_fullsized":"2024-04-19T03:35:59.867797+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867712+0000","last_change":"2024-04-19T03:35:59.432736+0000","last_active":"2024-04-19T03:36:00.867712+0000","last_peered":"2024-04-19T03:36:00.867712+0000","last_clean":"2024-04-19T03:36:00.867712+0000","last_became_active":"2024-04-19T03:35:59.432160+0000","last_became_peered":"2024-04-19T03:35:59.432160+0000","last_unstale":"2024-04-19T03:36:00.867712+0000","last_undegraded":"2024-04-19T03:36:00.867712+0000","last_fullsized":"2024-04-19T03:36:00.867712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868107+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:36:00.868107+0000","last_peered":"2024-04-19T03:36:00.868107+0000","last_clean":"2024-04-19T03:36:00.868107+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:36:00.868107+0000","last_undegraded":"2024-04-19T03:36:00.868107+0000","last_fullsized":"2024-04-19T03:36:00.868107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867075+0000","last_change":"2024-04-19T03:35:54.405961+0000","last_active":"2024-04-19T03:35:59.867075+0000","last_peered":"2024-04-19T03:35:59.867075+0000","last_clean":"2024-04-19T03:35:59.867075+0000","last_became_active":"2024-04-19T03:35:54.405640+0000","last_became_peered":"2024-04-19T03:35:54.405640+0000","last_unstale":"2024-04-19T03:35:59.867075+0000","last_undegraded":"2024-04-19T03:35:59.867075+0000","last_fullsized":"2024-04-19T03:35:59.867075+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867408+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:36:00.867408+0000","last_peered":"2024-04-19T03:36:00.867408+0000","last_clean":"2024-04-19T03:36:00.867408+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:36:00.867408+0000","last_undegraded":"2024-04-19T03:36:00.867408+0000","last_fullsized":"2024-04-19T03:36:00.867408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868467+0000","last_change":"2024-04-19T03:35:59.885491+0000","last_active":"2024-04-19T03:36:00.868467+0000","last_peered":"2024-04-19T03:36:00.868467+0000","last_clean":"2024-04-19T03:36:00.868467+0000","last_became_active":"2024-04-19T03:35:59.885190+0000","last_became_peered":"2024-04-19T03:35:59.885190+0000","last_unstale":"2024-04-19T03:36:00.868467+0000","last_undegraded":"2024-04-19T03:36:00.868467+0000","last_fullsized":"2024-04-19T03:36:00.868467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.872489+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:35:59.872489+0000","last_peered":"2024-04-19T03:35:59.872489+0000","last_clean":"2024-04-19T03:35:59.872489+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:35:59.872489+0000","last_undegraded":"2024-04-19T03:35:59.872489+0000","last_fullsized":"2024-04-19T03:35:59.872489+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868035+0000","last_change":"2024-04-19T03:35:59.431391+0000","last_active":"2024-04-19T03:36:00.868035+0000","last_peered":"2024-04-19T03:36:00.868035+0000","last_clean":"2024-04-19T03:36:00.868035+0000","last_became_active":"2024-04-19T03:35:59.431063+0000","last_became_peered":"2024-04-19T03:35:59.431063+0000","last_unstale":"2024-04-19T03:36:00.868035+0000","last_undegraded":"2024-04-19T03:36:00.868035+0000","last_fullsized":"2024-04-19T03:36:00.868035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867786+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:36:00.867786+0000","last_peered":"2024-04-19T03:36:00.867786+0000","last_clean":"2024-04-19T03:36:00.867786+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:36:00.867786+0000","last_undegraded":"2024-04-19T03:36:00.867786+0000","last_fullsized":"2024-04-19T03:36:00.867786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873656+0000","last_change":"2024-04-19T03:35:54.405542+0000","last_active":"2024-04-19T03:35:59.873656+0000","last_peered":"2024-04-19T03:35:59.873656+0000","last_clean":"2024-04-19T03:35:59.873656+0000","last_became_active":"2024-04-19T03:35:54.405292+0000","last_became_peered":"2024-04-19T03:35:54.405292+0000","last_unstale":"2024-04-19T03:35:59.873656+0000","last_undegraded":"2024-04-19T03:35:59.873656+0000","last_fullsized":"2024-04-19T03:35:59.873656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867907+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:36:00.867907+0000","last_peered":"2024-04-19T03:36:00.867907+0000","last_clean":"2024-04-19T03:36:00.867907+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:36:00.867907+0000","last_undegraded":"2024-04-19T03:36:00.867907+0000","last_fullsized":"2024-04-19T03:36:00.867907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868284+0000","last_change":"2024-04-19T03:35:59.879474+0000","last_active":"2024-04-19T03:36:00.868284+0000","last_peered":"2024-04-19T03:36:00.868284+0000","last_clean":"2024-04-19T03:36:00.868284+0000","last_became_active":"2024-04-19T03:35:59.878964+0000","last_became_peered":"2024-04-19T03:35:59.878964+0000","last_unstale":"2024-04-19T03:36:00.868284+0000","last_undegraded":"2024-04-19T03:36:00.868284+0000","last_fullsized":"2024-04-19T03:36:00.868284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.868556+0000","last_change":"2024-04-19T03:35:54.405958+0000","last_active":"2024-04-19T03:35:59.868556+0000","last_peered":"2024-04-19T03:35:59.868556+0000","last_clean":"2024-04-19T03:35:59.868556+0000","last_became_active":"2024-04-19T03:35:54.405578+0000","last_became_peered":"2024-04-19T03:35:54.405578+0000","last_unstale":"2024-04-19T03:35:59.868556+0000","last_undegraded":"2024-04-19T03:35:59.868556+0000","last_fullsized":"2024-04-19T03:35:59.868556+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:11.280110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868342+0000","last_change":"2024-04-19T03:35:59.433970+0000","last_active":"2024-04-19T03:36:00.868342+0000","last_peered":"2024-04-19T03:36:00.868342+0000","last_clean":"2024-04-19T03:36:00.868342+0000","last_became_active":"2024-04-19T03:35:59.433556+0000","last_became_peered":"2024-04-19T03:35:59.433556+0000","last_unstale":"2024-04-19T03:36:00.868342+0000","last_undegraded":"2024-04-19T03:36:00.868342+0000","last_fullsized":"2024-04-19T03:36:00.868342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:44.022207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868191+0000","last_change":"2024-04-19T03:35:59.879956+0000","last_active":"2024-04-19T03:36:00.868191+0000","last_peered":"2024-04-19T03:36:00.868191+0000","last_clean":"2024-04-19T03:36:00.868191+0000","last_became_active":"2024-04-19T03:35:59.879330+0000","last_became_peered":"2024-04-19T03:35:59.879330+0000","last_unstale":"2024-04-19T03:36:00.868191+0000","last_undegraded":"2024-04-19T03:36:00.868191+0000","last_fullsized":"2024-04-19T03:36:00.868191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867999+0000","last_change":"2024-04-19T03:35:59.432750+0000","last_active":"2024-04-19T03:36:00.867999+0000","last_peered":"2024-04-19T03:36:00.867999+0000","last_clean":"2024-04-19T03:36:00.867999+0000","last_became_active":"2024-04-19T03:35:59.432172+0000","last_became_peered":"2024-04-19T03:35:59.432172+0000","last_unstale":"2024-04-19T03:36:00.867999+0000","last_undegraded":"2024-04-19T03:36:00.867999+0000","last_fullsized":"2024-04-19T03:36:00.867999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868608+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:36:00.868608+0000","last_peered":"2024-04-19T03:36:00.868608+0000","last_clean":"2024-04-19T03:36:00.868608+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:36:00.868608+0000","last_undegraded":"2024-04-19T03:36:00.868608+0000","last_fullsized":"2024-04-19T03:36:00.868608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868241+0000","last_change":"2024-04-19T03:35:59.434114+0000","last_active":"2024-04-19T03:36:00.868241+0000","last_peered":"2024-04-19T03:36:00.868241+0000","last_clean":"2024-04-19T03:36:00.868241+0000","last_became_active":"2024-04-19T03:35:59.433765+0000","last_became_peered":"2024-04-19T03:35:59.433765+0000","last_unstale":"2024-04-19T03:36:00.868241+0000","last_undegraded":"2024-04-19T03:36:00.868241+0000","last_fullsized":"2024-04-19T03:36:00.868241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867893+0000","last_change":"2024-04-19T03:35:59.876608+0000","last_active":"2024-04-19T03:36:00.867893+0000","last_peered":"2024-04-19T03:36:00.867893+0000","last_clean":"2024-04-19T03:36:00.867893+0000","last_became_active":"2024-04-19T03:35:59.875297+0000","last_became_peered":"2024-04-19T03:35:59.875297+0000","last_unstale":"2024-04-19T03:36:00.867893+0000","last_undegraded":"2024-04-19T03:36:00.867893+0000","last_fullsized":"2024-04-19T03:36:00.867893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868926+0000","last_change":"2024-04-19T03:35:59.432321+0000","last_active":"2024-04-19T03:36:00.868926+0000","last_peered":"2024-04-19T03:36:00.868926+0000","last_clean":"2024-04-19T03:36:00.868926+0000","last_became_active":"2024-04-19T03:35:59.431638+0000","last_became_peered":"2024-04-19T03:35:59.431638+0000","last_unstale":"2024-04-19T03:36:00.868926+0000","last_undegraded":"2024-04-19T03:36:00.868926+0000","last_fullsized":"2024-04-19T03:36:00.868926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867670+0000","last_change":"2024-04-19T03:35:59.877336+0000","last_active":"2024-04-19T03:36:00.867670+0000","last_peered":"2024-04-19T03:36:00.867670+0000","last_clean":"2024-04-19T03:36:00.867670+0000","last_became_active":"2024-04-19T03:35:59.876461+0000","last_became_peered":"2024-04-19T03:35:59.876461+0000","last_unstale":"2024-04-19T03:36:00.867670+0000","last_undegraded":"2024-04-19T03:36:00.867670+0000","last_fullsized":"2024-04-19T03:36:00.867670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868151+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:36:00.868151+0000","last_peered":"2024-04-19T03:36:00.868151+0000","last_clean":"2024-04-19T03:36:00.868151+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:36:00.868151+0000","last_undegraded":"2024-04-19T03:36:00.868151+0000","last_fullsized":"2024-04-19T03:36:00.868151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868264+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:36:00.868264+0000","last_peered":"2024-04-19T03:36:00.868264+0000","last_clean":"2024-04-19T03:36:00.868264+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:36:00.868264+0000","last_undegraded":"2024-04-19T03:36:00.868264+0000","last_fullsized":"2024-04-19T03:36:00.868264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868040+0000","last_change":"2024-04-19T03:35:59.429171+0000","last_active":"2024-04-19T03:36:00.868040+0000","last_peered":"2024-04-19T03:36:00.868040+0000","last_clean":"2024-04-19T03:36:00.868040+0000","last_became_active":"2024-04-19T03:35:59.428837+0000","last_became_peered":"2024-04-19T03:35:59.428837+0000","last_unstale":"2024-04-19T03:36:00.868040+0000","last_undegraded":"2024-04-19T03:36:00.868040+0000","last_fullsized":"2024-04-19T03:36:00.868040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867627+0000","last_change":"2024-04-19T03:35:59.880260+0000","last_active":"2024-04-19T03:36:00.867627+0000","last_peered":"2024-04-19T03:36:00.867627+0000","last_clean":"2024-04-19T03:36:00.867627+0000","last_became_active":"2024-04-19T03:35:59.879086+0000","last_became_peered":"2024-04-19T03:35:59.879086+0000","last_unstale":"2024-04-19T03:36:00.867627+0000","last_undegraded":"2024-04-19T03:36:00.867627+0000","last_fullsized":"2024-04-19T03:36:00.867627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867442+0000","last_change":"2024-04-19T03:35:59.880550+0000","last_active":"2024-04-19T03:36:00.867442+0000","last_peered":"2024-04-19T03:36:00.867442+0000","last_clean":"2024-04-19T03:36:00.867442+0000","last_became_active":"2024-04-19T03:35:59.879772+0000","last_became_peered":"2024-04-19T03:35:59.879772+0000","last_unstale":"2024-04-19T03:36:00.867442+0000","last_undegraded":"2024-04-19T03:36:00.867442+0000","last_fullsized":"2024-04-19T03:36:00.867442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867115+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:36:00.867115+0000","last_peered":"2024-04-19T03:36:00.867115+0000","last_clean":"2024-04-19T03:36:00.867115+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:36:00.867115+0000","last_undegraded":"2024-04-19T03:36:00.867115+0000","last_fullsized":"2024-04-19T03:36:00.867115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868363+0000","last_change":"2024-04-19T03:35:59.881028+0000","last_active":"2024-04-19T03:36:00.868363+0000","last_peered":"2024-04-19T03:36:00.868363+0000","last_clean":"2024-04-19T03:36:00.868363+0000","last_became_active":"2024-04-19T03:35:59.880088+0000","last_became_peered":"2024-04-19T03:35:59.880088+0000","last_unstale":"2024-04-19T03:36:00.868363+0000","last_undegraded":"2024-04-19T03:36:00.868363+0000","last_fullsized":"2024-04-19T03:36:00.868363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:52.418012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867632+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:36:00.867632+0000","last_peered":"2024-04-19T03:36:00.867632+0000","last_clean":"2024-04-19T03:36:00.867632+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:36:00.867632+0000","last_undegraded":"2024-04-19T03:36:00.867632+0000","last_fullsized":"2024-04-19T03:36:00.867632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868762+0000","last_change":"2024-04-19T03:35:59.882281+0000","last_active":"2024-04-19T03:36:00.868762+0000","last_peered":"2024-04-19T03:36:00.868762+0000","last_clean":"2024-04-19T03:36:00.868762+0000","last_became_active":"2024-04-19T03:35:59.880757+0000","last_became_peered":"2024-04-19T03:35:59.880757+0000","last_unstale":"2024-04-19T03:36:00.868762+0000","last_undegraded":"2024-04-19T03:36:00.868762+0000","last_fullsized":"2024-04-19T03:36:00.868762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:36:04.607 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-19T03:36:04.608 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-19T03:36:04.608 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-19T03:36:04.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-19T03:36:04.608 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-19T03:36:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4128,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":39771},{"type":"v1","addr":"172.21.15.5:6801","nonce":39771}]},"active_addr":"172.21.15.5:6801/39771","active_change":"2024-04-19T03:35:52.261674+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4134,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3656343658}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":937063019}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":4270898311}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":1146457900}]}]} 2024-04-19T03:36:05.096 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-19T03:36:05.096 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T03:36:05.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:36:05.460 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:05.460 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:36:00.861407+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:36:05.476 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T03:36:05.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:36:05.843 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:05.843 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:36:00.861407+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:36:05.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T03:36:05.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T03:36:05.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T03:36:06.049 INFO:teuthology.orchestra.run.smithi005.stdout:34359738372 2024-04-19T03:36:06.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T03:36:06.056 INFO:teuthology.orchestra.run.smithi005.stdout:34359738372 2024-04-19T03:36:06.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T03:36:06.057 INFO:teuthology.orchestra.run.smithi005.stdout:34359738372 2024-04-19T03:36:06.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T03:36:06.434 INFO:teuthology.orchestra.run.smithi005.stdout:34359738371 2024-04-19T03:36:06.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.1 2024-04-19T03:36:06.488 INFO:teuthology.orchestra.run.smithi005.stdout:34359738371 2024-04-19T03:36:06.498 INFO:teuthology.orchestra.run.smithi005.stdout:34359738371 2024-04-19T03:36:06.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2024-04-19T03:36:06.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2024-04-19T03:36:07.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T03:36:07.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T03:36:07.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T03:36:07.872 INFO:teuthology.orchestra.run.smithi005.stdout:34359738372 2024-04-19T03:36:07.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.1 2024-04-19T03:36:07.890 DEBUG:teuthology.parallel:result is None 2024-04-19T03:36:07.894 INFO:teuthology.orchestra.run.smithi005.stdout:34359738372 2024-04-19T03:36:07.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2024-04-19T03:36:07.910 DEBUG:teuthology.parallel:result is None 2024-04-19T03:36:07.956 INFO:teuthology.orchestra.run.smithi005.stdout:34359738372 2024-04-19T03:36:07.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.2 2024-04-19T03:36:07.972 DEBUG:teuthology.parallel:result is None 2024-04-19T03:36:07.972 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T03:36:07.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:36:08.341 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:08.343 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:36:08.355 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-19T03:36:08.270123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.407257"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869083+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:36:00.869083+0000","last_peered":"2024-04-19T03:36:00.869083+0000","last_clean":"2024-04-19T03:36:00.869083+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:36:00.869083+0000","last_undegraded":"2024-04-19T03:36:00.869083+0000","last_fullsized":"2024-04-19T03:36:00.869083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868676+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:36:00.868676+0000","last_peered":"2024-04-19T03:36:00.868676+0000","last_clean":"2024-04-19T03:36:00.868676+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:36:00.868676+0000","last_undegraded":"2024-04-19T03:36:00.868676+0000","last_fullsized":"2024-04-19T03:36:00.868676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868331+0000","last_change":"2024-04-19T03:35:59.886429+0000","last_active":"2024-04-19T03:36:00.868331+0000","last_peered":"2024-04-19T03:36:00.868331+0000","last_clean":"2024-04-19T03:36:00.868331+0000","last_became_active":"2024-04-19T03:35:59.886189+0000","last_became_peered":"2024-04-19T03:35:59.886189+0000","last_unstale":"2024-04-19T03:36:00.868331+0000","last_undegraded":"2024-04-19T03:36:00.868331+0000","last_fullsized":"2024-04-19T03:36:00.868331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867838+0000","last_change":"2024-04-19T03:35:59.878844+0000","last_active":"2024-04-19T03:36:00.867838+0000","last_peered":"2024-04-19T03:36:00.867838+0000","last_clean":"2024-04-19T03:36:00.867838+0000","last_became_active":"2024-04-19T03:35:59.878100+0000","last_became_peered":"2024-04-19T03:35:59.878100+0000","last_unstale":"2024-04-19T03:36:00.867838+0000","last_undegraded":"2024-04-19T03:36:00.867838+0000","last_fullsized":"2024-04-19T03:36:00.867838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868178+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:36:00.868178+0000","last_peered":"2024-04-19T03:36:00.868178+0000","last_clean":"2024-04-19T03:36:00.868178+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:36:00.868178+0000","last_undegraded":"2024-04-19T03:36:00.868178+0000","last_fullsized":"2024-04-19T03:36:00.868178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867527+0000","last_change":"2024-04-19T03:35:59.876553+0000","last_active":"2024-04-19T03:36:00.867527+0000","last_peered":"2024-04-19T03:36:00.867527+0000","last_clean":"2024-04-19T03:36:00.867527+0000","last_became_active":"2024-04-19T03:35:59.875201+0000","last_became_peered":"2024-04-19T03:35:59.875201+0000","last_unstale":"2024-04-19T03:36:00.867527+0000","last_undegraded":"2024-04-19T03:36:00.867527+0000","last_fullsized":"2024-04-19T03:36:00.867527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867483+0000","last_change":"2024-04-19T03:35:59.876305+0000","last_active":"2024-04-19T03:36:00.867483+0000","last_peered":"2024-04-19T03:36:00.867483+0000","last_clean":"2024-04-19T03:36:00.867483+0000","last_became_active":"2024-04-19T03:35:59.875093+0000","last_became_peered":"2024-04-19T03:35:59.875093+0000","last_unstale":"2024-04-19T03:36:00.867483+0000","last_undegraded":"2024-04-19T03:36:00.867483+0000","last_fullsized":"2024-04-19T03:36:00.867483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867184+0000","last_change":"2024-04-19T03:35:59.880058+0000","last_active":"2024-04-19T03:36:00.867184+0000","last_peered":"2024-04-19T03:36:00.867184+0000","last_clean":"2024-04-19T03:36:00.867184+0000","last_became_active":"2024-04-19T03:35:59.878691+0000","last_became_peered":"2024-04-19T03:35:59.878691+0000","last_unstale":"2024-04-19T03:36:00.867184+0000","last_undegraded":"2024-04-19T03:36:00.867184+0000","last_fullsized":"2024-04-19T03:36:00.867184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868945+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:36:00.868945+0000","last_peered":"2024-04-19T03:36:00.868945+0000","last_clean":"2024-04-19T03:36:00.868945+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:36:00.868945+0000","last_undegraded":"2024-04-19T03:36:00.868945+0000","last_fullsized":"2024-04-19T03:36:00.868945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868069+0000","last_change":"2024-04-19T03:35:59.878070+0000","last_active":"2024-04-19T03:36:00.868069+0000","last_peered":"2024-04-19T03:36:00.868069+0000","last_clean":"2024-04-19T03:36:00.868069+0000","last_became_active":"2024-04-19T03:35:59.876291+0000","last_became_peered":"2024-04-19T03:35:59.876291+0000","last_unstale":"2024-04-19T03:36:00.868069+0000","last_undegraded":"2024-04-19T03:36:00.868069+0000","last_fullsized":"2024-04-19T03:36:00.868069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868341+0000","last_change":"2024-04-19T03:35:59.883585+0000","last_active":"2024-04-19T03:36:00.868341+0000","last_peered":"2024-04-19T03:36:00.868341+0000","last_clean":"2024-04-19T03:36:00.868341+0000","last_became_active":"2024-04-19T03:35:59.883232+0000","last_became_peered":"2024-04-19T03:35:59.883232+0000","last_unstale":"2024-04-19T03:36:00.868341+0000","last_undegraded":"2024-04-19T03:36:00.868341+0000","last_fullsized":"2024-04-19T03:36:00.868341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867977+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:36:00.867977+0000","last_peered":"2024-04-19T03:36:00.867977+0000","last_clean":"2024-04-19T03:36:00.867977+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:36:00.867977+0000","last_undegraded":"2024-04-19T03:36:00.867977+0000","last_fullsized":"2024-04-19T03:36:00.867977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867945+0000","last_change":"2024-04-19T03:35:59.882444+0000","last_active":"2024-04-19T03:36:00.867945+0000","last_peered":"2024-04-19T03:36:00.867945+0000","last_clean":"2024-04-19T03:36:00.867945+0000","last_became_active":"2024-04-19T03:35:59.882075+0000","last_became_peered":"2024-04-19T03:35:59.882075+0000","last_unstale":"2024-04-19T03:36:00.867945+0000","last_undegraded":"2024-04-19T03:36:00.867945+0000","last_fullsized":"2024-04-19T03:36:00.867945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867610+0000","last_change":"2024-04-19T03:35:59.882604+0000","last_active":"2024-04-19T03:36:00.867610+0000","last_peered":"2024-04-19T03:36:00.867610+0000","last_clean":"2024-04-19T03:36:00.867610+0000","last_became_active":"2024-04-19T03:35:59.882330+0000","last_became_peered":"2024-04-19T03:35:59.882330+0000","last_unstale":"2024-04-19T03:36:00.867610+0000","last_undegraded":"2024-04-19T03:36:00.867610+0000","last_fullsized":"2024-04-19T03:36:00.867610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867199+0000","last_change":"2024-04-19T03:35:59.880349+0000","last_active":"2024-04-19T03:36:00.867199+0000","last_peered":"2024-04-19T03:36:00.867199+0000","last_clean":"2024-04-19T03:36:00.867199+0000","last_became_active":"2024-04-19T03:35:59.879119+0000","last_became_peered":"2024-04-19T03:35:59.879119+0000","last_unstale":"2024-04-19T03:36:00.867199+0000","last_undegraded":"2024-04-19T03:36:00.867199+0000","last_fullsized":"2024-04-19T03:36:00.867199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867891+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:36:00.867891+0000","last_peered":"2024-04-19T03:36:00.867891+0000","last_clean":"2024-04-19T03:36:00.867891+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:36:00.867891+0000","last_undegraded":"2024-04-19T03:36:00.867891+0000","last_fullsized":"2024-04-19T03:36:00.867891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868856+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868856+0000","last_peered":"2024-04-19T03:36:00.868856+0000","last_clean":"2024-04-19T03:36:00.868856+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:36:00.868856+0000","last_undegraded":"2024-04-19T03:36:00.868856+0000","last_fullsized":"2024-04-19T03:36:00.868856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867771+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:36:00.867771+0000","last_peered":"2024-04-19T03:36:00.867771+0000","last_clean":"2024-04-19T03:36:00.867771+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:36:00.867771+0000","last_undegraded":"2024-04-19T03:36:00.867771+0000","last_fullsized":"2024-04-19T03:36:00.867771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867992+0000","last_change":"2024-04-19T03:35:59.879234+0000","last_active":"2024-04-19T03:36:00.867992+0000","last_peered":"2024-04-19T03:36:00.867992+0000","last_clean":"2024-04-19T03:36:00.867992+0000","last_became_active":"2024-04-19T03:35:59.878820+0000","last_became_peered":"2024-04-19T03:35:59.878820+0000","last_unstale":"2024-04-19T03:36:00.867992+0000","last_undegraded":"2024-04-19T03:36:00.867992+0000","last_fullsized":"2024-04-19T03:36:00.867992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.877313+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.875350+0000","last_became_peered":"2024-04-19T03:35:59.875350+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868267+0000","last_change":"2024-04-19T03:35:59.881019+0000","last_active":"2024-04-19T03:36:00.868267+0000","last_peered":"2024-04-19T03:36:00.868267+0000","last_clean":"2024-04-19T03:36:00.868267+0000","last_became_active":"2024-04-19T03:35:59.880363+0000","last_became_peered":"2024-04-19T03:35:59.880363+0000","last_unstale":"2024-04-19T03:36:00.868267+0000","last_undegraded":"2024-04-19T03:36:00.868267+0000","last_fullsized":"2024-04-19T03:36:00.868267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867430+0000","last_change":"2024-04-19T03:35:59.872083+0000","last_active":"2024-04-19T03:36:00.867430+0000","last_peered":"2024-04-19T03:36:00.867430+0000","last_clean":"2024-04-19T03:36:00.867430+0000","last_became_active":"2024-04-19T03:35:59.871872+0000","last_became_peered":"2024-04-19T03:35:59.871872+0000","last_unstale":"2024-04-19T03:36:00.867430+0000","last_undegraded":"2024-04-19T03:36:00.867430+0000","last_fullsized":"2024-04-19T03:36:00.867430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868080+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:36:00.868080+0000","last_peered":"2024-04-19T03:36:00.868080+0000","last_clean":"2024-04-19T03:36:00.868080+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:36:00.868080+0000","last_undegraded":"2024-04-19T03:36:00.868080+0000","last_fullsized":"2024-04-19T03:36:00.868080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869076+0000","last_change":"2024-04-19T03:35:59.882017+0000","last_active":"2024-04-19T03:36:00.869076+0000","last_peered":"2024-04-19T03:36:00.869076+0000","last_clean":"2024-04-19T03:36:00.869076+0000","last_became_active":"2024-04-19T03:35:59.881048+0000","last_became_peered":"2024-04-19T03:35:59.881048+0000","last_unstale":"2024-04-19T03:36:00.869076+0000","last_undegraded":"2024-04-19T03:36:00.869076+0000","last_fullsized":"2024-04-19T03:36:00.869076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868233+0000","last_change":"2024-04-19T03:35:59.873199+0000","last_active":"2024-04-19T03:36:00.868233+0000","last_peered":"2024-04-19T03:36:00.868233+0000","last_clean":"2024-04-19T03:36:00.868233+0000","last_became_active":"2024-04-19T03:35:59.872661+0000","last_became_peered":"2024-04-19T03:35:59.872661+0000","last_unstale":"2024-04-19T03:36:00.868233+0000","last_undegraded":"2024-04-19T03:36:00.868233+0000","last_fullsized":"2024-04-19T03:36:00.868233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868190+0000","last_change":"2024-04-19T03:35:59.882737+0000","last_active":"2024-04-19T03:36:00.868190+0000","last_peered":"2024-04-19T03:36:00.868190+0000","last_clean":"2024-04-19T03:36:00.868190+0000","last_became_active":"2024-04-19T03:35:59.882537+0000","last_became_peered":"2024-04-19T03:35:59.882537+0000","last_unstale":"2024-04-19T03:36:00.868190+0000","last_undegraded":"2024-04-19T03:36:00.868190+0000","last_fullsized":"2024-04-19T03:36:00.868190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867954+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:36:00.867954+0000","last_peered":"2024-04-19T03:36:00.867954+0000","last_clean":"2024-04-19T03:36:00.867954+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:36:00.867954+0000","last_undegraded":"2024-04-19T03:36:00.867954+0000","last_fullsized":"2024-04-19T03:36:00.867954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868942+0000","last_change":"2024-04-19T03:35:59.882176+0000","last_active":"2024-04-19T03:36:00.868942+0000","last_peered":"2024-04-19T03:36:00.868942+0000","last_clean":"2024-04-19T03:36:00.868942+0000","last_became_active":"2024-04-19T03:35:59.881216+0000","last_became_peered":"2024-04-19T03:35:59.881216+0000","last_unstale":"2024-04-19T03:36:00.868942+0000","last_undegraded":"2024-04-19T03:36:00.868942+0000","last_fullsized":"2024-04-19T03:36:00.868942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867298+0000","last_change":"2024-04-19T03:35:59.429598+0000","last_active":"2024-04-19T03:36:00.867298+0000","last_peered":"2024-04-19T03:36:00.867298+0000","last_clean":"2024-04-19T03:36:00.867298+0000","last_became_active":"2024-04-19T03:35:59.429239+0000","last_became_peered":"2024-04-19T03:35:59.429239+0000","last_unstale":"2024-04-19T03:36:00.867298+0000","last_undegraded":"2024-04-19T03:36:00.867298+0000","last_fullsized":"2024-04-19T03:36:00.867298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868065+0000","last_change":"2024-04-19T03:35:59.872790+0000","last_active":"2024-04-19T03:36:00.868065+0000","last_peered":"2024-04-19T03:36:00.868065+0000","last_clean":"2024-04-19T03:36:00.868065+0000","last_became_active":"2024-04-19T03:35:59.872223+0000","last_became_peered":"2024-04-19T03:35:59.872223+0000","last_unstale":"2024-04-19T03:36:00.868065+0000","last_undegraded":"2024-04-19T03:36:00.868065+0000","last_fullsized":"2024-04-19T03:36:00.868065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867213+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:36:00.867213+0000","last_peered":"2024-04-19T03:36:00.867213+0000","last_clean":"2024-04-19T03:36:00.867213+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:36:00.867213+0000","last_undegraded":"2024-04-19T03:36:00.867213+0000","last_fullsized":"2024-04-19T03:36:00.867213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868970+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868970+0000","last_peered":"2024-04-19T03:36:00.868970+0000","last_clean":"2024-04-19T03:36:00.868970+0000","last_became_active":"2024-04-19T03:35:59.881795+0000","last_became_peered":"2024-04-19T03:35:59.881795+0000","last_unstale":"2024-04-19T03:36:00.868970+0000","last_undegraded":"2024-04-19T03:36:00.868970+0000","last_fullsized":"2024-04-19T03:36:00.868970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868091+0000","last_change":"2024-04-19T03:35:59.429529+0000","last_active":"2024-04-19T03:36:00.868091+0000","last_peered":"2024-04-19T03:36:00.868091+0000","last_clean":"2024-04-19T03:36:00.868091+0000","last_became_active":"2024-04-19T03:35:59.429121+0000","last_became_peered":"2024-04-19T03:35:59.429121+0000","last_unstale":"2024-04-19T03:36:00.868091+0000","last_undegraded":"2024-04-19T03:36:00.868091+0000","last_fullsized":"2024-04-19T03:36:00.868091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867146+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:36:00.867146+0000","last_peered":"2024-04-19T03:36:00.867146+0000","last_clean":"2024-04-19T03:36:00.867146+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:36:00.867146+0000","last_undegraded":"2024-04-19T03:36:00.867146+0000","last_fullsized":"2024-04-19T03:36:00.867146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868383+0000","last_change":"2024-04-19T03:35:59.434129+0000","last_active":"2024-04-19T03:36:00.868383+0000","last_peered":"2024-04-19T03:36:00.868383+0000","last_clean":"2024-04-19T03:36:00.868383+0000","last_became_active":"2024-04-19T03:35:59.433761+0000","last_became_peered":"2024-04-19T03:35:59.433761+0000","last_unstale":"2024-04-19T03:36:00.868383+0000","last_undegraded":"2024-04-19T03:36:00.868383+0000","last_fullsized":"2024-04-19T03:36:00.868383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867364+0000","last_change":"2024-04-19T03:35:59.872126+0000","last_active":"2024-04-19T03:36:00.867364+0000","last_peered":"2024-04-19T03:36:00.867364+0000","last_clean":"2024-04-19T03:36:00.867364+0000","last_became_active":"2024-04-19T03:35:59.871818+0000","last_became_peered":"2024-04-19T03:35:59.871818+0000","last_unstale":"2024-04-19T03:36:00.867364+0000","last_undegraded":"2024-04-19T03:36:00.867364+0000","last_fullsized":"2024-04-19T03:36:00.867364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:49:19.611505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868776+0000","last_change":"2024-04-19T03:35:59.431907+0000","last_active":"2024-04-19T03:36:00.868776+0000","last_peered":"2024-04-19T03:36:00.868776+0000","last_clean":"2024-04-19T03:36:00.868776+0000","last_became_active":"2024-04-19T03:35:59.431432+0000","last_became_peered":"2024-04-19T03:35:59.431432+0000","last_unstale":"2024-04-19T03:36:00.868776+0000","last_undegraded":"2024-04-19T03:36:00.868776+0000","last_fullsized":"2024-04-19T03:36:00.868776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867656+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:36:00.867656+0000","last_peered":"2024-04-19T03:36:00.867656+0000","last_clean":"2024-04-19T03:36:00.867656+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:36:00.867656+0000","last_undegraded":"2024-04-19T03:36:00.867656+0000","last_fullsized":"2024-04-19T03:36:00.867656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868141+0000","last_change":"2024-04-19T03:35:59.433961+0000","last_active":"2024-04-19T03:36:00.868141+0000","last_peered":"2024-04-19T03:36:00.868141+0000","last_clean":"2024-04-19T03:36:00.868141+0000","last_became_active":"2024-04-19T03:35:59.433506+0000","last_became_peered":"2024-04-19T03:35:59.433506+0000","last_unstale":"2024-04-19T03:36:00.868141+0000","last_undegraded":"2024-04-19T03:36:00.868141+0000","last_fullsized":"2024-04-19T03:36:00.868141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868192+0000","last_change":"2024-04-19T03:35:59.885493+0000","last_active":"2024-04-19T03:36:00.868192+0000","last_peered":"2024-04-19T03:36:00.868192+0000","last_clean":"2024-04-19T03:36:00.868192+0000","last_became_active":"2024-04-19T03:35:59.885107+0000","last_became_peered":"2024-04-19T03:35:59.885107+0000","last_unstale":"2024-04-19T03:36:00.868192+0000","last_undegraded":"2024-04-19T03:36:00.868192+0000","last_fullsized":"2024-04-19T03:36:00.868192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868108+0000","last_change":"2024-04-19T03:35:59.434133+0000","last_active":"2024-04-19T03:36:00.868108+0000","last_peered":"2024-04-19T03:36:00.868108+0000","last_clean":"2024-04-19T03:36:00.868108+0000","last_became_active":"2024-04-19T03:35:59.433755+0000","last_became_peered":"2024-04-19T03:35:59.433755+0000","last_unstale":"2024-04-19T03:36:00.868108+0000","last_undegraded":"2024-04-19T03:36:00.868108+0000","last_fullsized":"2024-04-19T03:36:00.868108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:17.507444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868452+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:36:00.868452+0000","last_peered":"2024-04-19T03:36:00.868452+0000","last_clean":"2024-04-19T03:36:00.868452+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:36:00.868452+0000","last_undegraded":"2024-04-19T03:36:00.868452+0000","last_fullsized":"2024-04-19T03:36:00.868452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867515+0000","last_change":"2024-04-19T03:35:59.428849+0000","last_active":"2024-04-19T03:36:00.867515+0000","last_peered":"2024-04-19T03:36:00.867515+0000","last_clean":"2024-04-19T03:36:00.867515+0000","last_became_active":"2024-04-19T03:35:59.428478+0000","last_became_peered":"2024-04-19T03:35:59.428478+0000","last_unstale":"2024-04-19T03:36:00.867515+0000","last_undegraded":"2024-04-19T03:36:00.867515+0000","last_fullsized":"2024-04-19T03:36:00.867515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869023+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:36:00.869023+0000","last_peered":"2024-04-19T03:36:00.869023+0000","last_clean":"2024-04-19T03:36:00.869023+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:36:00.869023+0000","last_undegraded":"2024-04-19T03:36:00.869023+0000","last_fullsized":"2024-04-19T03:36:00.869023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867937+0000","last_change":"2024-04-19T03:35:59.431877+0000","last_active":"2024-04-19T03:36:00.867937+0000","last_peered":"2024-04-19T03:36:00.867937+0000","last_clean":"2024-04-19T03:36:00.867937+0000","last_became_active":"2024-04-19T03:35:59.431343+0000","last_became_peered":"2024-04-19T03:35:59.431343+0000","last_unstale":"2024-04-19T03:36:00.867937+0000","last_undegraded":"2024-04-19T03:36:00.867937+0000","last_fullsized":"2024-04-19T03:36:00.867937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868161+0000","last_change":"2024-04-19T03:35:59.873111+0000","last_active":"2024-04-19T03:36:00.868161+0000","last_peered":"2024-04-19T03:36:00.868161+0000","last_clean":"2024-04-19T03:36:00.868161+0000","last_became_active":"2024-04-19T03:35:59.872468+0000","last_became_peered":"2024-04-19T03:35:59.872468+0000","last_unstale":"2024-04-19T03:36:00.868161+0000","last_undegraded":"2024-04-19T03:36:00.868161+0000","last_fullsized":"2024-04-19T03:36:00.868161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:30:15.469254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867684+0000","last_change":"2024-04-19T03:35:59.434023+0000","last_active":"2024-04-19T03:36:00.867684+0000","last_peered":"2024-04-19T03:36:00.867684+0000","last_clean":"2024-04-19T03:36:00.867684+0000","last_became_active":"2024-04-19T03:35:59.433542+0000","last_became_peered":"2024-04-19T03:35:59.433542+0000","last_unstale":"2024-04-19T03:36:00.867684+0000","last_undegraded":"2024-04-19T03:36:00.867684+0000","last_fullsized":"2024-04-19T03:36:00.867684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868203+0000","last_change":"2024-04-19T03:35:59.872558+0000","last_active":"2024-04-19T03:36:00.868203+0000","last_peered":"2024-04-19T03:36:00.868203+0000","last_clean":"2024-04-19T03:36:00.868203+0000","last_became_active":"2024-04-19T03:35:59.872302+0000","last_became_peered":"2024-04-19T03:35:59.872302+0000","last_unstale":"2024-04-19T03:36:00.868203+0000","last_undegraded":"2024-04-19T03:36:00.868203+0000","last_fullsized":"2024-04-19T03:36:00.868203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:14.886758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868499+0000","last_change":"2024-04-19T03:35:59.434430+0000","last_active":"2024-04-19T03:36:00.868499+0000","last_peered":"2024-04-19T03:36:00.868499+0000","last_clean":"2024-04-19T03:36:00.868499+0000","last_became_active":"2024-04-19T03:35:59.433885+0000","last_became_peered":"2024-04-19T03:35:59.433885+0000","last_unstale":"2024-04-19T03:36:00.868499+0000","last_undegraded":"2024-04-19T03:36:00.868499+0000","last_fullsized":"2024-04-19T03:36:00.868499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867570+0000","last_change":"2024-04-19T03:35:59.883449+0000","last_active":"2024-04-19T03:36:00.867570+0000","last_peered":"2024-04-19T03:36:00.867570+0000","last_clean":"2024-04-19T03:36:00.867570+0000","last_became_active":"2024-04-19T03:35:59.882794+0000","last_became_peered":"2024-04-19T03:35:59.882794+0000","last_unstale":"2024-04-19T03:36:00.867570+0000","last_undegraded":"2024-04-19T03:36:00.867570+0000","last_fullsized":"2024-04-19T03:36:00.867570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868576+0000","last_change":"2024-04-19T03:35:59.433568+0000","last_active":"2024-04-19T03:36:00.868576+0000","last_peered":"2024-04-19T03:36:00.868576+0000","last_clean":"2024-04-19T03:36:00.868576+0000","last_became_active":"2024-04-19T03:35:59.433247+0000","last_became_peered":"2024-04-19T03:35:59.433247+0000","last_unstale":"2024-04-19T03:36:00.868576+0000","last_undegraded":"2024-04-19T03:36:00.868576+0000","last_fullsized":"2024-04-19T03:36:00.868576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868220+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:36:00.868220+0000","last_peered":"2024-04-19T03:36:00.868220+0000","last_clean":"2024-04-19T03:36:00.868220+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:36:00.868220+0000","last_undegraded":"2024-04-19T03:36:00.868220+0000","last_fullsized":"2024-04-19T03:36:00.868220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868210+0000","last_change":"2024-04-19T03:35:59.433585+0000","last_active":"2024-04-19T03:36:00.868210+0000","last_peered":"2024-04-19T03:36:00.868210+0000","last_clean":"2024-04-19T03:36:00.868210+0000","last_became_active":"2024-04-19T03:35:59.433273+0000","last_became_peered":"2024-04-19T03:35:59.433273+0000","last_unstale":"2024-04-19T03:36:00.868210+0000","last_undegraded":"2024-04-19T03:36:00.868210+0000","last_fullsized":"2024-04-19T03:36:00.868210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867805+0000","last_change":"2024-04-19T03:35:59.876757+0000","last_active":"2024-04-19T03:36:00.867805+0000","last_peered":"2024-04-19T03:36:00.867805+0000","last_clean":"2024-04-19T03:36:00.867805+0000","last_became_active":"2024-04-19T03:35:59.876227+0000","last_became_peered":"2024-04-19T03:35:59.876227+0000","last_unstale":"2024-04-19T03:36:00.867805+0000","last_undegraded":"2024-04-19T03:36:00.867805+0000","last_fullsized":"2024-04-19T03:36:00.867805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867647+0000","last_change":"2024-04-19T03:35:59.431430+0000","last_active":"2024-04-19T03:36:00.867647+0000","last_peered":"2024-04-19T03:36:00.867647+0000","last_clean":"2024-04-19T03:36:00.867647+0000","last_became_active":"2024-04-19T03:35:59.431072+0000","last_became_peered":"2024-04-19T03:35:59.431072+0000","last_unstale":"2024-04-19T03:36:00.867647+0000","last_undegraded":"2024-04-19T03:36:00.867647+0000","last_fullsized":"2024-04-19T03:36:00.867647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867590+0000","last_change":"2024-04-19T03:35:59.876828+0000","last_active":"2024-04-19T03:36:00.867590+0000","last_peered":"2024-04-19T03:36:00.867590+0000","last_clean":"2024-04-19T03:36:00.867590+0000","last_became_active":"2024-04-19T03:35:59.876482+0000","last_became_peered":"2024-04-19T03:35:59.876482+0000","last_unstale":"2024-04-19T03:36:00.867590+0000","last_undegraded":"2024-04-19T03:36:00.867590+0000","last_fullsized":"2024-04-19T03:36:00.867590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:05.827809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867495+0000","last_change":"2024-04-19T03:35:59.429451+0000","last_active":"2024-04-19T03:36:00.867495+0000","last_peered":"2024-04-19T03:36:00.867495+0000","last_clean":"2024-04-19T03:36:00.867495+0000","last_became_active":"2024-04-19T03:35:59.429087+0000","last_became_peered":"2024-04-19T03:35:59.429087+0000","last_unstale":"2024-04-19T03:36:00.867495+0000","last_undegraded":"2024-04-19T03:36:00.867495+0000","last_fullsized":"2024-04-19T03:36:00.867495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:19.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867804+0000","last_change":"2024-04-19T03:35:59.879270+0000","last_active":"2024-04-19T03:36:00.867804+0000","last_peered":"2024-04-19T03:36:00.867804+0000","last_clean":"2024-04-19T03:36:00.867804+0000","last_became_active":"2024-04-19T03:35:59.878554+0000","last_became_peered":"2024-04-19T03:35:59.878554+0000","last_unstale":"2024-04-19T03:36:00.867804+0000","last_undegraded":"2024-04-19T03:36:00.867804+0000","last_fullsized":"2024-04-19T03:36:00.867804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867631+0000","last_change":"2024-04-19T03:35:59.431379+0000","last_active":"2024-04-19T03:36:00.867631+0000","last_peered":"2024-04-19T03:36:00.867631+0000","last_clean":"2024-04-19T03:36:00.867631+0000","last_became_active":"2024-04-19T03:35:59.431065+0000","last_became_peered":"2024-04-19T03:35:59.431065+0000","last_unstale":"2024-04-19T03:36:00.867631+0000","last_undegraded":"2024-04-19T03:36:00.867631+0000","last_fullsized":"2024-04-19T03:36:00.867631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868460+0000","last_change":"2024-04-19T03:35:59.885989+0000","last_active":"2024-04-19T03:36:00.868460+0000","last_peered":"2024-04-19T03:36:00.868460+0000","last_clean":"2024-04-19T03:36:00.868460+0000","last_became_active":"2024-04-19T03:35:59.885765+0000","last_became_peered":"2024-04-19T03:35:59.885765+0000","last_unstale":"2024-04-19T03:36:00.868460+0000","last_undegraded":"2024-04-19T03:36:00.868460+0000","last_fullsized":"2024-04-19T03:36:00.868460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867795+0000","last_change":"2024-04-19T03:35:59.431967+0000","last_active":"2024-04-19T03:36:00.867795+0000","last_peered":"2024-04-19T03:36:00.867795+0000","last_clean":"2024-04-19T03:36:00.867795+0000","last_became_active":"2024-04-19T03:35:59.431521+0000","last_became_peered":"2024-04-19T03:35:59.431521+0000","last_unstale":"2024-04-19T03:36:00.867795+0000","last_undegraded":"2024-04-19T03:36:00.867795+0000","last_fullsized":"2024-04-19T03:36:00.867795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868517+0000","last_change":"2024-04-19T03:35:59.885527+0000","last_active":"2024-04-19T03:36:00.868517+0000","last_peered":"2024-04-19T03:36:00.868517+0000","last_clean":"2024-04-19T03:36:00.868517+0000","last_became_active":"2024-04-19T03:35:59.885186+0000","last_became_peered":"2024-04-19T03:35:59.885186+0000","last_unstale":"2024-04-19T03:36:00.868517+0000","last_undegraded":"2024-04-19T03:36:00.868517+0000","last_fullsized":"2024-04-19T03:36:00.868517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867777+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:36:00.867777+0000","last_peered":"2024-04-19T03:36:00.867777+0000","last_clean":"2024-04-19T03:36:00.867777+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:36:00.867777+0000","last_undegraded":"2024-04-19T03:36:00.867777+0000","last_fullsized":"2024-04-19T03:36:00.867777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867975+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:36:00.867975+0000","last_peered":"2024-04-19T03:36:00.867975+0000","last_clean":"2024-04-19T03:36:00.867975+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:36:00.867975+0000","last_undegraded":"2024-04-19T03:36:00.867975+0000","last_fullsized":"2024-04-19T03:36:00.867975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867991+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:36:00.867991+0000","last_peered":"2024-04-19T03:36:00.867991+0000","last_clean":"2024-04-19T03:36:00.867991+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:36:00.867991+0000","last_undegraded":"2024-04-19T03:36:00.867991+0000","last_fullsized":"2024-04-19T03:36:00.867991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.874027+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:35:59.874027+0000","last_peered":"2024-04-19T03:35:59.874027+0000","last_clean":"2024-04-19T03:35:59.874027+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:35:59.874027+0000","last_undegraded":"2024-04-19T03:35:59.874027+0000","last_fullsized":"2024-04-19T03:35:59.874027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.866975+0000","last_change":"2024-04-19T03:35:59.878242+0000","last_active":"2024-04-19T03:36:00.866975+0000","last_peered":"2024-04-19T03:36:00.866975+0000","last_clean":"2024-04-19T03:36:00.866975+0000","last_became_active":"2024-04-19T03:35:59.877991+0000","last_became_peered":"2024-04-19T03:35:59.877991+0000","last_unstale":"2024-04-19T03:36:00.866975+0000","last_undegraded":"2024-04-19T03:36:00.866975+0000","last_fullsized":"2024-04-19T03:36:00.866975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:59:22.544717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873236+0000","last_change":"2024-04-19T03:35:54.405842+0000","last_active":"2024-04-19T03:35:59.873236+0000","last_peered":"2024-04-19T03:35:59.873236+0000","last_clean":"2024-04-19T03:35:59.873236+0000","last_became_active":"2024-04-19T03:35:54.405465+0000","last_became_peered":"2024-04-19T03:35:54.405465+0000","last_unstale":"2024-04-19T03:35:59.873236+0000","last_undegraded":"2024-04-19T03:35:59.873236+0000","last_fullsized":"2024-04-19T03:35:59.873236+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:03.279704+0000","last_change":"2024-04-19T03:35:59.429504+0000","last_active":"2024-04-19T03:36:03.279704+0000","last_peered":"2024-04-19T03:36:03.279704+0000","last_clean":"2024-04-19T03:36:03.279704+0000","last_became_active":"2024-04-19T03:35:59.428445+0000","last_became_peered":"2024-04-19T03:35:59.428445+0000","last_unstale":"2024-04-19T03:36:03.279704+0000","last_undegraded":"2024-04-19T03:36:03.279704+0000","last_fullsized":"2024-04-19T03:36:03.279704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:36.587021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867969+0000","last_change":"2024-04-19T03:35:59.881612+0000","last_active":"2024-04-19T03:36:00.867969+0000","last_peered":"2024-04-19T03:36:00.867969+0000","last_clean":"2024-04-19T03:36:00.867969+0000","last_became_active":"2024-04-19T03:35:59.880798+0000","last_became_peered":"2024-04-19T03:35:59.880798+0000","last_unstale":"2024-04-19T03:36:00.867969+0000","last_undegraded":"2024-04-19T03:36:00.867969+0000","last_fullsized":"2024-04-19T03:36:00.867969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.863575+0000","last_change":"2024-04-19T03:35:54.404971+0000","last_active":"2024-04-19T03:35:59.863575+0000","last_peered":"2024-04-19T03:35:59.863575+0000","last_clean":"2024-04-19T03:35:59.863575+0000","last_became_active":"2024-04-19T03:35:54.404670+0000","last_became_peered":"2024-04-19T03:35:54.404670+0000","last_unstale":"2024-04-19T03:35:59.863575+0000","last_undegraded":"2024-04-19T03:35:59.863575+0000","last_fullsized":"2024-04-19T03:35:59.863575+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:47.049313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867265+0000","last_change":"2024-04-19T03:35:55.405560+0000","last_active":"2024-04-19T03:35:59.867265+0000","last_peered":"2024-04-19T03:35:59.867265+0000","last_clean":"2024-04-19T03:35:59.867265+0000","last_became_active":"2024-04-19T03:35:55.405342+0000","last_became_peered":"2024-04-19T03:35:55.405342+0000","last_unstale":"2024-04-19T03:35:59.867265+0000","last_undegraded":"2024-04-19T03:35:59.867265+0000","last_fullsized":"2024-04-19T03:35:59.867265+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:27.418444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867074+0000","last_change":"2024-04-19T03:35:59.430221+0000","last_active":"2024-04-19T03:36:00.867074+0000","last_peered":"2024-04-19T03:36:00.867074+0000","last_clean":"2024-04-19T03:36:00.867074+0000","last_became_active":"2024-04-19T03:35:59.429479+0000","last_became_peered":"2024-04-19T03:35:59.429479+0000","last_unstale":"2024-04-19T03:36:00.867074+0000","last_undegraded":"2024-04-19T03:36:00.867074+0000","last_fullsized":"2024-04-19T03:36:00.867074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868989+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:36:00.868989+0000","last_peered":"2024-04-19T03:36:00.868989+0000","last_clean":"2024-04-19T03:36:00.868989+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:36:00.868989+0000","last_undegraded":"2024-04-19T03:36:00.868989+0000","last_fullsized":"2024-04-19T03:36:00.868989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867797+0000","last_change":"2024-04-19T03:35:54.408755+0000","last_active":"2024-04-19T03:35:59.867797+0000","last_peered":"2024-04-19T03:35:59.867797+0000","last_clean":"2024-04-19T03:35:59.867797+0000","last_became_active":"2024-04-19T03:35:54.408501+0000","last_became_peered":"2024-04-19T03:35:54.408501+0000","last_unstale":"2024-04-19T03:35:59.867797+0000","last_undegraded":"2024-04-19T03:35:59.867797+0000","last_fullsized":"2024-04-19T03:35:59.867797+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867712+0000","last_change":"2024-04-19T03:35:59.432736+0000","last_active":"2024-04-19T03:36:00.867712+0000","last_peered":"2024-04-19T03:36:00.867712+0000","last_clean":"2024-04-19T03:36:00.867712+0000","last_became_active":"2024-04-19T03:35:59.432160+0000","last_became_peered":"2024-04-19T03:35:59.432160+0000","last_unstale":"2024-04-19T03:36:00.867712+0000","last_undegraded":"2024-04-19T03:36:00.867712+0000","last_fullsized":"2024-04-19T03:36:00.867712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868107+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:36:00.868107+0000","last_peered":"2024-04-19T03:36:00.868107+0000","last_clean":"2024-04-19T03:36:00.868107+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:36:00.868107+0000","last_undegraded":"2024-04-19T03:36:00.868107+0000","last_fullsized":"2024-04-19T03:36:00.868107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867075+0000","last_change":"2024-04-19T03:35:54.405961+0000","last_active":"2024-04-19T03:35:59.867075+0000","last_peered":"2024-04-19T03:35:59.867075+0000","last_clean":"2024-04-19T03:35:59.867075+0000","last_became_active":"2024-04-19T03:35:54.405640+0000","last_became_peered":"2024-04-19T03:35:54.405640+0000","last_unstale":"2024-04-19T03:35:59.867075+0000","last_undegraded":"2024-04-19T03:35:59.867075+0000","last_fullsized":"2024-04-19T03:35:59.867075+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867408+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:36:00.867408+0000","last_peered":"2024-04-19T03:36:00.867408+0000","last_clean":"2024-04-19T03:36:00.867408+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:36:00.867408+0000","last_undegraded":"2024-04-19T03:36:00.867408+0000","last_fullsized":"2024-04-19T03:36:00.867408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868467+0000","last_change":"2024-04-19T03:35:59.885491+0000","last_active":"2024-04-19T03:36:00.868467+0000","last_peered":"2024-04-19T03:36:00.868467+0000","last_clean":"2024-04-19T03:36:00.868467+0000","last_became_active":"2024-04-19T03:35:59.885190+0000","last_became_peered":"2024-04-19T03:35:59.885190+0000","last_unstale":"2024-04-19T03:36:00.868467+0000","last_undegraded":"2024-04-19T03:36:00.868467+0000","last_fullsized":"2024-04-19T03:36:00.868467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.872489+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:35:59.872489+0000","last_peered":"2024-04-19T03:35:59.872489+0000","last_clean":"2024-04-19T03:35:59.872489+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:35:59.872489+0000","last_undegraded":"2024-04-19T03:35:59.872489+0000","last_fullsized":"2024-04-19T03:35:59.872489+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868035+0000","last_change":"2024-04-19T03:35:59.431391+0000","last_active":"2024-04-19T03:36:00.868035+0000","last_peered":"2024-04-19T03:36:00.868035+0000","last_clean":"2024-04-19T03:36:00.868035+0000","last_became_active":"2024-04-19T03:35:59.431063+0000","last_became_peered":"2024-04-19T03:35:59.431063+0000","last_unstale":"2024-04-19T03:36:00.868035+0000","last_undegraded":"2024-04-19T03:36:00.868035+0000","last_fullsized":"2024-04-19T03:36:00.868035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867786+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:36:00.867786+0000","last_peered":"2024-04-19T03:36:00.867786+0000","last_clean":"2024-04-19T03:36:00.867786+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:36:00.867786+0000","last_undegraded":"2024-04-19T03:36:00.867786+0000","last_fullsized":"2024-04-19T03:36:00.867786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873656+0000","last_change":"2024-04-19T03:35:54.405542+0000","last_active":"2024-04-19T03:35:59.873656+0000","last_peered":"2024-04-19T03:35:59.873656+0000","last_clean":"2024-04-19T03:35:59.873656+0000","last_became_active":"2024-04-19T03:35:54.405292+0000","last_became_peered":"2024-04-19T03:35:54.405292+0000","last_unstale":"2024-04-19T03:35:59.873656+0000","last_undegraded":"2024-04-19T03:35:59.873656+0000","last_fullsized":"2024-04-19T03:35:59.873656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867907+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:36:00.867907+0000","last_peered":"2024-04-19T03:36:00.867907+0000","last_clean":"2024-04-19T03:36:00.867907+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:36:00.867907+0000","last_undegraded":"2024-04-19T03:36:00.867907+0000","last_fullsized":"2024-04-19T03:36:00.867907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868284+0000","last_change":"2024-04-19T03:35:59.879474+0000","last_active":"2024-04-19T03:36:00.868284+0000","last_peered":"2024-04-19T03:36:00.868284+0000","last_clean":"2024-04-19T03:36:00.868284+0000","last_became_active":"2024-04-19T03:35:59.878964+0000","last_became_peered":"2024-04-19T03:35:59.878964+0000","last_unstale":"2024-04-19T03:36:00.868284+0000","last_undegraded":"2024-04-19T03:36:00.868284+0000","last_fullsized":"2024-04-19T03:36:00.868284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.868556+0000","last_change":"2024-04-19T03:35:54.405958+0000","last_active":"2024-04-19T03:35:59.868556+0000","last_peered":"2024-04-19T03:35:59.868556+0000","last_clean":"2024-04-19T03:35:59.868556+0000","last_became_active":"2024-04-19T03:35:54.405578+0000","last_became_peered":"2024-04-19T03:35:54.405578+0000","last_unstale":"2024-04-19T03:35:59.868556+0000","last_undegraded":"2024-04-19T03:35:59.868556+0000","last_fullsized":"2024-04-19T03:35:59.868556+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:11.280110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868342+0000","last_change":"2024-04-19T03:35:59.433970+0000","last_active":"2024-04-19T03:36:00.868342+0000","last_peered":"2024-04-19T03:36:00.868342+0000","last_clean":"2024-04-19T03:36:00.868342+0000","last_became_active":"2024-04-19T03:35:59.433556+0000","last_became_peered":"2024-04-19T03:35:59.433556+0000","last_unstale":"2024-04-19T03:36:00.868342+0000","last_undegraded":"2024-04-19T03:36:00.868342+0000","last_fullsized":"2024-04-19T03:36:00.868342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:44.022207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868191+0000","last_change":"2024-04-19T03:35:59.879956+0000","last_active":"2024-04-19T03:36:00.868191+0000","last_peered":"2024-04-19T03:36:00.868191+0000","last_clean":"2024-04-19T03:36:00.868191+0000","last_became_active":"2024-04-19T03:35:59.879330+0000","last_became_peered":"2024-04-19T03:35:59.879330+0000","last_unstale":"2024-04-19T03:36:00.868191+0000","last_undegraded":"2024-04-19T03:36:00.868191+0000","last_fullsized":"2024-04-19T03:36:00.868191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867999+0000","last_change":"2024-04-19T03:35:59.432750+0000","last_active":"2024-04-19T03:36:00.867999+0000","last_peered":"2024-04-19T03:36:00.867999+0000","last_clean":"2024-04-19T03:36:00.867999+0000","last_became_active":"2024-04-19T03:35:59.432172+0000","last_became_peered":"2024-04-19T03:35:59.432172+0000","last_unstale":"2024-04-19T03:36:00.867999+0000","last_undegraded":"2024-04-19T03:36:00.867999+0000","last_fullsized":"2024-04-19T03:36:00.867999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868608+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:36:00.868608+0000","last_peered":"2024-04-19T03:36:00.868608+0000","last_clean":"2024-04-19T03:36:00.868608+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:36:00.868608+0000","last_undegraded":"2024-04-19T03:36:00.868608+0000","last_fullsized":"2024-04-19T03:36:00.868608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868241+0000","last_change":"2024-04-19T03:35:59.434114+0000","last_active":"2024-04-19T03:36:00.868241+0000","last_peered":"2024-04-19T03:36:00.868241+0000","last_clean":"2024-04-19T03:36:00.868241+0000","last_became_active":"2024-04-19T03:35:59.433765+0000","last_became_peered":"2024-04-19T03:35:59.433765+0000","last_unstale":"2024-04-19T03:36:00.868241+0000","last_undegraded":"2024-04-19T03:36:00.868241+0000","last_fullsized":"2024-04-19T03:36:00.868241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867893+0000","last_change":"2024-04-19T03:35:59.876608+0000","last_active":"2024-04-19T03:36:00.867893+0000","last_peered":"2024-04-19T03:36:00.867893+0000","last_clean":"2024-04-19T03:36:00.867893+0000","last_became_active":"2024-04-19T03:35:59.875297+0000","last_became_peered":"2024-04-19T03:35:59.875297+0000","last_unstale":"2024-04-19T03:36:00.867893+0000","last_undegraded":"2024-04-19T03:36:00.867893+0000","last_fullsized":"2024-04-19T03:36:00.867893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868926+0000","last_change":"2024-04-19T03:35:59.432321+0000","last_active":"2024-04-19T03:36:00.868926+0000","last_peered":"2024-04-19T03:36:00.868926+0000","last_clean":"2024-04-19T03:36:00.868926+0000","last_became_active":"2024-04-19T03:35:59.431638+0000","last_became_peered":"2024-04-19T03:35:59.431638+0000","last_unstale":"2024-04-19T03:36:00.868926+0000","last_undegraded":"2024-04-19T03:36:00.868926+0000","last_fullsized":"2024-04-19T03:36:00.868926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867670+0000","last_change":"2024-04-19T03:35:59.877336+0000","last_active":"2024-04-19T03:36:00.867670+0000","last_peered":"2024-04-19T03:36:00.867670+0000","last_clean":"2024-04-19T03:36:00.867670+0000","last_became_active":"2024-04-19T03:35:59.876461+0000","last_became_peered":"2024-04-19T03:35:59.876461+0000","last_unstale":"2024-04-19T03:36:00.867670+0000","last_undegraded":"2024-04-19T03:36:00.867670+0000","last_fullsized":"2024-04-19T03:36:00.867670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868151+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:36:00.868151+0000","last_peered":"2024-04-19T03:36:00.868151+0000","last_clean":"2024-04-19T03:36:00.868151+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:36:00.868151+0000","last_undegraded":"2024-04-19T03:36:00.868151+0000","last_fullsized":"2024-04-19T03:36:00.868151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868264+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:36:00.868264+0000","last_peered":"2024-04-19T03:36:00.868264+0000","last_clean":"2024-04-19T03:36:00.868264+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:36:00.868264+0000","last_undegraded":"2024-04-19T03:36:00.868264+0000","last_fullsized":"2024-04-19T03:36:00.868264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868040+0000","last_change":"2024-04-19T03:35:59.429171+0000","last_active":"2024-04-19T03:36:00.868040+0000","last_peered":"2024-04-19T03:36:00.868040+0000","last_clean":"2024-04-19T03:36:00.868040+0000","last_became_active":"2024-04-19T03:35:59.428837+0000","last_became_peered":"2024-04-19T03:35:59.428837+0000","last_unstale":"2024-04-19T03:36:00.868040+0000","last_undegraded":"2024-04-19T03:36:00.868040+0000","last_fullsized":"2024-04-19T03:36:00.868040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867627+0000","last_change":"2024-04-19T03:35:59.880260+0000","last_active":"2024-04-19T03:36:00.867627+0000","last_peered":"2024-04-19T03:36:00.867627+0000","last_clean":"2024-04-19T03:36:00.867627+0000","last_became_active":"2024-04-19T03:35:59.879086+0000","last_became_peered":"2024-04-19T03:35:59.879086+0000","last_unstale":"2024-04-19T03:36:00.867627+0000","last_undegraded":"2024-04-19T03:36:00.867627+0000","last_fullsized":"2024-04-19T03:36:00.867627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867442+0000","last_change":"2024-04-19T03:35:59.880550+0000","last_active":"2024-04-19T03:36:00.867442+0000","last_peered":"2024-04-19T03:36:00.867442+0000","last_clean":"2024-04-19T03:36:00.867442+0000","last_became_active":"2024-04-19T03:35:59.879772+0000","last_became_peered":"2024-04-19T03:35:59.879772+0000","last_unstale":"2024-04-19T03:36:00.867442+0000","last_undegraded":"2024-04-19T03:36:00.867442+0000","last_fullsized":"2024-04-19T03:36:00.867442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867115+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:36:00.867115+0000","last_peered":"2024-04-19T03:36:00.867115+0000","last_clean":"2024-04-19T03:36:00.867115+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:36:00.867115+0000","last_undegraded":"2024-04-19T03:36:00.867115+0000","last_fullsized":"2024-04-19T03:36:00.867115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868363+0000","last_change":"2024-04-19T03:35:59.881028+0000","last_active":"2024-04-19T03:36:00.868363+0000","last_peered":"2024-04-19T03:36:00.868363+0000","last_clean":"2024-04-19T03:36:00.868363+0000","last_became_active":"2024-04-19T03:35:59.880088+0000","last_became_peered":"2024-04-19T03:35:59.880088+0000","last_unstale":"2024-04-19T03:36:00.868363+0000","last_undegraded":"2024-04-19T03:36:00.868363+0000","last_fullsized":"2024-04-19T03:36:00.868363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:52.418012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867632+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:36:00.867632+0000","last_peered":"2024-04-19T03:36:00.867632+0000","last_clean":"2024-04-19T03:36:00.867632+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:36:00.867632+0000","last_undegraded":"2024-04-19T03:36:00.867632+0000","last_fullsized":"2024-04-19T03:36:00.867632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868762+0000","last_change":"2024-04-19T03:35:59.882281+0000","last_active":"2024-04-19T03:36:00.868762+0000","last_peered":"2024-04-19T03:36:00.868762+0000","last_clean":"2024-04-19T03:36:00.868762+0000","last_became_active":"2024-04-19T03:35:59.880757+0000","last_became_peered":"2024-04-19T03:35:59.880757+0000","last_unstale":"2024-04-19T03:36:00.868762+0000","last_undegraded":"2024-04-19T03:36:00.868762+0000","last_fullsized":"2024-04-19T03:36:00.868762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:36:08.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:36:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:36:08.778 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-19T03:36:08.270123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.407257"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869083+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:36:00.869083+0000","last_peered":"2024-04-19T03:36:00.869083+0000","last_clean":"2024-04-19T03:36:00.869083+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:36:00.869083+0000","last_undegraded":"2024-04-19T03:36:00.869083+0000","last_fullsized":"2024-04-19T03:36:00.869083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868676+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:36:00.868676+0000","last_peered":"2024-04-19T03:36:00.868676+0000","last_clean":"2024-04-19T03:36:00.868676+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:36:00.868676+0000","last_undegraded":"2024-04-19T03:36:00.868676+0000","last_fullsized":"2024-04-19T03:36:00.868676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868331+0000","last_change":"2024-04-19T03:35:59.886429+0000","last_active":"2024-04-19T03:36:00.868331+0000","last_peered":"2024-04-19T03:36:00.868331+0000","last_clean":"2024-04-19T03:36:00.868331+0000","last_became_active":"2024-04-19T03:35:59.886189+0000","last_became_peered":"2024-04-19T03:35:59.886189+0000","last_unstale":"2024-04-19T03:36:00.868331+0000","last_undegraded":"2024-04-19T03:36:00.868331+0000","last_fullsized":"2024-04-19T03:36:00.868331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867838+0000","last_change":"2024-04-19T03:35:59.878844+0000","last_active":"2024-04-19T03:36:00.867838+0000","last_peered":"2024-04-19T03:36:00.867838+0000","last_clean":"2024-04-19T03:36:00.867838+0000","last_became_active":"2024-04-19T03:35:59.878100+0000","last_became_peered":"2024-04-19T03:35:59.878100+0000","last_unstale":"2024-04-19T03:36:00.867838+0000","last_undegraded":"2024-04-19T03:36:00.867838+0000","last_fullsized":"2024-04-19T03:36:00.867838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868178+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:36:00.868178+0000","last_peered":"2024-04-19T03:36:00.868178+0000","last_clean":"2024-04-19T03:36:00.868178+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:36:00.868178+0000","last_undegraded":"2024-04-19T03:36:00.868178+0000","last_fullsized":"2024-04-19T03:36:00.868178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867527+0000","last_change":"2024-04-19T03:35:59.876553+0000","last_active":"2024-04-19T03:36:00.867527+0000","last_peered":"2024-04-19T03:36:00.867527+0000","last_clean":"2024-04-19T03:36:00.867527+0000","last_became_active":"2024-04-19T03:35:59.875201+0000","last_became_peered":"2024-04-19T03:35:59.875201+0000","last_unstale":"2024-04-19T03:36:00.867527+0000","last_undegraded":"2024-04-19T03:36:00.867527+0000","last_fullsized":"2024-04-19T03:36:00.867527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867483+0000","last_change":"2024-04-19T03:35:59.876305+0000","last_active":"2024-04-19T03:36:00.867483+0000","last_peered":"2024-04-19T03:36:00.867483+0000","last_clean":"2024-04-19T03:36:00.867483+0000","last_became_active":"2024-04-19T03:35:59.875093+0000","last_became_peered":"2024-04-19T03:35:59.875093+0000","last_unstale":"2024-04-19T03:36:00.867483+0000","last_undegraded":"2024-04-19T03:36:00.867483+0000","last_fullsized":"2024-04-19T03:36:00.867483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867184+0000","last_change":"2024-04-19T03:35:59.880058+0000","last_active":"2024-04-19T03:36:00.867184+0000","last_peered":"2024-04-19T03:36:00.867184+0000","last_clean":"2024-04-19T03:36:00.867184+0000","last_became_active":"2024-04-19T03:35:59.878691+0000","last_became_peered":"2024-04-19T03:35:59.878691+0000","last_unstale":"2024-04-19T03:36:00.867184+0000","last_undegraded":"2024-04-19T03:36:00.867184+0000","last_fullsized":"2024-04-19T03:36:00.867184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868945+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:36:00.868945+0000","last_peered":"2024-04-19T03:36:00.868945+0000","last_clean":"2024-04-19T03:36:00.868945+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:36:00.868945+0000","last_undegraded":"2024-04-19T03:36:00.868945+0000","last_fullsized":"2024-04-19T03:36:00.868945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868069+0000","last_change":"2024-04-19T03:35:59.878070+0000","last_active":"2024-04-19T03:36:00.868069+0000","last_peered":"2024-04-19T03:36:00.868069+0000","last_clean":"2024-04-19T03:36:00.868069+0000","last_became_active":"2024-04-19T03:35:59.876291+0000","last_became_peered":"2024-04-19T03:35:59.876291+0000","last_unstale":"2024-04-19T03:36:00.868069+0000","last_undegraded":"2024-04-19T03:36:00.868069+0000","last_fullsized":"2024-04-19T03:36:00.868069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868341+0000","last_change":"2024-04-19T03:35:59.883585+0000","last_active":"2024-04-19T03:36:00.868341+0000","last_peered":"2024-04-19T03:36:00.868341+0000","last_clean":"2024-04-19T03:36:00.868341+0000","last_became_active":"2024-04-19T03:35:59.883232+0000","last_became_peered":"2024-04-19T03:35:59.883232+0000","last_unstale":"2024-04-19T03:36:00.868341+0000","last_undegraded":"2024-04-19T03:36:00.868341+0000","last_fullsized":"2024-04-19T03:36:00.868341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867977+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:36:00.867977+0000","last_peered":"2024-04-19T03:36:00.867977+0000","last_clean":"2024-04-19T03:36:00.867977+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:36:00.867977+0000","last_undegraded":"2024-04-19T03:36:00.867977+0000","last_fullsized":"2024-04-19T03:36:00.867977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867945+0000","last_change":"2024-04-19T03:35:59.882444+0000","last_active":"2024-04-19T03:36:00.867945+0000","last_peered":"2024-04-19T03:36:00.867945+0000","last_clean":"2024-04-19T03:36:00.867945+0000","last_became_active":"2024-04-19T03:35:59.882075+0000","last_became_peered":"2024-04-19T03:35:59.882075+0000","last_unstale":"2024-04-19T03:36:00.867945+0000","last_undegraded":"2024-04-19T03:36:00.867945+0000","last_fullsized":"2024-04-19T03:36:00.867945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867610+0000","last_change":"2024-04-19T03:35:59.882604+0000","last_active":"2024-04-19T03:36:00.867610+0000","last_peered":"2024-04-19T03:36:00.867610+0000","last_clean":"2024-04-19T03:36:00.867610+0000","last_became_active":"2024-04-19T03:35:59.882330+0000","last_became_peered":"2024-04-19T03:35:59.882330+0000","last_unstale":"2024-04-19T03:36:00.867610+0000","last_undegraded":"2024-04-19T03:36:00.867610+0000","last_fullsized":"2024-04-19T03:36:00.867610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867199+0000","last_change":"2024-04-19T03:35:59.880349+0000","last_active":"2024-04-19T03:36:00.867199+0000","last_peered":"2024-04-19T03:36:00.867199+0000","last_clean":"2024-04-19T03:36:00.867199+0000","last_became_active":"2024-04-19T03:35:59.879119+0000","last_became_peered":"2024-04-19T03:35:59.879119+0000","last_unstale":"2024-04-19T03:36:00.867199+0000","last_undegraded":"2024-04-19T03:36:00.867199+0000","last_fullsized":"2024-04-19T03:36:00.867199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867891+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:36:00.867891+0000","last_peered":"2024-04-19T03:36:00.867891+0000","last_clean":"2024-04-19T03:36:00.867891+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:36:00.867891+0000","last_undegraded":"2024-04-19T03:36:00.867891+0000","last_fullsized":"2024-04-19T03:36:00.867891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868856+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868856+0000","last_peered":"2024-04-19T03:36:00.868856+0000","last_clean":"2024-04-19T03:36:00.868856+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:36:00.868856+0000","last_undegraded":"2024-04-19T03:36:00.868856+0000","last_fullsized":"2024-04-19T03:36:00.868856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867771+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:36:00.867771+0000","last_peered":"2024-04-19T03:36:00.867771+0000","last_clean":"2024-04-19T03:36:00.867771+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:36:00.867771+0000","last_undegraded":"2024-04-19T03:36:00.867771+0000","last_fullsized":"2024-04-19T03:36:00.867771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867992+0000","last_change":"2024-04-19T03:35:59.879234+0000","last_active":"2024-04-19T03:36:00.867992+0000","last_peered":"2024-04-19T03:36:00.867992+0000","last_clean":"2024-04-19T03:36:00.867992+0000","last_became_active":"2024-04-19T03:35:59.878820+0000","last_became_peered":"2024-04-19T03:35:59.878820+0000","last_unstale":"2024-04-19T03:36:00.867992+0000","last_undegraded":"2024-04-19T03:36:00.867992+0000","last_fullsized":"2024-04-19T03:36:00.867992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.877313+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.875350+0000","last_became_peered":"2024-04-19T03:35:59.875350+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868267+0000","last_change":"2024-04-19T03:35:59.881019+0000","last_active":"2024-04-19T03:36:00.868267+0000","last_peered":"2024-04-19T03:36:00.868267+0000","last_clean":"2024-04-19T03:36:00.868267+0000","last_became_active":"2024-04-19T03:35:59.880363+0000","last_became_peered":"2024-04-19T03:35:59.880363+0000","last_unstale":"2024-04-19T03:36:00.868267+0000","last_undegraded":"2024-04-19T03:36:00.868267+0000","last_fullsized":"2024-04-19T03:36:00.868267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867430+0000","last_change":"2024-04-19T03:35:59.872083+0000","last_active":"2024-04-19T03:36:00.867430+0000","last_peered":"2024-04-19T03:36:00.867430+0000","last_clean":"2024-04-19T03:36:00.867430+0000","last_became_active":"2024-04-19T03:35:59.871872+0000","last_became_peered":"2024-04-19T03:35:59.871872+0000","last_unstale":"2024-04-19T03:36:00.867430+0000","last_undegraded":"2024-04-19T03:36:00.867430+0000","last_fullsized":"2024-04-19T03:36:00.867430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868080+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:36:00.868080+0000","last_peered":"2024-04-19T03:36:00.868080+0000","last_clean":"2024-04-19T03:36:00.868080+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:36:00.868080+0000","last_undegraded":"2024-04-19T03:36:00.868080+0000","last_fullsized":"2024-04-19T03:36:00.868080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869076+0000","last_change":"2024-04-19T03:35:59.882017+0000","last_active":"2024-04-19T03:36:00.869076+0000","last_peered":"2024-04-19T03:36:00.869076+0000","last_clean":"2024-04-19T03:36:00.869076+0000","last_became_active":"2024-04-19T03:35:59.881048+0000","last_became_peered":"2024-04-19T03:35:59.881048+0000","last_unstale":"2024-04-19T03:36:00.869076+0000","last_undegraded":"2024-04-19T03:36:00.869076+0000","last_fullsized":"2024-04-19T03:36:00.869076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868233+0000","last_change":"2024-04-19T03:35:59.873199+0000","last_active":"2024-04-19T03:36:00.868233+0000","last_peered":"2024-04-19T03:36:00.868233+0000","last_clean":"2024-04-19T03:36:00.868233+0000","last_became_active":"2024-04-19T03:35:59.872661+0000","last_became_peered":"2024-04-19T03:35:59.872661+0000","last_unstale":"2024-04-19T03:36:00.868233+0000","last_undegraded":"2024-04-19T03:36:00.868233+0000","last_fullsized":"2024-04-19T03:36:00.868233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868190+0000","last_change":"2024-04-19T03:35:59.882737+0000","last_active":"2024-04-19T03:36:00.868190+0000","last_peered":"2024-04-19T03:36:00.868190+0000","last_clean":"2024-04-19T03:36:00.868190+0000","last_became_active":"2024-04-19T03:35:59.882537+0000","last_became_peered":"2024-04-19T03:35:59.882537+0000","last_unstale":"2024-04-19T03:36:00.868190+0000","last_undegraded":"2024-04-19T03:36:00.868190+0000","last_fullsized":"2024-04-19T03:36:00.868190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867954+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:36:00.867954+0000","last_peered":"2024-04-19T03:36:00.867954+0000","last_clean":"2024-04-19T03:36:00.867954+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:36:00.867954+0000","last_undegraded":"2024-04-19T03:36:00.867954+0000","last_fullsized":"2024-04-19T03:36:00.867954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868942+0000","last_change":"2024-04-19T03:35:59.882176+0000","last_active":"2024-04-19T03:36:00.868942+0000","last_peered":"2024-04-19T03:36:00.868942+0000","last_clean":"2024-04-19T03:36:00.868942+0000","last_became_active":"2024-04-19T03:35:59.881216+0000","last_became_peered":"2024-04-19T03:35:59.881216+0000","last_unstale":"2024-04-19T03:36:00.868942+0000","last_undegraded":"2024-04-19T03:36:00.868942+0000","last_fullsized":"2024-04-19T03:36:00.868942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867298+0000","last_change":"2024-04-19T03:35:59.429598+0000","last_active":"2024-04-19T03:36:00.867298+0000","last_peered":"2024-04-19T03:36:00.867298+0000","last_clean":"2024-04-19T03:36:00.867298+0000","last_became_active":"2024-04-19T03:35:59.429239+0000","last_became_peered":"2024-04-19T03:35:59.429239+0000","last_unstale":"2024-04-19T03:36:00.867298+0000","last_undegraded":"2024-04-19T03:36:00.867298+0000","last_fullsized":"2024-04-19T03:36:00.867298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868065+0000","last_change":"2024-04-19T03:35:59.872790+0000","last_active":"2024-04-19T03:36:00.868065+0000","last_peered":"2024-04-19T03:36:00.868065+0000","last_clean":"2024-04-19T03:36:00.868065+0000","last_became_active":"2024-04-19T03:35:59.872223+0000","last_became_peered":"2024-04-19T03:35:59.872223+0000","last_unstale":"2024-04-19T03:36:00.868065+0000","last_undegraded":"2024-04-19T03:36:00.868065+0000","last_fullsized":"2024-04-19T03:36:00.868065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867213+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:36:00.867213+0000","last_peered":"2024-04-19T03:36:00.867213+0000","last_clean":"2024-04-19T03:36:00.867213+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:36:00.867213+0000","last_undegraded":"2024-04-19T03:36:00.867213+0000","last_fullsized":"2024-04-19T03:36:00.867213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868970+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868970+0000","last_peered":"2024-04-19T03:36:00.868970+0000","last_clean":"2024-04-19T03:36:00.868970+0000","last_became_active":"2024-04-19T03:35:59.881795+0000","last_became_peered":"2024-04-19T03:35:59.881795+0000","last_unstale":"2024-04-19T03:36:00.868970+0000","last_undegraded":"2024-04-19T03:36:00.868970+0000","last_fullsized":"2024-04-19T03:36:00.868970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868091+0000","last_change":"2024-04-19T03:35:59.429529+0000","last_active":"2024-04-19T03:36:00.868091+0000","last_peered":"2024-04-19T03:36:00.868091+0000","last_clean":"2024-04-19T03:36:00.868091+0000","last_became_active":"2024-04-19T03:35:59.429121+0000","last_became_peered":"2024-04-19T03:35:59.429121+0000","last_unstale":"2024-04-19T03:36:00.868091+0000","last_undegraded":"2024-04-19T03:36:00.868091+0000","last_fullsized":"2024-04-19T03:36:00.868091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867146+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:36:00.867146+0000","last_peered":"2024-04-19T03:36:00.867146+0000","last_clean":"2024-04-19T03:36:00.867146+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:36:00.867146+0000","last_undegraded":"2024-04-19T03:36:00.867146+0000","last_fullsized":"2024-04-19T03:36:00.867146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868383+0000","last_change":"2024-04-19T03:35:59.434129+0000","last_active":"2024-04-19T03:36:00.868383+0000","last_peered":"2024-04-19T03:36:00.868383+0000","last_clean":"2024-04-19T03:36:00.868383+0000","last_became_active":"2024-04-19T03:35:59.433761+0000","last_became_peered":"2024-04-19T03:35:59.433761+0000","last_unstale":"2024-04-19T03:36:00.868383+0000","last_undegraded":"2024-04-19T03:36:00.868383+0000","last_fullsized":"2024-04-19T03:36:00.868383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867364+0000","last_change":"2024-04-19T03:35:59.872126+0000","last_active":"2024-04-19T03:36:00.867364+0000","last_peered":"2024-04-19T03:36:00.867364+0000","last_clean":"2024-04-19T03:36:00.867364+0000","last_became_active":"2024-04-19T03:35:59.871818+0000","last_became_peered":"2024-04-19T03:35:59.871818+0000","last_unstale":"2024-04-19T03:36:00.867364+0000","last_undegraded":"2024-04-19T03:36:00.867364+0000","last_fullsized":"2024-04-19T03:36:00.867364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:49:19.611505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868776+0000","last_change":"2024-04-19T03:35:59.431907+0000","last_active":"2024-04-19T03:36:00.868776+0000","last_peered":"2024-04-19T03:36:00.868776+0000","last_clean":"2024-04-19T03:36:00.868776+0000","last_became_active":"2024-04-19T03:35:59.431432+0000","last_became_peered":"2024-04-19T03:35:59.431432+0000","last_unstale":"2024-04-19T03:36:00.868776+0000","last_undegraded":"2024-04-19T03:36:00.868776+0000","last_fullsized":"2024-04-19T03:36:00.868776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867656+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:36:00.867656+0000","last_peered":"2024-04-19T03:36:00.867656+0000","last_clean":"2024-04-19T03:36:00.867656+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:36:00.867656+0000","last_undegraded":"2024-04-19T03:36:00.867656+0000","last_fullsized":"2024-04-19T03:36:00.867656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868141+0000","last_change":"2024-04-19T03:35:59.433961+0000","last_active":"2024-04-19T03:36:00.868141+0000","last_peered":"2024-04-19T03:36:00.868141+0000","last_clean":"2024-04-19T03:36:00.868141+0000","last_became_active":"2024-04-19T03:35:59.433506+0000","last_became_peered":"2024-04-19T03:35:59.433506+0000","last_unstale":"2024-04-19T03:36:00.868141+0000","last_undegraded":"2024-04-19T03:36:00.868141+0000","last_fullsized":"2024-04-19T03:36:00.868141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868192+0000","last_change":"2024-04-19T03:35:59.885493+0000","last_active":"2024-04-19T03:36:00.868192+0000","last_peered":"2024-04-19T03:36:00.868192+0000","last_clean":"2024-04-19T03:36:00.868192+0000","last_became_active":"2024-04-19T03:35:59.885107+0000","last_became_peered":"2024-04-19T03:35:59.885107+0000","last_unstale":"2024-04-19T03:36:00.868192+0000","last_undegraded":"2024-04-19T03:36:00.868192+0000","last_fullsized":"2024-04-19T03:36:00.868192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868108+0000","last_change":"2024-04-19T03:35:59.434133+0000","last_active":"2024-04-19T03:36:00.868108+0000","last_peered":"2024-04-19T03:36:00.868108+0000","last_clean":"2024-04-19T03:36:00.868108+0000","last_became_active":"2024-04-19T03:35:59.433755+0000","last_became_peered":"2024-04-19T03:35:59.433755+0000","last_unstale":"2024-04-19T03:36:00.868108+0000","last_undegraded":"2024-04-19T03:36:00.868108+0000","last_fullsized":"2024-04-19T03:36:00.868108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:17.507444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868452+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:36:00.868452+0000","last_peered":"2024-04-19T03:36:00.868452+0000","last_clean":"2024-04-19T03:36:00.868452+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:36:00.868452+0000","last_undegraded":"2024-04-19T03:36:00.868452+0000","last_fullsized":"2024-04-19T03:36:00.868452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867515+0000","last_change":"2024-04-19T03:35:59.428849+0000","last_active":"2024-04-19T03:36:00.867515+0000","last_peered":"2024-04-19T03:36:00.867515+0000","last_clean":"2024-04-19T03:36:00.867515+0000","last_became_active":"2024-04-19T03:35:59.428478+0000","last_became_peered":"2024-04-19T03:35:59.428478+0000","last_unstale":"2024-04-19T03:36:00.867515+0000","last_undegraded":"2024-04-19T03:36:00.867515+0000","last_fullsized":"2024-04-19T03:36:00.867515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869023+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:36:00.869023+0000","last_peered":"2024-04-19T03:36:00.869023+0000","last_clean":"2024-04-19T03:36:00.869023+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:36:00.869023+0000","last_undegraded":"2024-04-19T03:36:00.869023+0000","last_fullsized":"2024-04-19T03:36:00.869023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867937+0000","last_change":"2024-04-19T03:35:59.431877+0000","last_active":"2024-04-19T03:36:00.867937+0000","last_peered":"2024-04-19T03:36:00.867937+0000","last_clean":"2024-04-19T03:36:00.867937+0000","last_became_active":"2024-04-19T03:35:59.431343+0000","last_became_peered":"2024-04-19T03:35:59.431343+0000","last_unstale":"2024-04-19T03:36:00.867937+0000","last_undegraded":"2024-04-19T03:36:00.867937+0000","last_fullsized":"2024-04-19T03:36:00.867937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868161+0000","last_change":"2024-04-19T03:35:59.873111+0000","last_active":"2024-04-19T03:36:00.868161+0000","last_peered":"2024-04-19T03:36:00.868161+0000","last_clean":"2024-04-19T03:36:00.868161+0000","last_became_active":"2024-04-19T03:35:59.872468+0000","last_became_peered":"2024-04-19T03:35:59.872468+0000","last_unstale":"2024-04-19T03:36:00.868161+0000","last_undegraded":"2024-04-19T03:36:00.868161+0000","last_fullsized":"2024-04-19T03:36:00.868161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:30:15.469254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867684+0000","last_change":"2024-04-19T03:35:59.434023+0000","last_active":"2024-04-19T03:36:00.867684+0000","last_peered":"2024-04-19T03:36:00.867684+0000","last_clean":"2024-04-19T03:36:00.867684+0000","last_became_active":"2024-04-19T03:35:59.433542+0000","last_became_peered":"2024-04-19T03:35:59.433542+0000","last_unstale":"2024-04-19T03:36:00.867684+0000","last_undegraded":"2024-04-19T03:36:00.867684+0000","last_fullsized":"2024-04-19T03:36:00.867684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868203+0000","last_change":"2024-04-19T03:35:59.872558+0000","last_active":"2024-04-19T03:36:00.868203+0000","last_peered":"2024-04-19T03:36:00.868203+0000","last_clean":"2024-04-19T03:36:00.868203+0000","last_became_active":"2024-04-19T03:35:59.872302+0000","last_became_peered":"2024-04-19T03:35:59.872302+0000","last_unstale":"2024-04-19T03:36:00.868203+0000","last_undegraded":"2024-04-19T03:36:00.868203+0000","last_fullsized":"2024-04-19T03:36:00.868203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:14.886758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868499+0000","last_change":"2024-04-19T03:35:59.434430+0000","last_active":"2024-04-19T03:36:00.868499+0000","last_peered":"2024-04-19T03:36:00.868499+0000","last_clean":"2024-04-19T03:36:00.868499+0000","last_became_active":"2024-04-19T03:35:59.433885+0000","last_became_peered":"2024-04-19T03:35:59.433885+0000","last_unstale":"2024-04-19T03:36:00.868499+0000","last_undegraded":"2024-04-19T03:36:00.868499+0000","last_fullsized":"2024-04-19T03:36:00.868499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867570+0000","last_change":"2024-04-19T03:35:59.883449+0000","last_active":"2024-04-19T03:36:00.867570+0000","last_peered":"2024-04-19T03:36:00.867570+0000","last_clean":"2024-04-19T03:36:00.867570+0000","last_became_active":"2024-04-19T03:35:59.882794+0000","last_became_peered":"2024-04-19T03:35:59.882794+0000","last_unstale":"2024-04-19T03:36:00.867570+0000","last_undegraded":"2024-04-19T03:36:00.867570+0000","last_fullsized":"2024-04-19T03:36:00.867570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868576+0000","last_change":"2024-04-19T03:35:59.433568+0000","last_active":"2024-04-19T03:36:00.868576+0000","last_peered":"2024-04-19T03:36:00.868576+0000","last_clean":"2024-04-19T03:36:00.868576+0000","last_became_active":"2024-04-19T03:35:59.433247+0000","last_became_peered":"2024-04-19T03:35:59.433247+0000","last_unstale":"2024-04-19T03:36:00.868576+0000","last_undegraded":"2024-04-19T03:36:00.868576+0000","last_fullsized":"2024-04-19T03:36:00.868576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868220+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:36:00.868220+0000","last_peered":"2024-04-19T03:36:00.868220+0000","last_clean":"2024-04-19T03:36:00.868220+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:36:00.868220+0000","last_undegraded":"2024-04-19T03:36:00.868220+0000","last_fullsized":"2024-04-19T03:36:00.868220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868210+0000","last_change":"2024-04-19T03:35:59.433585+0000","last_active":"2024-04-19T03:36:00.868210+0000","last_peered":"2024-04-19T03:36:00.868210+0000","last_clean":"2024-04-19T03:36:00.868210+0000","last_became_active":"2024-04-19T03:35:59.433273+0000","last_became_peered":"2024-04-19T03:35:59.433273+0000","last_unstale":"2024-04-19T03:36:00.868210+0000","last_undegraded":"2024-04-19T03:36:00.868210+0000","last_fullsized":"2024-04-19T03:36:00.868210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867805+0000","last_change":"2024-04-19T03:35:59.876757+0000","last_active":"2024-04-19T03:36:00.867805+0000","last_peered":"2024-04-19T03:36:00.867805+0000","last_clean":"2024-04-19T03:36:00.867805+0000","last_became_active":"2024-04-19T03:35:59.876227+0000","last_became_peered":"2024-04-19T03:35:59.876227+0000","last_unstale":"2024-04-19T03:36:00.867805+0000","last_undegraded":"2024-04-19T03:36:00.867805+0000","last_fullsized":"2024-04-19T03:36:00.867805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867647+0000","last_change":"2024-04-19T03:35:59.431430+0000","last_active":"2024-04-19T03:36:00.867647+0000","last_peered":"2024-04-19T03:36:00.867647+0000","last_clean":"2024-04-19T03:36:00.867647+0000","last_became_active":"2024-04-19T03:35:59.431072+0000","last_became_peered":"2024-04-19T03:35:59.431072+0000","last_unstale":"2024-04-19T03:36:00.867647+0000","last_undegraded":"2024-04-19T03:36:00.867647+0000","last_fullsized":"2024-04-19T03:36:00.867647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867590+0000","last_change":"2024-04-19T03:35:59.876828+0000","last_active":"2024-04-19T03:36:00.867590+0000","last_peered":"2024-04-19T03:36:00.867590+0000","last_clean":"2024-04-19T03:36:00.867590+0000","last_became_active":"2024-04-19T03:35:59.876482+0000","last_became_peered":"2024-04-19T03:35:59.876482+0000","last_unstale":"2024-04-19T03:36:00.867590+0000","last_undegraded":"2024-04-19T03:36:00.867590+0000","last_fullsized":"2024-04-19T03:36:00.867590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:05.827809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867495+0000","last_change":"2024-04-19T03:35:59.429451+0000","last_active":"2024-04-19T03:36:00.867495+0000","last_peered":"2024-04-19T03:36:00.867495+0000","last_clean":"2024-04-19T03:36:00.867495+0000","last_became_active":"2024-04-19T03:35:59.429087+0000","last_became_peered":"2024-04-19T03:35:59.429087+0000","last_unstale":"2024-04-19T03:36:00.867495+0000","last_undegraded":"2024-04-19T03:36:00.867495+0000","last_fullsized":"2024-04-19T03:36:00.867495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:19.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867804+0000","last_change":"2024-04-19T03:35:59.879270+0000","last_active":"2024-04-19T03:36:00.867804+0000","last_peered":"2024-04-19T03:36:00.867804+0000","last_clean":"2024-04-19T03:36:00.867804+0000","last_became_active":"2024-04-19T03:35:59.878554+0000","last_became_peered":"2024-04-19T03:35:59.878554+0000","last_unstale":"2024-04-19T03:36:00.867804+0000","last_undegraded":"2024-04-19T03:36:00.867804+0000","last_fullsized":"2024-04-19T03:36:00.867804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867631+0000","last_change":"2024-04-19T03:35:59.431379+0000","last_active":"2024-04-19T03:36:00.867631+0000","last_peered":"2024-04-19T03:36:00.867631+0000","last_clean":"2024-04-19T03:36:00.867631+0000","last_became_active":"2024-04-19T03:35:59.431065+0000","last_became_peered":"2024-04-19T03:35:59.431065+0000","last_unstale":"2024-04-19T03:36:00.867631+0000","last_undegraded":"2024-04-19T03:36:00.867631+0000","last_fullsized":"2024-04-19T03:36:00.867631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868460+0000","last_change":"2024-04-19T03:35:59.885989+0000","last_active":"2024-04-19T03:36:00.868460+0000","last_peered":"2024-04-19T03:36:00.868460+0000","last_clean":"2024-04-19T03:36:00.868460+0000","last_became_active":"2024-04-19T03:35:59.885765+0000","last_became_peered":"2024-04-19T03:35:59.885765+0000","last_unstale":"2024-04-19T03:36:00.868460+0000","last_undegraded":"2024-04-19T03:36:00.868460+0000","last_fullsized":"2024-04-19T03:36:00.868460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867795+0000","last_change":"2024-04-19T03:35:59.431967+0000","last_active":"2024-04-19T03:36:00.867795+0000","last_peered":"2024-04-19T03:36:00.867795+0000","last_clean":"2024-04-19T03:36:00.867795+0000","last_became_active":"2024-04-19T03:35:59.431521+0000","last_became_peered":"2024-04-19T03:35:59.431521+0000","last_unstale":"2024-04-19T03:36:00.867795+0000","last_undegraded":"2024-04-19T03:36:00.867795+0000","last_fullsized":"2024-04-19T03:36:00.867795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868517+0000","last_change":"2024-04-19T03:35:59.885527+0000","last_active":"2024-04-19T03:36:00.868517+0000","last_peered":"2024-04-19T03:36:00.868517+0000","last_clean":"2024-04-19T03:36:00.868517+0000","last_became_active":"2024-04-19T03:35:59.885186+0000","last_became_peered":"2024-04-19T03:35:59.885186+0000","last_unstale":"2024-04-19T03:36:00.868517+0000","last_undegraded":"2024-04-19T03:36:00.868517+0000","last_fullsized":"2024-04-19T03:36:00.868517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867777+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:36:00.867777+0000","last_peered":"2024-04-19T03:36:00.867777+0000","last_clean":"2024-04-19T03:36:00.867777+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:36:00.867777+0000","last_undegraded":"2024-04-19T03:36:00.867777+0000","last_fullsized":"2024-04-19T03:36:00.867777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867975+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:36:00.867975+0000","last_peered":"2024-04-19T03:36:00.867975+0000","last_clean":"2024-04-19T03:36:00.867975+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:36:00.867975+0000","last_undegraded":"2024-04-19T03:36:00.867975+0000","last_fullsized":"2024-04-19T03:36:00.867975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867991+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:36:00.867991+0000","last_peered":"2024-04-19T03:36:00.867991+0000","last_clean":"2024-04-19T03:36:00.867991+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:36:00.867991+0000","last_undegraded":"2024-04-19T03:36:00.867991+0000","last_fullsized":"2024-04-19T03:36:00.867991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.874027+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:35:59.874027+0000","last_peered":"2024-04-19T03:35:59.874027+0000","last_clean":"2024-04-19T03:35:59.874027+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:35:59.874027+0000","last_undegraded":"2024-04-19T03:35:59.874027+0000","last_fullsized":"2024-04-19T03:35:59.874027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.866975+0000","last_change":"2024-04-19T03:35:59.878242+0000","last_active":"2024-04-19T03:36:00.866975+0000","last_peered":"2024-04-19T03:36:00.866975+0000","last_clean":"2024-04-19T03:36:00.866975+0000","last_became_active":"2024-04-19T03:35:59.877991+0000","last_became_peered":"2024-04-19T03:35:59.877991+0000","last_unstale":"2024-04-19T03:36:00.866975+0000","last_undegraded":"2024-04-19T03:36:00.866975+0000","last_fullsized":"2024-04-19T03:36:00.866975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:59:22.544717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873236+0000","last_change":"2024-04-19T03:35:54.405842+0000","last_active":"2024-04-19T03:35:59.873236+0000","last_peered":"2024-04-19T03:35:59.873236+0000","last_clean":"2024-04-19T03:35:59.873236+0000","last_became_active":"2024-04-19T03:35:54.405465+0000","last_became_peered":"2024-04-19T03:35:54.405465+0000","last_unstale":"2024-04-19T03:35:59.873236+0000","last_undegraded":"2024-04-19T03:35:59.873236+0000","last_fullsized":"2024-04-19T03:35:59.873236+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:03.279704+0000","last_change":"2024-04-19T03:35:59.429504+0000","last_active":"2024-04-19T03:36:03.279704+0000","last_peered":"2024-04-19T03:36:03.279704+0000","last_clean":"2024-04-19T03:36:03.279704+0000","last_became_active":"2024-04-19T03:35:59.428445+0000","last_became_peered":"2024-04-19T03:35:59.428445+0000","last_unstale":"2024-04-19T03:36:03.279704+0000","last_undegraded":"2024-04-19T03:36:03.279704+0000","last_fullsized":"2024-04-19T03:36:03.279704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:36.587021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867969+0000","last_change":"2024-04-19T03:35:59.881612+0000","last_active":"2024-04-19T03:36:00.867969+0000","last_peered":"2024-04-19T03:36:00.867969+0000","last_clean":"2024-04-19T03:36:00.867969+0000","last_became_active":"2024-04-19T03:35:59.880798+0000","last_became_peered":"2024-04-19T03:35:59.880798+0000","last_unstale":"2024-04-19T03:36:00.867969+0000","last_undegraded":"2024-04-19T03:36:00.867969+0000","last_fullsized":"2024-04-19T03:36:00.867969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.863575+0000","last_change":"2024-04-19T03:35:54.404971+0000","last_active":"2024-04-19T03:35:59.863575+0000","last_peered":"2024-04-19T03:35:59.863575+0000","last_clean":"2024-04-19T03:35:59.863575+0000","last_became_active":"2024-04-19T03:35:54.404670+0000","last_became_peered":"2024-04-19T03:35:54.404670+0000","last_unstale":"2024-04-19T03:35:59.863575+0000","last_undegraded":"2024-04-19T03:35:59.863575+0000","last_fullsized":"2024-04-19T03:35:59.863575+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:47.049313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867265+0000","last_change":"2024-04-19T03:35:55.405560+0000","last_active":"2024-04-19T03:35:59.867265+0000","last_peered":"2024-04-19T03:35:59.867265+0000","last_clean":"2024-04-19T03:35:59.867265+0000","last_became_active":"2024-04-19T03:35:55.405342+0000","last_became_peered":"2024-04-19T03:35:55.405342+0000","last_unstale":"2024-04-19T03:35:59.867265+0000","last_undegraded":"2024-04-19T03:35:59.867265+0000","last_fullsized":"2024-04-19T03:35:59.867265+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:27.418444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867074+0000","last_change":"2024-04-19T03:35:59.430221+0000","last_active":"2024-04-19T03:36:00.867074+0000","last_peered":"2024-04-19T03:36:00.867074+0000","last_clean":"2024-04-19T03:36:00.867074+0000","last_became_active":"2024-04-19T03:35:59.429479+0000","last_became_peered":"2024-04-19T03:35:59.429479+0000","last_unstale":"2024-04-19T03:36:00.867074+0000","last_undegraded":"2024-04-19T03:36:00.867074+0000","last_fullsized":"2024-04-19T03:36:00.867074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868989+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:36:00.868989+0000","last_peered":"2024-04-19T03:36:00.868989+0000","last_clean":"2024-04-19T03:36:00.868989+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:36:00.868989+0000","last_undegraded":"2024-04-19T03:36:00.868989+0000","last_fullsized":"2024-04-19T03:36:00.868989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867797+0000","last_change":"2024-04-19T03:35:54.408755+0000","last_active":"2024-04-19T03:35:59.867797+0000","last_peered":"2024-04-19T03:35:59.867797+0000","last_clean":"2024-04-19T03:35:59.867797+0000","last_became_active":"2024-04-19T03:35:54.408501+0000","last_became_peered":"2024-04-19T03:35:54.408501+0000","last_unstale":"2024-04-19T03:35:59.867797+0000","last_undegraded":"2024-04-19T03:35:59.867797+0000","last_fullsized":"2024-04-19T03:35:59.867797+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867712+0000","last_change":"2024-04-19T03:35:59.432736+0000","last_active":"2024-04-19T03:36:00.867712+0000","last_peered":"2024-04-19T03:36:00.867712+0000","last_clean":"2024-04-19T03:36:00.867712+0000","last_became_active":"2024-04-19T03:35:59.432160+0000","last_became_peered":"2024-04-19T03:35:59.432160+0000","last_unstale":"2024-04-19T03:36:00.867712+0000","last_undegraded":"2024-04-19T03:36:00.867712+0000","last_fullsized":"2024-04-19T03:36:00.867712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868107+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:36:00.868107+0000","last_peered":"2024-04-19T03:36:00.868107+0000","last_clean":"2024-04-19T03:36:00.868107+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:36:00.868107+0000","last_undegraded":"2024-04-19T03:36:00.868107+0000","last_fullsized":"2024-04-19T03:36:00.868107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867075+0000","last_change":"2024-04-19T03:35:54.405961+0000","last_active":"2024-04-19T03:35:59.867075+0000","last_peered":"2024-04-19T03:35:59.867075+0000","last_clean":"2024-04-19T03:35:59.867075+0000","last_became_active":"2024-04-19T03:35:54.405640+0000","last_became_peered":"2024-04-19T03:35:54.405640+0000","last_unstale":"2024-04-19T03:35:59.867075+0000","last_undegraded":"2024-04-19T03:35:59.867075+0000","last_fullsized":"2024-04-19T03:35:59.867075+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867408+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:36:00.867408+0000","last_peered":"2024-04-19T03:36:00.867408+0000","last_clean":"2024-04-19T03:36:00.867408+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:36:00.867408+0000","last_undegraded":"2024-04-19T03:36:00.867408+0000","last_fullsized":"2024-04-19T03:36:00.867408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868467+0000","last_change":"2024-04-19T03:35:59.885491+0000","last_active":"2024-04-19T03:36:00.868467+0000","last_peered":"2024-04-19T03:36:00.868467+0000","last_clean":"2024-04-19T03:36:00.868467+0000","last_became_active":"2024-04-19T03:35:59.885190+0000","last_became_peered":"2024-04-19T03:35:59.885190+0000","last_unstale":"2024-04-19T03:36:00.868467+0000","last_undegraded":"2024-04-19T03:36:00.868467+0000","last_fullsized":"2024-04-19T03:36:00.868467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.872489+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:35:59.872489+0000","last_peered":"2024-04-19T03:35:59.872489+0000","last_clean":"2024-04-19T03:35:59.872489+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:35:59.872489+0000","last_undegraded":"2024-04-19T03:35:59.872489+0000","last_fullsized":"2024-04-19T03:35:59.872489+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868035+0000","last_change":"2024-04-19T03:35:59.431391+0000","last_active":"2024-04-19T03:36:00.868035+0000","last_peered":"2024-04-19T03:36:00.868035+0000","last_clean":"2024-04-19T03:36:00.868035+0000","last_became_active":"2024-04-19T03:35:59.431063+0000","last_became_peered":"2024-04-19T03:35:59.431063+0000","last_unstale":"2024-04-19T03:36:00.868035+0000","last_undegraded":"2024-04-19T03:36:00.868035+0000","last_fullsized":"2024-04-19T03:36:00.868035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867786+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:36:00.867786+0000","last_peered":"2024-04-19T03:36:00.867786+0000","last_clean":"2024-04-19T03:36:00.867786+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:36:00.867786+0000","last_undegraded":"2024-04-19T03:36:00.867786+0000","last_fullsized":"2024-04-19T03:36:00.867786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873656+0000","last_change":"2024-04-19T03:35:54.405542+0000","last_active":"2024-04-19T03:35:59.873656+0000","last_peered":"2024-04-19T03:35:59.873656+0000","last_clean":"2024-04-19T03:35:59.873656+0000","last_became_active":"2024-04-19T03:35:54.405292+0000","last_became_peered":"2024-04-19T03:35:54.405292+0000","last_unstale":"2024-04-19T03:35:59.873656+0000","last_undegraded":"2024-04-19T03:35:59.873656+0000","last_fullsized":"2024-04-19T03:35:59.873656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867907+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:36:00.867907+0000","last_peered":"2024-04-19T03:36:00.867907+0000","last_clean":"2024-04-19T03:36:00.867907+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:36:00.867907+0000","last_undegraded":"2024-04-19T03:36:00.867907+0000","last_fullsized":"2024-04-19T03:36:00.867907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868284+0000","last_change":"2024-04-19T03:35:59.879474+0000","last_active":"2024-04-19T03:36:00.868284+0000","last_peered":"2024-04-19T03:36:00.868284+0000","last_clean":"2024-04-19T03:36:00.868284+0000","last_became_active":"2024-04-19T03:35:59.878964+0000","last_became_peered":"2024-04-19T03:35:59.878964+0000","last_unstale":"2024-04-19T03:36:00.868284+0000","last_undegraded":"2024-04-19T03:36:00.868284+0000","last_fullsized":"2024-04-19T03:36:00.868284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.868556+0000","last_change":"2024-04-19T03:35:54.405958+0000","last_active":"2024-04-19T03:35:59.868556+0000","last_peered":"2024-04-19T03:35:59.868556+0000","last_clean":"2024-04-19T03:35:59.868556+0000","last_became_active":"2024-04-19T03:35:54.405578+0000","last_became_peered":"2024-04-19T03:35:54.405578+0000","last_unstale":"2024-04-19T03:35:59.868556+0000","last_undegraded":"2024-04-19T03:35:59.868556+0000","last_fullsized":"2024-04-19T03:35:59.868556+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:11.280110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868342+0000","last_change":"2024-04-19T03:35:59.433970+0000","last_active":"2024-04-19T03:36:00.868342+0000","last_peered":"2024-04-19T03:36:00.868342+0000","last_clean":"2024-04-19T03:36:00.868342+0000","last_became_active":"2024-04-19T03:35:59.433556+0000","last_became_peered":"2024-04-19T03:35:59.433556+0000","last_unstale":"2024-04-19T03:36:00.868342+0000","last_undegraded":"2024-04-19T03:36:00.868342+0000","last_fullsized":"2024-04-19T03:36:00.868342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:44.022207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868191+0000","last_change":"2024-04-19T03:35:59.879956+0000","last_active":"2024-04-19T03:36:00.868191+0000","last_peered":"2024-04-19T03:36:00.868191+0000","last_clean":"2024-04-19T03:36:00.868191+0000","last_became_active":"2024-04-19T03:35:59.879330+0000","last_became_peered":"2024-04-19T03:35:59.879330+0000","last_unstale":"2024-04-19T03:36:00.868191+0000","last_undegraded":"2024-04-19T03:36:00.868191+0000","last_fullsized":"2024-04-19T03:36:00.868191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867999+0000","last_change":"2024-04-19T03:35:59.432750+0000","last_active":"2024-04-19T03:36:00.867999+0000","last_peered":"2024-04-19T03:36:00.867999+0000","last_clean":"2024-04-19T03:36:00.867999+0000","last_became_active":"2024-04-19T03:35:59.432172+0000","last_became_peered":"2024-04-19T03:35:59.432172+0000","last_unstale":"2024-04-19T03:36:00.867999+0000","last_undegraded":"2024-04-19T03:36:00.867999+0000","last_fullsized":"2024-04-19T03:36:00.867999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868608+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:36:00.868608+0000","last_peered":"2024-04-19T03:36:00.868608+0000","last_clean":"2024-04-19T03:36:00.868608+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:36:00.868608+0000","last_undegraded":"2024-04-19T03:36:00.868608+0000","last_fullsized":"2024-04-19T03:36:00.868608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868241+0000","last_change":"2024-04-19T03:35:59.434114+0000","last_active":"2024-04-19T03:36:00.868241+0000","last_peered":"2024-04-19T03:36:00.868241+0000","last_clean":"2024-04-19T03:36:00.868241+0000","last_became_active":"2024-04-19T03:35:59.433765+0000","last_became_peered":"2024-04-19T03:35:59.433765+0000","last_unstale":"2024-04-19T03:36:00.868241+0000","last_undegraded":"2024-04-19T03:36:00.868241+0000","last_fullsized":"2024-04-19T03:36:00.868241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867893+0000","last_change":"2024-04-19T03:35:59.876608+0000","last_active":"2024-04-19T03:36:00.867893+0000","last_peered":"2024-04-19T03:36:00.867893+0000","last_clean":"2024-04-19T03:36:00.867893+0000","last_became_active":"2024-04-19T03:35:59.875297+0000","last_became_peered":"2024-04-19T03:35:59.875297+0000","last_unstale":"2024-04-19T03:36:00.867893+0000","last_undegraded":"2024-04-19T03:36:00.867893+0000","last_fullsized":"2024-04-19T03:36:00.867893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868926+0000","last_change":"2024-04-19T03:35:59.432321+0000","last_active":"2024-04-19T03:36:00.868926+0000","last_peered":"2024-04-19T03:36:00.868926+0000","last_clean":"2024-04-19T03:36:00.868926+0000","last_became_active":"2024-04-19T03:35:59.431638+0000","last_became_peered":"2024-04-19T03:35:59.431638+0000","last_unstale":"2024-04-19T03:36:00.868926+0000","last_undegraded":"2024-04-19T03:36:00.868926+0000","last_fullsized":"2024-04-19T03:36:00.868926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867670+0000","last_change":"2024-04-19T03:35:59.877336+0000","last_active":"2024-04-19T03:36:00.867670+0000","last_peered":"2024-04-19T03:36:00.867670+0000","last_clean":"2024-04-19T03:36:00.867670+0000","last_became_active":"2024-04-19T03:35:59.876461+0000","last_became_peered":"2024-04-19T03:35:59.876461+0000","last_unstale":"2024-04-19T03:36:00.867670+0000","last_undegraded":"2024-04-19T03:36:00.867670+0000","last_fullsized":"2024-04-19T03:36:00.867670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868151+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:36:00.868151+0000","last_peered":"2024-04-19T03:36:00.868151+0000","last_clean":"2024-04-19T03:36:00.868151+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:36:00.868151+0000","last_undegraded":"2024-04-19T03:36:00.868151+0000","last_fullsized":"2024-04-19T03:36:00.868151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868264+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:36:00.868264+0000","last_peered":"2024-04-19T03:36:00.868264+0000","last_clean":"2024-04-19T03:36:00.868264+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:36:00.868264+0000","last_undegraded":"2024-04-19T03:36:00.868264+0000","last_fullsized":"2024-04-19T03:36:00.868264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868040+0000","last_change":"2024-04-19T03:35:59.429171+0000","last_active":"2024-04-19T03:36:00.868040+0000","last_peered":"2024-04-19T03:36:00.868040+0000","last_clean":"2024-04-19T03:36:00.868040+0000","last_became_active":"2024-04-19T03:35:59.428837+0000","last_became_peered":"2024-04-19T03:35:59.428837+0000","last_unstale":"2024-04-19T03:36:00.868040+0000","last_undegraded":"2024-04-19T03:36:00.868040+0000","last_fullsized":"2024-04-19T03:36:00.868040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867627+0000","last_change":"2024-04-19T03:35:59.880260+0000","last_active":"2024-04-19T03:36:00.867627+0000","last_peered":"2024-04-19T03:36:00.867627+0000","last_clean":"2024-04-19T03:36:00.867627+0000","last_became_active":"2024-04-19T03:35:59.879086+0000","last_became_peered":"2024-04-19T03:35:59.879086+0000","last_unstale":"2024-04-19T03:36:00.867627+0000","last_undegraded":"2024-04-19T03:36:00.867627+0000","last_fullsized":"2024-04-19T03:36:00.867627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867442+0000","last_change":"2024-04-19T03:35:59.880550+0000","last_active":"2024-04-19T03:36:00.867442+0000","last_peered":"2024-04-19T03:36:00.867442+0000","last_clean":"2024-04-19T03:36:00.867442+0000","last_became_active":"2024-04-19T03:35:59.879772+0000","last_became_peered":"2024-04-19T03:35:59.879772+0000","last_unstale":"2024-04-19T03:36:00.867442+0000","last_undegraded":"2024-04-19T03:36:00.867442+0000","last_fullsized":"2024-04-19T03:36:00.867442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867115+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:36:00.867115+0000","last_peered":"2024-04-19T03:36:00.867115+0000","last_clean":"2024-04-19T03:36:00.867115+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:36:00.867115+0000","last_undegraded":"2024-04-19T03:36:00.867115+0000","last_fullsized":"2024-04-19T03:36:00.867115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868363+0000","last_change":"2024-04-19T03:35:59.881028+0000","last_active":"2024-04-19T03:36:00.868363+0000","last_peered":"2024-04-19T03:36:00.868363+0000","last_clean":"2024-04-19T03:36:00.868363+0000","last_became_active":"2024-04-19T03:35:59.880088+0000","last_became_peered":"2024-04-19T03:35:59.880088+0000","last_unstale":"2024-04-19T03:36:00.868363+0000","last_undegraded":"2024-04-19T03:36:00.868363+0000","last_fullsized":"2024-04-19T03:36:00.868363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:52.418012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867632+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:36:00.867632+0000","last_peered":"2024-04-19T03:36:00.867632+0000","last_clean":"2024-04-19T03:36:00.867632+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:36:00.867632+0000","last_undegraded":"2024-04-19T03:36:00.867632+0000","last_fullsized":"2024-04-19T03:36:00.867632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868762+0000","last_change":"2024-04-19T03:35:59.882281+0000","last_active":"2024-04-19T03:36:00.868762+0000","last_peered":"2024-04-19T03:36:00.868762+0000","last_clean":"2024-04-19T03:36:00.868762+0000","last_became_active":"2024-04-19T03:35:59.880757+0000","last_became_peered":"2024-04-19T03:35:59.880757+0000","last_unstale":"2024-04-19T03:36:00.868762+0000","last_undegraded":"2024-04-19T03:36:00.868762+0000","last_fullsized":"2024-04-19T03:36:00.868762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:36:08.782 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T03:36:08.782 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-19T03:36:08.783 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-19T03:36:08.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-19T03:36:09.233 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:09.233 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-19T03:36:09.249 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-19T03:36:09.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:36:09.616 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:09.617 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:36:00.861407+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:36:09.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:35:52.932739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:35:54.326287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:35:58.002172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:35:58.844614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:36:09.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:36:09.996 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2024-04-19T03:36:10.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:36:10.373 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-19T03:36:10.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T03:36:10.759 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-19T03:36:10.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T03:36:11.140 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-19T03:36:11.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:36:11.565 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:11.566 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:35:59.859870+0000","modified":"2024-04-19T03:36:02.866201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6803/2772249024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2772249024},{"type":"v1","addr":"172.21.15.5:6803","nonce":2772249024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:36:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-19T03:36:11.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:36:11.945 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:11.945 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:36:00.861407+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:36:11.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:35:52.932739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:35:54.326287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:35:58.002172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:35:58.844614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:36:11.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:36:12.325 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2024-04-19T03:36:12.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:36:12.708 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-19T03:36:12.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T03:36:13.089 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-19T03:36:13.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T03:36:13.469 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-19T03:36:13.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:36:13.894 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:13.894 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:35:59.859870+0000","modified":"2024-04-19T03:36:02.866201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6803/2772249024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2772249024},{"type":"v1","addr":"172.21.15.5:6803","nonce":2772249024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:36:13.897 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-19T03:36:13.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:36:14.277 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:14.278 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:36:00.861407+0000","last_up_change":"2024-04-19T03:35:52.387428+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:36:14.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:36:14.706 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:14.706 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:35:59.859870+0000","modified":"2024-04-19T03:36:02.866201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6803/2772249024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2772249024},{"type":"v1","addr":"172.21.15.5:6803","nonce":2772249024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:36:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-19T03:36:14.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-19T03:35:59.859870+0000', 'modified': '2024-04-19T03:36:02.866201+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4186': {'gid': 4186, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6803/2772249024', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6802', 'nonce': 2772249024}, {'type': 'v1', 'addr': '172.21.15.5:6803', 'nonce': 2772249024}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-19T03:36:14.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-19T03:36:14.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-19T03:36:14.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-19T03:36:14.982+0000 7f19c37fe700 0 client.4466 ms_handle_reset on v2:172.21.15.5:6802/2772249024 2024-04-19T03:36:15.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-19T03:36:15.005+0000 7f19c37fe700 0 client.4459 ms_handle_reset on v2:172.21.15.5:6802/2772249024 2024-04-19T03:36:15.006 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-19T03:36:15.006 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "094bb330-e26a-42d1-b1be-7931c5493f05", 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4186, 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 15.144508974000001, 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 6, 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 16, 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 16, 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 20.488014239000002 2024-04-19T03:36:15.007 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-19T03:36:15.021 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-19T03:36:15.031 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-19T03:36:15.031 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T03:36:15.031 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-19T03:36:15.031 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-19T03:36:15.032 DEBUG:teuthology.orchestra.run.smithi005:> sync 2024-04-19T03:36:15.160 DEBUG:teuthology.orchestra.run.smithi057:> sync 2024-04-19T03:36:15.293 DEBUG:teuthology.orchestra.run.smithi087:> sync 2024-04-19T03:36:15.364 DEBUG:teuthology.orchestra.run.smithi129:> sync 2024-04-19T03:36:15.425 DEBUG:tasks.thrashosds:checking console status of smithi005 2024-04-19T03:36:15.425 DEBUG:teuthology.orchestra.console.smithi005:Waiting for login prompt 2024-04-19T03:36:15.426 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi005 2024-04-19T03:36:15.597 DEBUG:teuthology.orchestra.console.smithi005:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T03:36:15.597 DEBUG:teuthology.orchestra.console.smithi005:expect after: smithi005 login: 2024-04-19T03:36:15.651 DEBUG:teuthology.orchestra.console.smithi005:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi005 login: [disconnect] 2024-04-19T03:36:15.752 DEBUG:tasks.thrashosds:checking console status of smithi057 2024-04-19T03:36:15.752 DEBUG:teuthology.orchestra.console.smithi057:Waiting for login prompt 2024-04-19T03:36:15.752 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi057 2024-04-19T03:36:15.931 DEBUG:teuthology.orchestra.console.smithi057:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T03:36:15.931 DEBUG:teuthology.orchestra.console.smithi057:expect after: smithi057 login: 2024-04-19T03:36:15.985 DEBUG:teuthology.orchestra.console.smithi057:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi057 login: [disconnect] 2024-04-19T03:36:16.086 DEBUG:tasks.thrashosds:checking console status of smithi087 2024-04-19T03:36:16.086 DEBUG:teuthology.orchestra.console.smithi087:Waiting for login prompt 2024-04-19T03:36:16.086 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi087 2024-04-19T03:36:16.197 DEBUG:teuthology.orchestra.console.smithi087:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T03:36:16.198 DEBUG:teuthology.orchestra.console.smithi087:expect after: smithi087 login: 2024-04-19T03:36:16.250 DEBUG:teuthology.orchestra.console.smithi087:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi087 login: [disconnect] 2024-04-19T03:36:16.352 DEBUG:tasks.thrashosds:checking console status of smithi129 2024-04-19T03:36:16.352 DEBUG:teuthology.orchestra.console.smithi129:Waiting for login prompt 2024-04-19T03:36:16.352 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi129 2024-04-19T03:36:16.519 DEBUG:teuthology.orchestra.console.smithi129:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T03:36:16.519 DEBUG:teuthology.orchestra.console.smithi129:expect after: smithi129 login: 2024-04-19T03:36:16.571 DEBUG:teuthology.orchestra.console.smithi129:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi129 login: [disconnect] 2024-04-19T03:36:16.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-19T03:36:17.066 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-19T03:36:17.066 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T03:36:17.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:36:17.437 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:17.439 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:36:17.449 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-19T03:36:16.271918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002855"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869083+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:36:00.869083+0000","last_peered":"2024-04-19T03:36:00.869083+0000","last_clean":"2024-04-19T03:36:00.869083+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:36:00.869083+0000","last_undegraded":"2024-04-19T03:36:00.869083+0000","last_fullsized":"2024-04-19T03:36:00.869083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868676+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:36:00.868676+0000","last_peered":"2024-04-19T03:36:00.868676+0000","last_clean":"2024-04-19T03:36:00.868676+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:36:00.868676+0000","last_undegraded":"2024-04-19T03:36:00.868676+0000","last_fullsized":"2024-04-19T03:36:00.868676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868331+0000","last_change":"2024-04-19T03:35:59.886429+0000","last_active":"2024-04-19T03:36:00.868331+0000","last_peered":"2024-04-19T03:36:00.868331+0000","last_clean":"2024-04-19T03:36:00.868331+0000","last_became_active":"2024-04-19T03:35:59.886189+0000","last_became_peered":"2024-04-19T03:35:59.886189+0000","last_unstale":"2024-04-19T03:36:00.868331+0000","last_undegraded":"2024-04-19T03:36:00.868331+0000","last_fullsized":"2024-04-19T03:36:00.868331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867838+0000","last_change":"2024-04-19T03:35:59.878844+0000","last_active":"2024-04-19T03:36:00.867838+0000","last_peered":"2024-04-19T03:36:00.867838+0000","last_clean":"2024-04-19T03:36:00.867838+0000","last_became_active":"2024-04-19T03:35:59.878100+0000","last_became_peered":"2024-04-19T03:35:59.878100+0000","last_unstale":"2024-04-19T03:36:00.867838+0000","last_undegraded":"2024-04-19T03:36:00.867838+0000","last_fullsized":"2024-04-19T03:36:00.867838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868178+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:36:00.868178+0000","last_peered":"2024-04-19T03:36:00.868178+0000","last_clean":"2024-04-19T03:36:00.868178+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:36:00.868178+0000","last_undegraded":"2024-04-19T03:36:00.868178+0000","last_fullsized":"2024-04-19T03:36:00.868178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867527+0000","last_change":"2024-04-19T03:35:59.876553+0000","last_active":"2024-04-19T03:36:00.867527+0000","last_peered":"2024-04-19T03:36:00.867527+0000","last_clean":"2024-04-19T03:36:00.867527+0000","last_became_active":"2024-04-19T03:35:59.875201+0000","last_became_peered":"2024-04-19T03:35:59.875201+0000","last_unstale":"2024-04-19T03:36:00.867527+0000","last_undegraded":"2024-04-19T03:36:00.867527+0000","last_fullsized":"2024-04-19T03:36:00.867527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867483+0000","last_change":"2024-04-19T03:35:59.876305+0000","last_active":"2024-04-19T03:36:00.867483+0000","last_peered":"2024-04-19T03:36:00.867483+0000","last_clean":"2024-04-19T03:36:00.867483+0000","last_became_active":"2024-04-19T03:35:59.875093+0000","last_became_peered":"2024-04-19T03:35:59.875093+0000","last_unstale":"2024-04-19T03:36:00.867483+0000","last_undegraded":"2024-04-19T03:36:00.867483+0000","last_fullsized":"2024-04-19T03:36:00.867483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867184+0000","last_change":"2024-04-19T03:35:59.880058+0000","last_active":"2024-04-19T03:36:00.867184+0000","last_peered":"2024-04-19T03:36:00.867184+0000","last_clean":"2024-04-19T03:36:00.867184+0000","last_became_active":"2024-04-19T03:35:59.878691+0000","last_became_peered":"2024-04-19T03:35:59.878691+0000","last_unstale":"2024-04-19T03:36:00.867184+0000","last_undegraded":"2024-04-19T03:36:00.867184+0000","last_fullsized":"2024-04-19T03:36:00.867184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868945+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:36:00.868945+0000","last_peered":"2024-04-19T03:36:00.868945+0000","last_clean":"2024-04-19T03:36:00.868945+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:36:00.868945+0000","last_undegraded":"2024-04-19T03:36:00.868945+0000","last_fullsized":"2024-04-19T03:36:00.868945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868069+0000","last_change":"2024-04-19T03:35:59.878070+0000","last_active":"2024-04-19T03:36:00.868069+0000","last_peered":"2024-04-19T03:36:00.868069+0000","last_clean":"2024-04-19T03:36:00.868069+0000","last_became_active":"2024-04-19T03:35:59.876291+0000","last_became_peered":"2024-04-19T03:35:59.876291+0000","last_unstale":"2024-04-19T03:36:00.868069+0000","last_undegraded":"2024-04-19T03:36:00.868069+0000","last_fullsized":"2024-04-19T03:36:00.868069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868341+0000","last_change":"2024-04-19T03:35:59.883585+0000","last_active":"2024-04-19T03:36:00.868341+0000","last_peered":"2024-04-19T03:36:00.868341+0000","last_clean":"2024-04-19T03:36:00.868341+0000","last_became_active":"2024-04-19T03:35:59.883232+0000","last_became_peered":"2024-04-19T03:35:59.883232+0000","last_unstale":"2024-04-19T03:36:00.868341+0000","last_undegraded":"2024-04-19T03:36:00.868341+0000","last_fullsized":"2024-04-19T03:36:00.868341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867977+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:36:00.867977+0000","last_peered":"2024-04-19T03:36:00.867977+0000","last_clean":"2024-04-19T03:36:00.867977+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:36:00.867977+0000","last_undegraded":"2024-04-19T03:36:00.867977+0000","last_fullsized":"2024-04-19T03:36:00.867977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867945+0000","last_change":"2024-04-19T03:35:59.882444+0000","last_active":"2024-04-19T03:36:00.867945+0000","last_peered":"2024-04-19T03:36:00.867945+0000","last_clean":"2024-04-19T03:36:00.867945+0000","last_became_active":"2024-04-19T03:35:59.882075+0000","last_became_peered":"2024-04-19T03:35:59.882075+0000","last_unstale":"2024-04-19T03:36:00.867945+0000","last_undegraded":"2024-04-19T03:36:00.867945+0000","last_fullsized":"2024-04-19T03:36:00.867945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867610+0000","last_change":"2024-04-19T03:35:59.882604+0000","last_active":"2024-04-19T03:36:00.867610+0000","last_peered":"2024-04-19T03:36:00.867610+0000","last_clean":"2024-04-19T03:36:00.867610+0000","last_became_active":"2024-04-19T03:35:59.882330+0000","last_became_peered":"2024-04-19T03:35:59.882330+0000","last_unstale":"2024-04-19T03:36:00.867610+0000","last_undegraded":"2024-04-19T03:36:00.867610+0000","last_fullsized":"2024-04-19T03:36:00.867610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867199+0000","last_change":"2024-04-19T03:35:59.880349+0000","last_active":"2024-04-19T03:36:00.867199+0000","last_peered":"2024-04-19T03:36:00.867199+0000","last_clean":"2024-04-19T03:36:00.867199+0000","last_became_active":"2024-04-19T03:35:59.879119+0000","last_became_peered":"2024-04-19T03:35:59.879119+0000","last_unstale":"2024-04-19T03:36:00.867199+0000","last_undegraded":"2024-04-19T03:36:00.867199+0000","last_fullsized":"2024-04-19T03:36:00.867199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867891+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:36:00.867891+0000","last_peered":"2024-04-19T03:36:00.867891+0000","last_clean":"2024-04-19T03:36:00.867891+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:36:00.867891+0000","last_undegraded":"2024-04-19T03:36:00.867891+0000","last_fullsized":"2024-04-19T03:36:00.867891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868856+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868856+0000","last_peered":"2024-04-19T03:36:00.868856+0000","last_clean":"2024-04-19T03:36:00.868856+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:36:00.868856+0000","last_undegraded":"2024-04-19T03:36:00.868856+0000","last_fullsized":"2024-04-19T03:36:00.868856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867771+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:36:00.867771+0000","last_peered":"2024-04-19T03:36:00.867771+0000","last_clean":"2024-04-19T03:36:00.867771+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:36:00.867771+0000","last_undegraded":"2024-04-19T03:36:00.867771+0000","last_fullsized":"2024-04-19T03:36:00.867771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867992+0000","last_change":"2024-04-19T03:35:59.879234+0000","last_active":"2024-04-19T03:36:00.867992+0000","last_peered":"2024-04-19T03:36:00.867992+0000","last_clean":"2024-04-19T03:36:00.867992+0000","last_became_active":"2024-04-19T03:35:59.878820+0000","last_became_peered":"2024-04-19T03:35:59.878820+0000","last_unstale":"2024-04-19T03:36:00.867992+0000","last_undegraded":"2024-04-19T03:36:00.867992+0000","last_fullsized":"2024-04-19T03:36:00.867992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.877313+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.875350+0000","last_became_peered":"2024-04-19T03:35:59.875350+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868267+0000","last_change":"2024-04-19T03:35:59.881019+0000","last_active":"2024-04-19T03:36:00.868267+0000","last_peered":"2024-04-19T03:36:00.868267+0000","last_clean":"2024-04-19T03:36:00.868267+0000","last_became_active":"2024-04-19T03:35:59.880363+0000","last_became_peered":"2024-04-19T03:35:59.880363+0000","last_unstale":"2024-04-19T03:36:00.868267+0000","last_undegraded":"2024-04-19T03:36:00.868267+0000","last_fullsized":"2024-04-19T03:36:00.868267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867430+0000","last_change":"2024-04-19T03:35:59.872083+0000","last_active":"2024-04-19T03:36:00.867430+0000","last_peered":"2024-04-19T03:36:00.867430+0000","last_clean":"2024-04-19T03:36:00.867430+0000","last_became_active":"2024-04-19T03:35:59.871872+0000","last_became_peered":"2024-04-19T03:35:59.871872+0000","last_unstale":"2024-04-19T03:36:00.867430+0000","last_undegraded":"2024-04-19T03:36:00.867430+0000","last_fullsized":"2024-04-19T03:36:00.867430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868080+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:36:00.868080+0000","last_peered":"2024-04-19T03:36:00.868080+0000","last_clean":"2024-04-19T03:36:00.868080+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:36:00.868080+0000","last_undegraded":"2024-04-19T03:36:00.868080+0000","last_fullsized":"2024-04-19T03:36:00.868080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869076+0000","last_change":"2024-04-19T03:35:59.882017+0000","last_active":"2024-04-19T03:36:00.869076+0000","last_peered":"2024-04-19T03:36:00.869076+0000","last_clean":"2024-04-19T03:36:00.869076+0000","last_became_active":"2024-04-19T03:35:59.881048+0000","last_became_peered":"2024-04-19T03:35:59.881048+0000","last_unstale":"2024-04-19T03:36:00.869076+0000","last_undegraded":"2024-04-19T03:36:00.869076+0000","last_fullsized":"2024-04-19T03:36:00.869076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868233+0000","last_change":"2024-04-19T03:35:59.873199+0000","last_active":"2024-04-19T03:36:00.868233+0000","last_peered":"2024-04-19T03:36:00.868233+0000","last_clean":"2024-04-19T03:36:00.868233+0000","last_became_active":"2024-04-19T03:35:59.872661+0000","last_became_peered":"2024-04-19T03:35:59.872661+0000","last_unstale":"2024-04-19T03:36:00.868233+0000","last_undegraded":"2024-04-19T03:36:00.868233+0000","last_fullsized":"2024-04-19T03:36:00.868233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868190+0000","last_change":"2024-04-19T03:35:59.882737+0000","last_active":"2024-04-19T03:36:00.868190+0000","last_peered":"2024-04-19T03:36:00.868190+0000","last_clean":"2024-04-19T03:36:00.868190+0000","last_became_active":"2024-04-19T03:35:59.882537+0000","last_became_peered":"2024-04-19T03:35:59.882537+0000","last_unstale":"2024-04-19T03:36:00.868190+0000","last_undegraded":"2024-04-19T03:36:00.868190+0000","last_fullsized":"2024-04-19T03:36:00.868190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867954+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:36:00.867954+0000","last_peered":"2024-04-19T03:36:00.867954+0000","last_clean":"2024-04-19T03:36:00.867954+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:36:00.867954+0000","last_undegraded":"2024-04-19T03:36:00.867954+0000","last_fullsized":"2024-04-19T03:36:00.867954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868942+0000","last_change":"2024-04-19T03:35:59.882176+0000","last_active":"2024-04-19T03:36:00.868942+0000","last_peered":"2024-04-19T03:36:00.868942+0000","last_clean":"2024-04-19T03:36:00.868942+0000","last_became_active":"2024-04-19T03:35:59.881216+0000","last_became_peered":"2024-04-19T03:35:59.881216+0000","last_unstale":"2024-04-19T03:36:00.868942+0000","last_undegraded":"2024-04-19T03:36:00.868942+0000","last_fullsized":"2024-04-19T03:36:00.868942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867298+0000","last_change":"2024-04-19T03:35:59.429598+0000","last_active":"2024-04-19T03:36:00.867298+0000","last_peered":"2024-04-19T03:36:00.867298+0000","last_clean":"2024-04-19T03:36:00.867298+0000","last_became_active":"2024-04-19T03:35:59.429239+0000","last_became_peered":"2024-04-19T03:35:59.429239+0000","last_unstale":"2024-04-19T03:36:00.867298+0000","last_undegraded":"2024-04-19T03:36:00.867298+0000","last_fullsized":"2024-04-19T03:36:00.867298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868065+0000","last_change":"2024-04-19T03:35:59.872790+0000","last_active":"2024-04-19T03:36:00.868065+0000","last_peered":"2024-04-19T03:36:00.868065+0000","last_clean":"2024-04-19T03:36:00.868065+0000","last_became_active":"2024-04-19T03:35:59.872223+0000","last_became_peered":"2024-04-19T03:35:59.872223+0000","last_unstale":"2024-04-19T03:36:00.868065+0000","last_undegraded":"2024-04-19T03:36:00.868065+0000","last_fullsized":"2024-04-19T03:36:00.868065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867213+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:36:00.867213+0000","last_peered":"2024-04-19T03:36:00.867213+0000","last_clean":"2024-04-19T03:36:00.867213+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:36:00.867213+0000","last_undegraded":"2024-04-19T03:36:00.867213+0000","last_fullsized":"2024-04-19T03:36:00.867213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868970+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868970+0000","last_peered":"2024-04-19T03:36:00.868970+0000","last_clean":"2024-04-19T03:36:00.868970+0000","last_became_active":"2024-04-19T03:35:59.881795+0000","last_became_peered":"2024-04-19T03:35:59.881795+0000","last_unstale":"2024-04-19T03:36:00.868970+0000","last_undegraded":"2024-04-19T03:36:00.868970+0000","last_fullsized":"2024-04-19T03:36:00.868970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868091+0000","last_change":"2024-04-19T03:35:59.429529+0000","last_active":"2024-04-19T03:36:00.868091+0000","last_peered":"2024-04-19T03:36:00.868091+0000","last_clean":"2024-04-19T03:36:00.868091+0000","last_became_active":"2024-04-19T03:35:59.429121+0000","last_became_peered":"2024-04-19T03:35:59.429121+0000","last_unstale":"2024-04-19T03:36:00.868091+0000","last_undegraded":"2024-04-19T03:36:00.868091+0000","last_fullsized":"2024-04-19T03:36:00.868091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867146+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:36:00.867146+0000","last_peered":"2024-04-19T03:36:00.867146+0000","last_clean":"2024-04-19T03:36:00.867146+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:36:00.867146+0000","last_undegraded":"2024-04-19T03:36:00.867146+0000","last_fullsized":"2024-04-19T03:36:00.867146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868383+0000","last_change":"2024-04-19T03:35:59.434129+0000","last_active":"2024-04-19T03:36:00.868383+0000","last_peered":"2024-04-19T03:36:00.868383+0000","last_clean":"2024-04-19T03:36:00.868383+0000","last_became_active":"2024-04-19T03:35:59.433761+0000","last_became_peered":"2024-04-19T03:35:59.433761+0000","last_unstale":"2024-04-19T03:36:00.868383+0000","last_undegraded":"2024-04-19T03:36:00.868383+0000","last_fullsized":"2024-04-19T03:36:00.868383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867364+0000","last_change":"2024-04-19T03:35:59.872126+0000","last_active":"2024-04-19T03:36:00.867364+0000","last_peered":"2024-04-19T03:36:00.867364+0000","last_clean":"2024-04-19T03:36:00.867364+0000","last_became_active":"2024-04-19T03:35:59.871818+0000","last_became_peered":"2024-04-19T03:35:59.871818+0000","last_unstale":"2024-04-19T03:36:00.867364+0000","last_undegraded":"2024-04-19T03:36:00.867364+0000","last_fullsized":"2024-04-19T03:36:00.867364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:49:19.611505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868776+0000","last_change":"2024-04-19T03:35:59.431907+0000","last_active":"2024-04-19T03:36:00.868776+0000","last_peered":"2024-04-19T03:36:00.868776+0000","last_clean":"2024-04-19T03:36:00.868776+0000","last_became_active":"2024-04-19T03:35:59.431432+0000","last_became_peered":"2024-04-19T03:35:59.431432+0000","last_unstale":"2024-04-19T03:36:00.868776+0000","last_undegraded":"2024-04-19T03:36:00.868776+0000","last_fullsized":"2024-04-19T03:36:00.868776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867656+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:36:00.867656+0000","last_peered":"2024-04-19T03:36:00.867656+0000","last_clean":"2024-04-19T03:36:00.867656+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:36:00.867656+0000","last_undegraded":"2024-04-19T03:36:00.867656+0000","last_fullsized":"2024-04-19T03:36:00.867656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868141+0000","last_change":"2024-04-19T03:35:59.433961+0000","last_active":"2024-04-19T03:36:00.868141+0000","last_peered":"2024-04-19T03:36:00.868141+0000","last_clean":"2024-04-19T03:36:00.868141+0000","last_became_active":"2024-04-19T03:35:59.433506+0000","last_became_peered":"2024-04-19T03:35:59.433506+0000","last_unstale":"2024-04-19T03:36:00.868141+0000","last_undegraded":"2024-04-19T03:36:00.868141+0000","last_fullsized":"2024-04-19T03:36:00.868141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868192+0000","last_change":"2024-04-19T03:35:59.885493+0000","last_active":"2024-04-19T03:36:00.868192+0000","last_peered":"2024-04-19T03:36:00.868192+0000","last_clean":"2024-04-19T03:36:00.868192+0000","last_became_active":"2024-04-19T03:35:59.885107+0000","last_became_peered":"2024-04-19T03:35:59.885107+0000","last_unstale":"2024-04-19T03:36:00.868192+0000","last_undegraded":"2024-04-19T03:36:00.868192+0000","last_fullsized":"2024-04-19T03:36:00.868192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868108+0000","last_change":"2024-04-19T03:35:59.434133+0000","last_active":"2024-04-19T03:36:00.868108+0000","last_peered":"2024-04-19T03:36:00.868108+0000","last_clean":"2024-04-19T03:36:00.868108+0000","last_became_active":"2024-04-19T03:35:59.433755+0000","last_became_peered":"2024-04-19T03:35:59.433755+0000","last_unstale":"2024-04-19T03:36:00.868108+0000","last_undegraded":"2024-04-19T03:36:00.868108+0000","last_fullsized":"2024-04-19T03:36:00.868108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:17.507444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868452+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:36:00.868452+0000","last_peered":"2024-04-19T03:36:00.868452+0000","last_clean":"2024-04-19T03:36:00.868452+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:36:00.868452+0000","last_undegraded":"2024-04-19T03:36:00.868452+0000","last_fullsized":"2024-04-19T03:36:00.868452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867515+0000","last_change":"2024-04-19T03:35:59.428849+0000","last_active":"2024-04-19T03:36:00.867515+0000","last_peered":"2024-04-19T03:36:00.867515+0000","last_clean":"2024-04-19T03:36:00.867515+0000","last_became_active":"2024-04-19T03:35:59.428478+0000","last_became_peered":"2024-04-19T03:35:59.428478+0000","last_unstale":"2024-04-19T03:36:00.867515+0000","last_undegraded":"2024-04-19T03:36:00.867515+0000","last_fullsized":"2024-04-19T03:36:00.867515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869023+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:36:00.869023+0000","last_peered":"2024-04-19T03:36:00.869023+0000","last_clean":"2024-04-19T03:36:00.869023+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:36:00.869023+0000","last_undegraded":"2024-04-19T03:36:00.869023+0000","last_fullsized":"2024-04-19T03:36:00.869023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867937+0000","last_change":"2024-04-19T03:35:59.431877+0000","last_active":"2024-04-19T03:36:00.867937+0000","last_peered":"2024-04-19T03:36:00.867937+0000","last_clean":"2024-04-19T03:36:00.867937+0000","last_became_active":"2024-04-19T03:35:59.431343+0000","last_became_peered":"2024-04-19T03:35:59.431343+0000","last_unstale":"2024-04-19T03:36:00.867937+0000","last_undegraded":"2024-04-19T03:36:00.867937+0000","last_fullsized":"2024-04-19T03:36:00.867937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868161+0000","last_change":"2024-04-19T03:35:59.873111+0000","last_active":"2024-04-19T03:36:00.868161+0000","last_peered":"2024-04-19T03:36:00.868161+0000","last_clean":"2024-04-19T03:36:00.868161+0000","last_became_active":"2024-04-19T03:35:59.872468+0000","last_became_peered":"2024-04-19T03:35:59.872468+0000","last_unstale":"2024-04-19T03:36:00.868161+0000","last_undegraded":"2024-04-19T03:36:00.868161+0000","last_fullsized":"2024-04-19T03:36:00.868161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:30:15.469254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867684+0000","last_change":"2024-04-19T03:35:59.434023+0000","last_active":"2024-04-19T03:36:00.867684+0000","last_peered":"2024-04-19T03:36:00.867684+0000","last_clean":"2024-04-19T03:36:00.867684+0000","last_became_active":"2024-04-19T03:35:59.433542+0000","last_became_peered":"2024-04-19T03:35:59.433542+0000","last_unstale":"2024-04-19T03:36:00.867684+0000","last_undegraded":"2024-04-19T03:36:00.867684+0000","last_fullsized":"2024-04-19T03:36:00.867684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868203+0000","last_change":"2024-04-19T03:35:59.872558+0000","last_active":"2024-04-19T03:36:00.868203+0000","last_peered":"2024-04-19T03:36:00.868203+0000","last_clean":"2024-04-19T03:36:00.868203+0000","last_became_active":"2024-04-19T03:35:59.872302+0000","last_became_peered":"2024-04-19T03:35:59.872302+0000","last_unstale":"2024-04-19T03:36:00.868203+0000","last_undegraded":"2024-04-19T03:36:00.868203+0000","last_fullsized":"2024-04-19T03:36:00.868203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:14.886758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868499+0000","last_change":"2024-04-19T03:35:59.434430+0000","last_active":"2024-04-19T03:36:00.868499+0000","last_peered":"2024-04-19T03:36:00.868499+0000","last_clean":"2024-04-19T03:36:00.868499+0000","last_became_active":"2024-04-19T03:35:59.433885+0000","last_became_peered":"2024-04-19T03:35:59.433885+0000","last_unstale":"2024-04-19T03:36:00.868499+0000","last_undegraded":"2024-04-19T03:36:00.868499+0000","last_fullsized":"2024-04-19T03:36:00.868499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867570+0000","last_change":"2024-04-19T03:35:59.883449+0000","last_active":"2024-04-19T03:36:00.867570+0000","last_peered":"2024-04-19T03:36:00.867570+0000","last_clean":"2024-04-19T03:36:00.867570+0000","last_became_active":"2024-04-19T03:35:59.882794+0000","last_became_peered":"2024-04-19T03:35:59.882794+0000","last_unstale":"2024-04-19T03:36:00.867570+0000","last_undegraded":"2024-04-19T03:36:00.867570+0000","last_fullsized":"2024-04-19T03:36:00.867570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868576+0000","last_change":"2024-04-19T03:35:59.433568+0000","last_active":"2024-04-19T03:36:00.868576+0000","last_peered":"2024-04-19T03:36:00.868576+0000","last_clean":"2024-04-19T03:36:00.868576+0000","last_became_active":"2024-04-19T03:35:59.433247+0000","last_became_peered":"2024-04-19T03:35:59.433247+0000","last_unstale":"2024-04-19T03:36:00.868576+0000","last_undegraded":"2024-04-19T03:36:00.868576+0000","last_fullsized":"2024-04-19T03:36:00.868576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868220+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:36:00.868220+0000","last_peered":"2024-04-19T03:36:00.868220+0000","last_clean":"2024-04-19T03:36:00.868220+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:36:00.868220+0000","last_undegraded":"2024-04-19T03:36:00.868220+0000","last_fullsized":"2024-04-19T03:36:00.868220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868210+0000","last_change":"2024-04-19T03:35:59.433585+0000","last_active":"2024-04-19T03:36:00.868210+0000","last_peered":"2024-04-19T03:36:00.868210+0000","last_clean":"2024-04-19T03:36:00.868210+0000","last_became_active":"2024-04-19T03:35:59.433273+0000","last_became_peered":"2024-04-19T03:35:59.433273+0000","last_unstale":"2024-04-19T03:36:00.868210+0000","last_undegraded":"2024-04-19T03:36:00.868210+0000","last_fullsized":"2024-04-19T03:36:00.868210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867805+0000","last_change":"2024-04-19T03:35:59.876757+0000","last_active":"2024-04-19T03:36:00.867805+0000","last_peered":"2024-04-19T03:36:00.867805+0000","last_clean":"2024-04-19T03:36:00.867805+0000","last_became_active":"2024-04-19T03:35:59.876227+0000","last_became_peered":"2024-04-19T03:35:59.876227+0000","last_unstale":"2024-04-19T03:36:00.867805+0000","last_undegraded":"2024-04-19T03:36:00.867805+0000","last_fullsized":"2024-04-19T03:36:00.867805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867647+0000","last_change":"2024-04-19T03:35:59.431430+0000","last_active":"2024-04-19T03:36:00.867647+0000","last_peered":"2024-04-19T03:36:00.867647+0000","last_clean":"2024-04-19T03:36:00.867647+0000","last_became_active":"2024-04-19T03:35:59.431072+0000","last_became_peered":"2024-04-19T03:35:59.431072+0000","last_unstale":"2024-04-19T03:36:00.867647+0000","last_undegraded":"2024-04-19T03:36:00.867647+0000","last_fullsized":"2024-04-19T03:36:00.867647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867590+0000","last_change":"2024-04-19T03:35:59.876828+0000","last_active":"2024-04-19T03:36:00.867590+0000","last_peered":"2024-04-19T03:36:00.867590+0000","last_clean":"2024-04-19T03:36:00.867590+0000","last_became_active":"2024-04-19T03:35:59.876482+0000","last_became_peered":"2024-04-19T03:35:59.876482+0000","last_unstale":"2024-04-19T03:36:00.867590+0000","last_undegraded":"2024-04-19T03:36:00.867590+0000","last_fullsized":"2024-04-19T03:36:00.867590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:05.827809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867495+0000","last_change":"2024-04-19T03:35:59.429451+0000","last_active":"2024-04-19T03:36:00.867495+0000","last_peered":"2024-04-19T03:36:00.867495+0000","last_clean":"2024-04-19T03:36:00.867495+0000","last_became_active":"2024-04-19T03:35:59.429087+0000","last_became_peered":"2024-04-19T03:35:59.429087+0000","last_unstale":"2024-04-19T03:36:00.867495+0000","last_undegraded":"2024-04-19T03:36:00.867495+0000","last_fullsized":"2024-04-19T03:36:00.867495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:19.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867804+0000","last_change":"2024-04-19T03:35:59.879270+0000","last_active":"2024-04-19T03:36:00.867804+0000","last_peered":"2024-04-19T03:36:00.867804+0000","last_clean":"2024-04-19T03:36:00.867804+0000","last_became_active":"2024-04-19T03:35:59.878554+0000","last_became_peered":"2024-04-19T03:35:59.878554+0000","last_unstale":"2024-04-19T03:36:00.867804+0000","last_undegraded":"2024-04-19T03:36:00.867804+0000","last_fullsized":"2024-04-19T03:36:00.867804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867631+0000","last_change":"2024-04-19T03:35:59.431379+0000","last_active":"2024-04-19T03:36:00.867631+0000","last_peered":"2024-04-19T03:36:00.867631+0000","last_clean":"2024-04-19T03:36:00.867631+0000","last_became_active":"2024-04-19T03:35:59.431065+0000","last_became_peered":"2024-04-19T03:35:59.431065+0000","last_unstale":"2024-04-19T03:36:00.867631+0000","last_undegraded":"2024-04-19T03:36:00.867631+0000","last_fullsized":"2024-04-19T03:36:00.867631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868460+0000","last_change":"2024-04-19T03:35:59.885989+0000","last_active":"2024-04-19T03:36:00.868460+0000","last_peered":"2024-04-19T03:36:00.868460+0000","last_clean":"2024-04-19T03:36:00.868460+0000","last_became_active":"2024-04-19T03:35:59.885765+0000","last_became_peered":"2024-04-19T03:35:59.885765+0000","last_unstale":"2024-04-19T03:36:00.868460+0000","last_undegraded":"2024-04-19T03:36:00.868460+0000","last_fullsized":"2024-04-19T03:36:00.868460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867795+0000","last_change":"2024-04-19T03:35:59.431967+0000","last_active":"2024-04-19T03:36:00.867795+0000","last_peered":"2024-04-19T03:36:00.867795+0000","last_clean":"2024-04-19T03:36:00.867795+0000","last_became_active":"2024-04-19T03:35:59.431521+0000","last_became_peered":"2024-04-19T03:35:59.431521+0000","last_unstale":"2024-04-19T03:36:00.867795+0000","last_undegraded":"2024-04-19T03:36:00.867795+0000","last_fullsized":"2024-04-19T03:36:00.867795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868517+0000","last_change":"2024-04-19T03:35:59.885527+0000","last_active":"2024-04-19T03:36:00.868517+0000","last_peered":"2024-04-19T03:36:00.868517+0000","last_clean":"2024-04-19T03:36:00.868517+0000","last_became_active":"2024-04-19T03:35:59.885186+0000","last_became_peered":"2024-04-19T03:35:59.885186+0000","last_unstale":"2024-04-19T03:36:00.868517+0000","last_undegraded":"2024-04-19T03:36:00.868517+0000","last_fullsized":"2024-04-19T03:36:00.868517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867777+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:36:00.867777+0000","last_peered":"2024-04-19T03:36:00.867777+0000","last_clean":"2024-04-19T03:36:00.867777+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:36:00.867777+0000","last_undegraded":"2024-04-19T03:36:00.867777+0000","last_fullsized":"2024-04-19T03:36:00.867777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867975+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:36:00.867975+0000","last_peered":"2024-04-19T03:36:00.867975+0000","last_clean":"2024-04-19T03:36:00.867975+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:36:00.867975+0000","last_undegraded":"2024-04-19T03:36:00.867975+0000","last_fullsized":"2024-04-19T03:36:00.867975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867991+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:36:00.867991+0000","last_peered":"2024-04-19T03:36:00.867991+0000","last_clean":"2024-04-19T03:36:00.867991+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:36:00.867991+0000","last_undegraded":"2024-04-19T03:36:00.867991+0000","last_fullsized":"2024-04-19T03:36:00.867991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.874027+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:35:59.874027+0000","last_peered":"2024-04-19T03:35:59.874027+0000","last_clean":"2024-04-19T03:35:59.874027+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:35:59.874027+0000","last_undegraded":"2024-04-19T03:35:59.874027+0000","last_fullsized":"2024-04-19T03:35:59.874027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.866975+0000","last_change":"2024-04-19T03:35:59.878242+0000","last_active":"2024-04-19T03:36:00.866975+0000","last_peered":"2024-04-19T03:36:00.866975+0000","last_clean":"2024-04-19T03:36:00.866975+0000","last_became_active":"2024-04-19T03:35:59.877991+0000","last_became_peered":"2024-04-19T03:35:59.877991+0000","last_unstale":"2024-04-19T03:36:00.866975+0000","last_undegraded":"2024-04-19T03:36:00.866975+0000","last_fullsized":"2024-04-19T03:36:00.866975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:59:22.544717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873236+0000","last_change":"2024-04-19T03:35:54.405842+0000","last_active":"2024-04-19T03:35:59.873236+0000","last_peered":"2024-04-19T03:35:59.873236+0000","last_clean":"2024-04-19T03:35:59.873236+0000","last_became_active":"2024-04-19T03:35:54.405465+0000","last_became_peered":"2024-04-19T03:35:54.405465+0000","last_unstale":"2024-04-19T03:35:59.873236+0000","last_undegraded":"2024-04-19T03:35:59.873236+0000","last_fullsized":"2024-04-19T03:35:59.873236+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:03.279704+0000","last_change":"2024-04-19T03:35:59.429504+0000","last_active":"2024-04-19T03:36:03.279704+0000","last_peered":"2024-04-19T03:36:03.279704+0000","last_clean":"2024-04-19T03:36:03.279704+0000","last_became_active":"2024-04-19T03:35:59.428445+0000","last_became_peered":"2024-04-19T03:35:59.428445+0000","last_unstale":"2024-04-19T03:36:03.279704+0000","last_undegraded":"2024-04-19T03:36:03.279704+0000","last_fullsized":"2024-04-19T03:36:03.279704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:36.587021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867969+0000","last_change":"2024-04-19T03:35:59.881612+0000","last_active":"2024-04-19T03:36:00.867969+0000","last_peered":"2024-04-19T03:36:00.867969+0000","last_clean":"2024-04-19T03:36:00.867969+0000","last_became_active":"2024-04-19T03:35:59.880798+0000","last_became_peered":"2024-04-19T03:35:59.880798+0000","last_unstale":"2024-04-19T03:36:00.867969+0000","last_undegraded":"2024-04-19T03:36:00.867969+0000","last_fullsized":"2024-04-19T03:36:00.867969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.863575+0000","last_change":"2024-04-19T03:35:54.404971+0000","last_active":"2024-04-19T03:35:59.863575+0000","last_peered":"2024-04-19T03:35:59.863575+0000","last_clean":"2024-04-19T03:35:59.863575+0000","last_became_active":"2024-04-19T03:35:54.404670+0000","last_became_peered":"2024-04-19T03:35:54.404670+0000","last_unstale":"2024-04-19T03:35:59.863575+0000","last_undegraded":"2024-04-19T03:35:59.863575+0000","last_fullsized":"2024-04-19T03:35:59.863575+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:47.049313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867265+0000","last_change":"2024-04-19T03:35:55.405560+0000","last_active":"2024-04-19T03:35:59.867265+0000","last_peered":"2024-04-19T03:35:59.867265+0000","last_clean":"2024-04-19T03:35:59.867265+0000","last_became_active":"2024-04-19T03:35:55.405342+0000","last_became_peered":"2024-04-19T03:35:55.405342+0000","last_unstale":"2024-04-19T03:35:59.867265+0000","last_undegraded":"2024-04-19T03:35:59.867265+0000","last_fullsized":"2024-04-19T03:35:59.867265+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:27.418444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867074+0000","last_change":"2024-04-19T03:35:59.430221+0000","last_active":"2024-04-19T03:36:00.867074+0000","last_peered":"2024-04-19T03:36:00.867074+0000","last_clean":"2024-04-19T03:36:00.867074+0000","last_became_active":"2024-04-19T03:35:59.429479+0000","last_became_peered":"2024-04-19T03:35:59.429479+0000","last_unstale":"2024-04-19T03:36:00.867074+0000","last_undegraded":"2024-04-19T03:36:00.867074+0000","last_fullsized":"2024-04-19T03:36:00.867074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868989+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:36:00.868989+0000","last_peered":"2024-04-19T03:36:00.868989+0000","last_clean":"2024-04-19T03:36:00.868989+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:36:00.868989+0000","last_undegraded":"2024-04-19T03:36:00.868989+0000","last_fullsized":"2024-04-19T03:36:00.868989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867797+0000","last_change":"2024-04-19T03:35:54.408755+0000","last_active":"2024-04-19T03:35:59.867797+0000","last_peered":"2024-04-19T03:35:59.867797+0000","last_clean":"2024-04-19T03:35:59.867797+0000","last_became_active":"2024-04-19T03:35:54.408501+0000","last_became_peered":"2024-04-19T03:35:54.408501+0000","last_unstale":"2024-04-19T03:35:59.867797+0000","last_undegraded":"2024-04-19T03:35:59.867797+0000","last_fullsized":"2024-04-19T03:35:59.867797+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867712+0000","last_change":"2024-04-19T03:35:59.432736+0000","last_active":"2024-04-19T03:36:00.867712+0000","last_peered":"2024-04-19T03:36:00.867712+0000","last_clean":"2024-04-19T03:36:00.867712+0000","last_became_active":"2024-04-19T03:35:59.432160+0000","last_became_peered":"2024-04-19T03:35:59.432160+0000","last_unstale":"2024-04-19T03:36:00.867712+0000","last_undegraded":"2024-04-19T03:36:00.867712+0000","last_fullsized":"2024-04-19T03:36:00.867712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868107+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:36:00.868107+0000","last_peered":"2024-04-19T03:36:00.868107+0000","last_clean":"2024-04-19T03:36:00.868107+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:36:00.868107+0000","last_undegraded":"2024-04-19T03:36:00.868107+0000","last_fullsized":"2024-04-19T03:36:00.868107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867075+0000","last_change":"2024-04-19T03:35:54.405961+0000","last_active":"2024-04-19T03:35:59.867075+0000","last_peered":"2024-04-19T03:35:59.867075+0000","last_clean":"2024-04-19T03:35:59.867075+0000","last_became_active":"2024-04-19T03:35:54.405640+0000","last_became_peered":"2024-04-19T03:35:54.405640+0000","last_unstale":"2024-04-19T03:35:59.867075+0000","last_undegraded":"2024-04-19T03:35:59.867075+0000","last_fullsized":"2024-04-19T03:35:59.867075+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867408+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:36:00.867408+0000","last_peered":"2024-04-19T03:36:00.867408+0000","last_clean":"2024-04-19T03:36:00.867408+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:36:00.867408+0000","last_undegraded":"2024-04-19T03:36:00.867408+0000","last_fullsized":"2024-04-19T03:36:00.867408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868467+0000","last_change":"2024-04-19T03:35:59.885491+0000","last_active":"2024-04-19T03:36:00.868467+0000","last_peered":"2024-04-19T03:36:00.868467+0000","last_clean":"2024-04-19T03:36:00.868467+0000","last_became_active":"2024-04-19T03:35:59.885190+0000","last_became_peered":"2024-04-19T03:35:59.885190+0000","last_unstale":"2024-04-19T03:36:00.868467+0000","last_undegraded":"2024-04-19T03:36:00.868467+0000","last_fullsized":"2024-04-19T03:36:00.868467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.872489+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:35:59.872489+0000","last_peered":"2024-04-19T03:35:59.872489+0000","last_clean":"2024-04-19T03:35:59.872489+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:35:59.872489+0000","last_undegraded":"2024-04-19T03:35:59.872489+0000","last_fullsized":"2024-04-19T03:35:59.872489+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868035+0000","last_change":"2024-04-19T03:35:59.431391+0000","last_active":"2024-04-19T03:36:00.868035+0000","last_peered":"2024-04-19T03:36:00.868035+0000","last_clean":"2024-04-19T03:36:00.868035+0000","last_became_active":"2024-04-19T03:35:59.431063+0000","last_became_peered":"2024-04-19T03:35:59.431063+0000","last_unstale":"2024-04-19T03:36:00.868035+0000","last_undegraded":"2024-04-19T03:36:00.868035+0000","last_fullsized":"2024-04-19T03:36:00.868035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867786+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:36:00.867786+0000","last_peered":"2024-04-19T03:36:00.867786+0000","last_clean":"2024-04-19T03:36:00.867786+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:36:00.867786+0000","last_undegraded":"2024-04-19T03:36:00.867786+0000","last_fullsized":"2024-04-19T03:36:00.867786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873656+0000","last_change":"2024-04-19T03:35:54.405542+0000","last_active":"2024-04-19T03:35:59.873656+0000","last_peered":"2024-04-19T03:35:59.873656+0000","last_clean":"2024-04-19T03:35:59.873656+0000","last_became_active":"2024-04-19T03:35:54.405292+0000","last_became_peered":"2024-04-19T03:35:54.405292+0000","last_unstale":"2024-04-19T03:35:59.873656+0000","last_undegraded":"2024-04-19T03:35:59.873656+0000","last_fullsized":"2024-04-19T03:35:59.873656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867907+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:36:00.867907+0000","last_peered":"2024-04-19T03:36:00.867907+0000","last_clean":"2024-04-19T03:36:00.867907+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:36:00.867907+0000","last_undegraded":"2024-04-19T03:36:00.867907+0000","last_fullsized":"2024-04-19T03:36:00.867907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868284+0000","last_change":"2024-04-19T03:35:59.879474+0000","last_active":"2024-04-19T03:36:00.868284+0000","last_peered":"2024-04-19T03:36:00.868284+0000","last_clean":"2024-04-19T03:36:00.868284+0000","last_became_active":"2024-04-19T03:35:59.878964+0000","last_became_peered":"2024-04-19T03:35:59.878964+0000","last_unstale":"2024-04-19T03:36:00.868284+0000","last_undegraded":"2024-04-19T03:36:00.868284+0000","last_fullsized":"2024-04-19T03:36:00.868284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.868556+0000","last_change":"2024-04-19T03:35:54.405958+0000","last_active":"2024-04-19T03:35:59.868556+0000","last_peered":"2024-04-19T03:35:59.868556+0000","last_clean":"2024-04-19T03:35:59.868556+0000","last_became_active":"2024-04-19T03:35:54.405578+0000","last_became_peered":"2024-04-19T03:35:54.405578+0000","last_unstale":"2024-04-19T03:35:59.868556+0000","last_undegraded":"2024-04-19T03:35:59.868556+0000","last_fullsized":"2024-04-19T03:35:59.868556+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:11.280110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868342+0000","last_change":"2024-04-19T03:35:59.433970+0000","last_active":"2024-04-19T03:36:00.868342+0000","last_peered":"2024-04-19T03:36:00.868342+0000","last_clean":"2024-04-19T03:36:00.868342+0000","last_became_active":"2024-04-19T03:35:59.433556+0000","last_became_peered":"2024-04-19T03:35:59.433556+0000","last_unstale":"2024-04-19T03:36:00.868342+0000","last_undegraded":"2024-04-19T03:36:00.868342+0000","last_fullsized":"2024-04-19T03:36:00.868342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:44.022207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868191+0000","last_change":"2024-04-19T03:35:59.879956+0000","last_active":"2024-04-19T03:36:00.868191+0000","last_peered":"2024-04-19T03:36:00.868191+0000","last_clean":"2024-04-19T03:36:00.868191+0000","last_became_active":"2024-04-19T03:35:59.879330+0000","last_became_peered":"2024-04-19T03:35:59.879330+0000","last_unstale":"2024-04-19T03:36:00.868191+0000","last_undegraded":"2024-04-19T03:36:00.868191+0000","last_fullsized":"2024-04-19T03:36:00.868191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867999+0000","last_change":"2024-04-19T03:35:59.432750+0000","last_active":"2024-04-19T03:36:00.867999+0000","last_peered":"2024-04-19T03:36:00.867999+0000","last_clean":"2024-04-19T03:36:00.867999+0000","last_became_active":"2024-04-19T03:35:59.432172+0000","last_became_peered":"2024-04-19T03:35:59.432172+0000","last_unstale":"2024-04-19T03:36:00.867999+0000","last_undegraded":"2024-04-19T03:36:00.867999+0000","last_fullsized":"2024-04-19T03:36:00.867999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868608+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:36:00.868608+0000","last_peered":"2024-04-19T03:36:00.868608+0000","last_clean":"2024-04-19T03:36:00.868608+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:36:00.868608+0000","last_undegraded":"2024-04-19T03:36:00.868608+0000","last_fullsized":"2024-04-19T03:36:00.868608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868241+0000","last_change":"2024-04-19T03:35:59.434114+0000","last_active":"2024-04-19T03:36:00.868241+0000","last_peered":"2024-04-19T03:36:00.868241+0000","last_clean":"2024-04-19T03:36:00.868241+0000","last_became_active":"2024-04-19T03:35:59.433765+0000","last_became_peered":"2024-04-19T03:35:59.433765+0000","last_unstale":"2024-04-19T03:36:00.868241+0000","last_undegraded":"2024-04-19T03:36:00.868241+0000","last_fullsized":"2024-04-19T03:36:00.868241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867893+0000","last_change":"2024-04-19T03:35:59.876608+0000","last_active":"2024-04-19T03:36:00.867893+0000","last_peered":"2024-04-19T03:36:00.867893+0000","last_clean":"2024-04-19T03:36:00.867893+0000","last_became_active":"2024-04-19T03:35:59.875297+0000","last_became_peered":"2024-04-19T03:35:59.875297+0000","last_unstale":"2024-04-19T03:36:00.867893+0000","last_undegraded":"2024-04-19T03:36:00.867893+0000","last_fullsized":"2024-04-19T03:36:00.867893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868926+0000","last_change":"2024-04-19T03:35:59.432321+0000","last_active":"2024-04-19T03:36:00.868926+0000","last_peered":"2024-04-19T03:36:00.868926+0000","last_clean":"2024-04-19T03:36:00.868926+0000","last_became_active":"2024-04-19T03:35:59.431638+0000","last_became_peered":"2024-04-19T03:35:59.431638+0000","last_unstale":"2024-04-19T03:36:00.868926+0000","last_undegraded":"2024-04-19T03:36:00.868926+0000","last_fullsized":"2024-04-19T03:36:00.868926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867670+0000","last_change":"2024-04-19T03:35:59.877336+0000","last_active":"2024-04-19T03:36:00.867670+0000","last_peered":"2024-04-19T03:36:00.867670+0000","last_clean":"2024-04-19T03:36:00.867670+0000","last_became_active":"2024-04-19T03:35:59.876461+0000","last_became_peered":"2024-04-19T03:35:59.876461+0000","last_unstale":"2024-04-19T03:36:00.867670+0000","last_undegraded":"2024-04-19T03:36:00.867670+0000","last_fullsized":"2024-04-19T03:36:00.867670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868151+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:36:00.868151+0000","last_peered":"2024-04-19T03:36:00.868151+0000","last_clean":"2024-04-19T03:36:00.868151+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:36:00.868151+0000","last_undegraded":"2024-04-19T03:36:00.868151+0000","last_fullsized":"2024-04-19T03:36:00.868151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868264+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:36:00.868264+0000","last_peered":"2024-04-19T03:36:00.868264+0000","last_clean":"2024-04-19T03:36:00.868264+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:36:00.868264+0000","last_undegraded":"2024-04-19T03:36:00.868264+0000","last_fullsized":"2024-04-19T03:36:00.868264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868040+0000","last_change":"2024-04-19T03:35:59.429171+0000","last_active":"2024-04-19T03:36:00.868040+0000","last_peered":"2024-04-19T03:36:00.868040+0000","last_clean":"2024-04-19T03:36:00.868040+0000","last_became_active":"2024-04-19T03:35:59.428837+0000","last_became_peered":"2024-04-19T03:35:59.428837+0000","last_unstale":"2024-04-19T03:36:00.868040+0000","last_undegraded":"2024-04-19T03:36:00.868040+0000","last_fullsized":"2024-04-19T03:36:00.868040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867627+0000","last_change":"2024-04-19T03:35:59.880260+0000","last_active":"2024-04-19T03:36:00.867627+0000","last_peered":"2024-04-19T03:36:00.867627+0000","last_clean":"2024-04-19T03:36:00.867627+0000","last_became_active":"2024-04-19T03:35:59.879086+0000","last_became_peered":"2024-04-19T03:35:59.879086+0000","last_unstale":"2024-04-19T03:36:00.867627+0000","last_undegraded":"2024-04-19T03:36:00.867627+0000","last_fullsized":"2024-04-19T03:36:00.867627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867442+0000","last_change":"2024-04-19T03:35:59.880550+0000","last_active":"2024-04-19T03:36:00.867442+0000","last_peered":"2024-04-19T03:36:00.867442+0000","last_clean":"2024-04-19T03:36:00.867442+0000","last_became_active":"2024-04-19T03:35:59.879772+0000","last_became_peered":"2024-04-19T03:35:59.879772+0000","last_unstale":"2024-04-19T03:36:00.867442+0000","last_undegraded":"2024-04-19T03:36:00.867442+0000","last_fullsized":"2024-04-19T03:36:00.867442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867115+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:36:00.867115+0000","last_peered":"2024-04-19T03:36:00.867115+0000","last_clean":"2024-04-19T03:36:00.867115+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:36:00.867115+0000","last_undegraded":"2024-04-19T03:36:00.867115+0000","last_fullsized":"2024-04-19T03:36:00.867115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868363+0000","last_change":"2024-04-19T03:35:59.881028+0000","last_active":"2024-04-19T03:36:00.868363+0000","last_peered":"2024-04-19T03:36:00.868363+0000","last_clean":"2024-04-19T03:36:00.868363+0000","last_became_active":"2024-04-19T03:35:59.880088+0000","last_became_peered":"2024-04-19T03:35:59.880088+0000","last_unstale":"2024-04-19T03:36:00.868363+0000","last_undegraded":"2024-04-19T03:36:00.868363+0000","last_fullsized":"2024-04-19T03:36:00.868363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:52.418012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867632+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:36:00.867632+0000","last_peered":"2024-04-19T03:36:00.867632+0000","last_clean":"2024-04-19T03:36:00.867632+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:36:00.867632+0000","last_undegraded":"2024-04-19T03:36:00.867632+0000","last_fullsized":"2024-04-19T03:36:00.867632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868762+0000","last_change":"2024-04-19T03:35:59.882281+0000","last_active":"2024-04-19T03:36:00.868762+0000","last_peered":"2024-04-19T03:36:00.868762+0000","last_clean":"2024-04-19T03:36:00.868762+0000","last_became_active":"2024-04-19T03:35:59.880757+0000","last_became_peered":"2024-04-19T03:35:59.880757+0000","last_unstale":"2024-04-19T03:36:00.868762+0000","last_undegraded":"2024-04-19T03:36:00.868762+0000","last_fullsized":"2024-04-19T03:36:00.868762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:36:17.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:36:17.860 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:36:17.862 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:36:17.874 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-19T03:36:16.271918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86796,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028724,"statfs":{"total":289910292480,"available":289821413376,"internally_reserved":0,"allocated":1671168,"data_stored":1332547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002855"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869083+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:36:00.869083+0000","last_peered":"2024-04-19T03:36:00.869083+0000","last_clean":"2024-04-19T03:36:00.869083+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:36:00.869083+0000","last_undegraded":"2024-04-19T03:36:00.869083+0000","last_fullsized":"2024-04-19T03:36:00.869083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868676+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:36:00.868676+0000","last_peered":"2024-04-19T03:36:00.868676+0000","last_clean":"2024-04-19T03:36:00.868676+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:36:00.868676+0000","last_undegraded":"2024-04-19T03:36:00.868676+0000","last_fullsized":"2024-04-19T03:36:00.868676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868331+0000","last_change":"2024-04-19T03:35:59.886429+0000","last_active":"2024-04-19T03:36:00.868331+0000","last_peered":"2024-04-19T03:36:00.868331+0000","last_clean":"2024-04-19T03:36:00.868331+0000","last_became_active":"2024-04-19T03:35:59.886189+0000","last_became_peered":"2024-04-19T03:35:59.886189+0000","last_unstale":"2024-04-19T03:36:00.868331+0000","last_undegraded":"2024-04-19T03:36:00.868331+0000","last_fullsized":"2024-04-19T03:36:00.868331+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867838+0000","last_change":"2024-04-19T03:35:59.878844+0000","last_active":"2024-04-19T03:36:00.867838+0000","last_peered":"2024-04-19T03:36:00.867838+0000","last_clean":"2024-04-19T03:36:00.867838+0000","last_became_active":"2024-04-19T03:35:59.878100+0000","last_became_peered":"2024-04-19T03:35:59.878100+0000","last_unstale":"2024-04-19T03:36:00.867838+0000","last_undegraded":"2024-04-19T03:36:00.867838+0000","last_fullsized":"2024-04-19T03:36:00.867838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868178+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:36:00.868178+0000","last_peered":"2024-04-19T03:36:00.868178+0000","last_clean":"2024-04-19T03:36:00.868178+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:36:00.868178+0000","last_undegraded":"2024-04-19T03:36:00.868178+0000","last_fullsized":"2024-04-19T03:36:00.868178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867527+0000","last_change":"2024-04-19T03:35:59.876553+0000","last_active":"2024-04-19T03:36:00.867527+0000","last_peered":"2024-04-19T03:36:00.867527+0000","last_clean":"2024-04-19T03:36:00.867527+0000","last_became_active":"2024-04-19T03:35:59.875201+0000","last_became_peered":"2024-04-19T03:35:59.875201+0000","last_unstale":"2024-04-19T03:36:00.867527+0000","last_undegraded":"2024-04-19T03:36:00.867527+0000","last_fullsized":"2024-04-19T03:36:00.867527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867483+0000","last_change":"2024-04-19T03:35:59.876305+0000","last_active":"2024-04-19T03:36:00.867483+0000","last_peered":"2024-04-19T03:36:00.867483+0000","last_clean":"2024-04-19T03:36:00.867483+0000","last_became_active":"2024-04-19T03:35:59.875093+0000","last_became_peered":"2024-04-19T03:35:59.875093+0000","last_unstale":"2024-04-19T03:36:00.867483+0000","last_undegraded":"2024-04-19T03:36:00.867483+0000","last_fullsized":"2024-04-19T03:36:00.867483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867184+0000","last_change":"2024-04-19T03:35:59.880058+0000","last_active":"2024-04-19T03:36:00.867184+0000","last_peered":"2024-04-19T03:36:00.867184+0000","last_clean":"2024-04-19T03:36:00.867184+0000","last_became_active":"2024-04-19T03:35:59.878691+0000","last_became_peered":"2024-04-19T03:35:59.878691+0000","last_unstale":"2024-04-19T03:36:00.867184+0000","last_undegraded":"2024-04-19T03:36:00.867184+0000","last_fullsized":"2024-04-19T03:36:00.867184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868945+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:36:00.868945+0000","last_peered":"2024-04-19T03:36:00.868945+0000","last_clean":"2024-04-19T03:36:00.868945+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:36:00.868945+0000","last_undegraded":"2024-04-19T03:36:00.868945+0000","last_fullsized":"2024-04-19T03:36:00.868945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868069+0000","last_change":"2024-04-19T03:35:59.878070+0000","last_active":"2024-04-19T03:36:00.868069+0000","last_peered":"2024-04-19T03:36:00.868069+0000","last_clean":"2024-04-19T03:36:00.868069+0000","last_became_active":"2024-04-19T03:35:59.876291+0000","last_became_peered":"2024-04-19T03:35:59.876291+0000","last_unstale":"2024-04-19T03:36:00.868069+0000","last_undegraded":"2024-04-19T03:36:00.868069+0000","last_fullsized":"2024-04-19T03:36:00.868069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868341+0000","last_change":"2024-04-19T03:35:59.883585+0000","last_active":"2024-04-19T03:36:00.868341+0000","last_peered":"2024-04-19T03:36:00.868341+0000","last_clean":"2024-04-19T03:36:00.868341+0000","last_became_active":"2024-04-19T03:35:59.883232+0000","last_became_peered":"2024-04-19T03:35:59.883232+0000","last_unstale":"2024-04-19T03:36:00.868341+0000","last_undegraded":"2024-04-19T03:36:00.868341+0000","last_fullsized":"2024-04-19T03:36:00.868341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867977+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:36:00.867977+0000","last_peered":"2024-04-19T03:36:00.867977+0000","last_clean":"2024-04-19T03:36:00.867977+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:36:00.867977+0000","last_undegraded":"2024-04-19T03:36:00.867977+0000","last_fullsized":"2024-04-19T03:36:00.867977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867945+0000","last_change":"2024-04-19T03:35:59.882444+0000","last_active":"2024-04-19T03:36:00.867945+0000","last_peered":"2024-04-19T03:36:00.867945+0000","last_clean":"2024-04-19T03:36:00.867945+0000","last_became_active":"2024-04-19T03:35:59.882075+0000","last_became_peered":"2024-04-19T03:35:59.882075+0000","last_unstale":"2024-04-19T03:36:00.867945+0000","last_undegraded":"2024-04-19T03:36:00.867945+0000","last_fullsized":"2024-04-19T03:36:00.867945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867610+0000","last_change":"2024-04-19T03:35:59.882604+0000","last_active":"2024-04-19T03:36:00.867610+0000","last_peered":"2024-04-19T03:36:00.867610+0000","last_clean":"2024-04-19T03:36:00.867610+0000","last_became_active":"2024-04-19T03:35:59.882330+0000","last_became_peered":"2024-04-19T03:35:59.882330+0000","last_unstale":"2024-04-19T03:36:00.867610+0000","last_undegraded":"2024-04-19T03:36:00.867610+0000","last_fullsized":"2024-04-19T03:36:00.867610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867199+0000","last_change":"2024-04-19T03:35:59.880349+0000","last_active":"2024-04-19T03:36:00.867199+0000","last_peered":"2024-04-19T03:36:00.867199+0000","last_clean":"2024-04-19T03:36:00.867199+0000","last_became_active":"2024-04-19T03:35:59.879119+0000","last_became_peered":"2024-04-19T03:35:59.879119+0000","last_unstale":"2024-04-19T03:36:00.867199+0000","last_undegraded":"2024-04-19T03:36:00.867199+0000","last_fullsized":"2024-04-19T03:36:00.867199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867891+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:36:00.867891+0000","last_peered":"2024-04-19T03:36:00.867891+0000","last_clean":"2024-04-19T03:36:00.867891+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:36:00.867891+0000","last_undegraded":"2024-04-19T03:36:00.867891+0000","last_fullsized":"2024-04-19T03:36:00.867891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868856+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868856+0000","last_peered":"2024-04-19T03:36:00.868856+0000","last_clean":"2024-04-19T03:36:00.868856+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:36:00.868856+0000","last_undegraded":"2024-04-19T03:36:00.868856+0000","last_fullsized":"2024-04-19T03:36:00.868856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867771+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:36:00.867771+0000","last_peered":"2024-04-19T03:36:00.867771+0000","last_clean":"2024-04-19T03:36:00.867771+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:36:00.867771+0000","last_undegraded":"2024-04-19T03:36:00.867771+0000","last_fullsized":"2024-04-19T03:36:00.867771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867992+0000","last_change":"2024-04-19T03:35:59.879234+0000","last_active":"2024-04-19T03:36:00.867992+0000","last_peered":"2024-04-19T03:36:00.867992+0000","last_clean":"2024-04-19T03:36:00.867992+0000","last_became_active":"2024-04-19T03:35:59.878820+0000","last_became_peered":"2024-04-19T03:35:59.878820+0000","last_unstale":"2024-04-19T03:36:00.867992+0000","last_undegraded":"2024-04-19T03:36:00.867992+0000","last_fullsized":"2024-04-19T03:36:00.867992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867874+0000","last_change":"2024-04-19T03:35:59.877313+0000","last_active":"2024-04-19T03:36:00.867874+0000","last_peered":"2024-04-19T03:36:00.867874+0000","last_clean":"2024-04-19T03:36:00.867874+0000","last_became_active":"2024-04-19T03:35:59.875350+0000","last_became_peered":"2024-04-19T03:35:59.875350+0000","last_unstale":"2024-04-19T03:36:00.867874+0000","last_undegraded":"2024-04-19T03:36:00.867874+0000","last_fullsized":"2024-04-19T03:36:00.867874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868267+0000","last_change":"2024-04-19T03:35:59.881019+0000","last_active":"2024-04-19T03:36:00.868267+0000","last_peered":"2024-04-19T03:36:00.868267+0000","last_clean":"2024-04-19T03:36:00.868267+0000","last_became_active":"2024-04-19T03:35:59.880363+0000","last_became_peered":"2024-04-19T03:35:59.880363+0000","last_unstale":"2024-04-19T03:36:00.868267+0000","last_undegraded":"2024-04-19T03:36:00.868267+0000","last_fullsized":"2024-04-19T03:36:00.868267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867430+0000","last_change":"2024-04-19T03:35:59.872083+0000","last_active":"2024-04-19T03:36:00.867430+0000","last_peered":"2024-04-19T03:36:00.867430+0000","last_clean":"2024-04-19T03:36:00.867430+0000","last_became_active":"2024-04-19T03:35:59.871872+0000","last_became_peered":"2024-04-19T03:35:59.871872+0000","last_unstale":"2024-04-19T03:36:00.867430+0000","last_undegraded":"2024-04-19T03:36:00.867430+0000","last_fullsized":"2024-04-19T03:36:00.867430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868080+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:36:00.868080+0000","last_peered":"2024-04-19T03:36:00.868080+0000","last_clean":"2024-04-19T03:36:00.868080+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:36:00.868080+0000","last_undegraded":"2024-04-19T03:36:00.868080+0000","last_fullsized":"2024-04-19T03:36:00.868080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869076+0000","last_change":"2024-04-19T03:35:59.882017+0000","last_active":"2024-04-19T03:36:00.869076+0000","last_peered":"2024-04-19T03:36:00.869076+0000","last_clean":"2024-04-19T03:36:00.869076+0000","last_became_active":"2024-04-19T03:35:59.881048+0000","last_became_peered":"2024-04-19T03:35:59.881048+0000","last_unstale":"2024-04-19T03:36:00.869076+0000","last_undegraded":"2024-04-19T03:36:00.869076+0000","last_fullsized":"2024-04-19T03:36:00.869076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:49:35.433110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868233+0000","last_change":"2024-04-19T03:35:59.873199+0000","last_active":"2024-04-19T03:36:00.868233+0000","last_peered":"2024-04-19T03:36:00.868233+0000","last_clean":"2024-04-19T03:36:00.868233+0000","last_became_active":"2024-04-19T03:35:59.872661+0000","last_became_peered":"2024-04-19T03:35:59.872661+0000","last_unstale":"2024-04-19T03:36:00.868233+0000","last_undegraded":"2024-04-19T03:36:00.868233+0000","last_fullsized":"2024-04-19T03:36:00.868233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868190+0000","last_change":"2024-04-19T03:35:59.882737+0000","last_active":"2024-04-19T03:36:00.868190+0000","last_peered":"2024-04-19T03:36:00.868190+0000","last_clean":"2024-04-19T03:36:00.868190+0000","last_became_active":"2024-04-19T03:35:59.882537+0000","last_became_peered":"2024-04-19T03:35:59.882537+0000","last_unstale":"2024-04-19T03:36:00.868190+0000","last_undegraded":"2024-04-19T03:36:00.868190+0000","last_fullsized":"2024-04-19T03:36:00.868190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867954+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:36:00.867954+0000","last_peered":"2024-04-19T03:36:00.867954+0000","last_clean":"2024-04-19T03:36:00.867954+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:36:00.867954+0000","last_undegraded":"2024-04-19T03:36:00.867954+0000","last_fullsized":"2024-04-19T03:36:00.867954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868942+0000","last_change":"2024-04-19T03:35:59.882176+0000","last_active":"2024-04-19T03:36:00.868942+0000","last_peered":"2024-04-19T03:36:00.868942+0000","last_clean":"2024-04-19T03:36:00.868942+0000","last_became_active":"2024-04-19T03:35:59.881216+0000","last_became_peered":"2024-04-19T03:35:59.881216+0000","last_unstale":"2024-04-19T03:36:00.868942+0000","last_undegraded":"2024-04-19T03:36:00.868942+0000","last_fullsized":"2024-04-19T03:36:00.868942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867298+0000","last_change":"2024-04-19T03:35:59.429598+0000","last_active":"2024-04-19T03:36:00.867298+0000","last_peered":"2024-04-19T03:36:00.867298+0000","last_clean":"2024-04-19T03:36:00.867298+0000","last_became_active":"2024-04-19T03:35:59.429239+0000","last_became_peered":"2024-04-19T03:35:59.429239+0000","last_unstale":"2024-04-19T03:36:00.867298+0000","last_undegraded":"2024-04-19T03:36:00.867298+0000","last_fullsized":"2024-04-19T03:36:00.867298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868065+0000","last_change":"2024-04-19T03:35:59.872790+0000","last_active":"2024-04-19T03:36:00.868065+0000","last_peered":"2024-04-19T03:36:00.868065+0000","last_clean":"2024-04-19T03:36:00.868065+0000","last_became_active":"2024-04-19T03:35:59.872223+0000","last_became_peered":"2024-04-19T03:35:59.872223+0000","last_unstale":"2024-04-19T03:36:00.868065+0000","last_undegraded":"2024-04-19T03:36:00.868065+0000","last_fullsized":"2024-04-19T03:36:00.868065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867213+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:36:00.867213+0000","last_peered":"2024-04-19T03:36:00.867213+0000","last_clean":"2024-04-19T03:36:00.867213+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:36:00.867213+0000","last_undegraded":"2024-04-19T03:36:00.867213+0000","last_fullsized":"2024-04-19T03:36:00.867213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868970+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:36:00.868970+0000","last_peered":"2024-04-19T03:36:00.868970+0000","last_clean":"2024-04-19T03:36:00.868970+0000","last_became_active":"2024-04-19T03:35:59.881795+0000","last_became_peered":"2024-04-19T03:35:59.881795+0000","last_unstale":"2024-04-19T03:36:00.868970+0000","last_undegraded":"2024-04-19T03:36:00.868970+0000","last_fullsized":"2024-04-19T03:36:00.868970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868091+0000","last_change":"2024-04-19T03:35:59.429529+0000","last_active":"2024-04-19T03:36:00.868091+0000","last_peered":"2024-04-19T03:36:00.868091+0000","last_clean":"2024-04-19T03:36:00.868091+0000","last_became_active":"2024-04-19T03:35:59.429121+0000","last_became_peered":"2024-04-19T03:35:59.429121+0000","last_unstale":"2024-04-19T03:36:00.868091+0000","last_undegraded":"2024-04-19T03:36:00.868091+0000","last_fullsized":"2024-04-19T03:36:00.868091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867146+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:36:00.867146+0000","last_peered":"2024-04-19T03:36:00.867146+0000","last_clean":"2024-04-19T03:36:00.867146+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:36:00.867146+0000","last_undegraded":"2024-04-19T03:36:00.867146+0000","last_fullsized":"2024-04-19T03:36:00.867146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868383+0000","last_change":"2024-04-19T03:35:59.434129+0000","last_active":"2024-04-19T03:36:00.868383+0000","last_peered":"2024-04-19T03:36:00.868383+0000","last_clean":"2024-04-19T03:36:00.868383+0000","last_became_active":"2024-04-19T03:35:59.433761+0000","last_became_peered":"2024-04-19T03:35:59.433761+0000","last_unstale":"2024-04-19T03:36:00.868383+0000","last_undegraded":"2024-04-19T03:36:00.868383+0000","last_fullsized":"2024-04-19T03:36:00.868383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867364+0000","last_change":"2024-04-19T03:35:59.872126+0000","last_active":"2024-04-19T03:36:00.867364+0000","last_peered":"2024-04-19T03:36:00.867364+0000","last_clean":"2024-04-19T03:36:00.867364+0000","last_became_active":"2024-04-19T03:35:59.871818+0000","last_became_peered":"2024-04-19T03:35:59.871818+0000","last_unstale":"2024-04-19T03:36:00.867364+0000","last_undegraded":"2024-04-19T03:36:00.867364+0000","last_fullsized":"2024-04-19T03:36:00.867364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:49:19.611505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868776+0000","last_change":"2024-04-19T03:35:59.431907+0000","last_active":"2024-04-19T03:36:00.868776+0000","last_peered":"2024-04-19T03:36:00.868776+0000","last_clean":"2024-04-19T03:36:00.868776+0000","last_became_active":"2024-04-19T03:35:59.431432+0000","last_became_peered":"2024-04-19T03:35:59.431432+0000","last_unstale":"2024-04-19T03:36:00.868776+0000","last_undegraded":"2024-04-19T03:36:00.868776+0000","last_fullsized":"2024-04-19T03:36:00.868776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867656+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:36:00.867656+0000","last_peered":"2024-04-19T03:36:00.867656+0000","last_clean":"2024-04-19T03:36:00.867656+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:36:00.867656+0000","last_undegraded":"2024-04-19T03:36:00.867656+0000","last_fullsized":"2024-04-19T03:36:00.867656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868141+0000","last_change":"2024-04-19T03:35:59.433961+0000","last_active":"2024-04-19T03:36:00.868141+0000","last_peered":"2024-04-19T03:36:00.868141+0000","last_clean":"2024-04-19T03:36:00.868141+0000","last_became_active":"2024-04-19T03:35:59.433506+0000","last_became_peered":"2024-04-19T03:35:59.433506+0000","last_unstale":"2024-04-19T03:36:00.868141+0000","last_undegraded":"2024-04-19T03:36:00.868141+0000","last_fullsized":"2024-04-19T03:36:00.868141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868192+0000","last_change":"2024-04-19T03:35:59.885493+0000","last_active":"2024-04-19T03:36:00.868192+0000","last_peered":"2024-04-19T03:36:00.868192+0000","last_clean":"2024-04-19T03:36:00.868192+0000","last_became_active":"2024-04-19T03:35:59.885107+0000","last_became_peered":"2024-04-19T03:35:59.885107+0000","last_unstale":"2024-04-19T03:36:00.868192+0000","last_undegraded":"2024-04-19T03:36:00.868192+0000","last_fullsized":"2024-04-19T03:36:00.868192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:41:55.801718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868108+0000","last_change":"2024-04-19T03:35:59.434133+0000","last_active":"2024-04-19T03:36:00.868108+0000","last_peered":"2024-04-19T03:36:00.868108+0000","last_clean":"2024-04-19T03:36:00.868108+0000","last_became_active":"2024-04-19T03:35:59.433755+0000","last_became_peered":"2024-04-19T03:35:59.433755+0000","last_unstale":"2024-04-19T03:36:00.868108+0000","last_undegraded":"2024-04-19T03:36:00.868108+0000","last_fullsized":"2024-04-19T03:36:00.868108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:58:17.507444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868452+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:36:00.868452+0000","last_peered":"2024-04-19T03:36:00.868452+0000","last_clean":"2024-04-19T03:36:00.868452+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:36:00.868452+0000","last_undegraded":"2024-04-19T03:36:00.868452+0000","last_fullsized":"2024-04-19T03:36:00.868452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867515+0000","last_change":"2024-04-19T03:35:59.428849+0000","last_active":"2024-04-19T03:36:00.867515+0000","last_peered":"2024-04-19T03:36:00.867515+0000","last_clean":"2024-04-19T03:36:00.867515+0000","last_became_active":"2024-04-19T03:35:59.428478+0000","last_became_peered":"2024-04-19T03:35:59.428478+0000","last_unstale":"2024-04-19T03:36:00.867515+0000","last_undegraded":"2024-04-19T03:36:00.867515+0000","last_fullsized":"2024-04-19T03:36:00.867515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.869023+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:36:00.869023+0000","last_peered":"2024-04-19T03:36:00.869023+0000","last_clean":"2024-04-19T03:36:00.869023+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:36:00.869023+0000","last_undegraded":"2024-04-19T03:36:00.869023+0000","last_fullsized":"2024-04-19T03:36:00.869023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867937+0000","last_change":"2024-04-19T03:35:59.431877+0000","last_active":"2024-04-19T03:36:00.867937+0000","last_peered":"2024-04-19T03:36:00.867937+0000","last_clean":"2024-04-19T03:36:00.867937+0000","last_became_active":"2024-04-19T03:35:59.431343+0000","last_became_peered":"2024-04-19T03:35:59.431343+0000","last_unstale":"2024-04-19T03:36:00.867937+0000","last_undegraded":"2024-04-19T03:36:00.867937+0000","last_fullsized":"2024-04-19T03:36:00.867937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868161+0000","last_change":"2024-04-19T03:35:59.873111+0000","last_active":"2024-04-19T03:36:00.868161+0000","last_peered":"2024-04-19T03:36:00.868161+0000","last_clean":"2024-04-19T03:36:00.868161+0000","last_became_active":"2024-04-19T03:35:59.872468+0000","last_became_peered":"2024-04-19T03:35:59.872468+0000","last_unstale":"2024-04-19T03:36:00.868161+0000","last_undegraded":"2024-04-19T03:36:00.868161+0000","last_fullsized":"2024-04-19T03:36:00.868161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:30:15.469254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867684+0000","last_change":"2024-04-19T03:35:59.434023+0000","last_active":"2024-04-19T03:36:00.867684+0000","last_peered":"2024-04-19T03:36:00.867684+0000","last_clean":"2024-04-19T03:36:00.867684+0000","last_became_active":"2024-04-19T03:35:59.433542+0000","last_became_peered":"2024-04-19T03:35:59.433542+0000","last_unstale":"2024-04-19T03:36:00.867684+0000","last_undegraded":"2024-04-19T03:36:00.867684+0000","last_fullsized":"2024-04-19T03:36:00.867684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868203+0000","last_change":"2024-04-19T03:35:59.872558+0000","last_active":"2024-04-19T03:36:00.868203+0000","last_peered":"2024-04-19T03:36:00.868203+0000","last_clean":"2024-04-19T03:36:00.868203+0000","last_became_active":"2024-04-19T03:35:59.872302+0000","last_became_peered":"2024-04-19T03:35:59.872302+0000","last_unstale":"2024-04-19T03:36:00.868203+0000","last_undegraded":"2024-04-19T03:36:00.868203+0000","last_fullsized":"2024-04-19T03:36:00.868203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:46:14.886758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868499+0000","last_change":"2024-04-19T03:35:59.434430+0000","last_active":"2024-04-19T03:36:00.868499+0000","last_peered":"2024-04-19T03:36:00.868499+0000","last_clean":"2024-04-19T03:36:00.868499+0000","last_became_active":"2024-04-19T03:35:59.433885+0000","last_became_peered":"2024-04-19T03:35:59.433885+0000","last_unstale":"2024-04-19T03:36:00.868499+0000","last_undegraded":"2024-04-19T03:36:00.868499+0000","last_fullsized":"2024-04-19T03:36:00.868499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867570+0000","last_change":"2024-04-19T03:35:59.883449+0000","last_active":"2024-04-19T03:36:00.867570+0000","last_peered":"2024-04-19T03:36:00.867570+0000","last_clean":"2024-04-19T03:36:00.867570+0000","last_became_active":"2024-04-19T03:35:59.882794+0000","last_became_peered":"2024-04-19T03:35:59.882794+0000","last_unstale":"2024-04-19T03:36:00.867570+0000","last_undegraded":"2024-04-19T03:36:00.867570+0000","last_fullsized":"2024-04-19T03:36:00.867570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:50.161294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868576+0000","last_change":"2024-04-19T03:35:59.433568+0000","last_active":"2024-04-19T03:36:00.868576+0000","last_peered":"2024-04-19T03:36:00.868576+0000","last_clean":"2024-04-19T03:36:00.868576+0000","last_became_active":"2024-04-19T03:35:59.433247+0000","last_became_peered":"2024-04-19T03:35:59.433247+0000","last_unstale":"2024-04-19T03:36:00.868576+0000","last_undegraded":"2024-04-19T03:36:00.868576+0000","last_fullsized":"2024-04-19T03:36:00.868576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868220+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:36:00.868220+0000","last_peered":"2024-04-19T03:36:00.868220+0000","last_clean":"2024-04-19T03:36:00.868220+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:36:00.868220+0000","last_undegraded":"2024-04-19T03:36:00.868220+0000","last_fullsized":"2024-04-19T03:36:00.868220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868210+0000","last_change":"2024-04-19T03:35:59.433585+0000","last_active":"2024-04-19T03:36:00.868210+0000","last_peered":"2024-04-19T03:36:00.868210+0000","last_clean":"2024-04-19T03:36:00.868210+0000","last_became_active":"2024-04-19T03:35:59.433273+0000","last_became_peered":"2024-04-19T03:35:59.433273+0000","last_unstale":"2024-04-19T03:36:00.868210+0000","last_undegraded":"2024-04-19T03:36:00.868210+0000","last_fullsized":"2024-04-19T03:36:00.868210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867805+0000","last_change":"2024-04-19T03:35:59.876757+0000","last_active":"2024-04-19T03:36:00.867805+0000","last_peered":"2024-04-19T03:36:00.867805+0000","last_clean":"2024-04-19T03:36:00.867805+0000","last_became_active":"2024-04-19T03:35:59.876227+0000","last_became_peered":"2024-04-19T03:35:59.876227+0000","last_unstale":"2024-04-19T03:36:00.867805+0000","last_undegraded":"2024-04-19T03:36:00.867805+0000","last_fullsized":"2024-04-19T03:36:00.867805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867647+0000","last_change":"2024-04-19T03:35:59.431430+0000","last_active":"2024-04-19T03:36:00.867647+0000","last_peered":"2024-04-19T03:36:00.867647+0000","last_clean":"2024-04-19T03:36:00.867647+0000","last_became_active":"2024-04-19T03:35:59.431072+0000","last_became_peered":"2024-04-19T03:35:59.431072+0000","last_unstale":"2024-04-19T03:36:00.867647+0000","last_undegraded":"2024-04-19T03:36:00.867647+0000","last_fullsized":"2024-04-19T03:36:00.867647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:16.712388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867590+0000","last_change":"2024-04-19T03:35:59.876828+0000","last_active":"2024-04-19T03:36:00.867590+0000","last_peered":"2024-04-19T03:36:00.867590+0000","last_clean":"2024-04-19T03:36:00.867590+0000","last_became_active":"2024-04-19T03:35:59.876482+0000","last_became_peered":"2024-04-19T03:35:59.876482+0000","last_unstale":"2024-04-19T03:36:00.867590+0000","last_undegraded":"2024-04-19T03:36:00.867590+0000","last_fullsized":"2024-04-19T03:36:00.867590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:05.827809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867495+0000","last_change":"2024-04-19T03:35:59.429451+0000","last_active":"2024-04-19T03:36:00.867495+0000","last_peered":"2024-04-19T03:36:00.867495+0000","last_clean":"2024-04-19T03:36:00.867495+0000","last_became_active":"2024-04-19T03:35:59.429087+0000","last_became_peered":"2024-04-19T03:35:59.429087+0000","last_unstale":"2024-04-19T03:36:00.867495+0000","last_undegraded":"2024-04-19T03:36:00.867495+0000","last_fullsized":"2024-04-19T03:36:00.867495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:19.283695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867804+0000","last_change":"2024-04-19T03:35:59.879270+0000","last_active":"2024-04-19T03:36:00.867804+0000","last_peered":"2024-04-19T03:36:00.867804+0000","last_clean":"2024-04-19T03:36:00.867804+0000","last_became_active":"2024-04-19T03:35:59.878554+0000","last_became_peered":"2024-04-19T03:35:59.878554+0000","last_unstale":"2024-04-19T03:36:00.867804+0000","last_undegraded":"2024-04-19T03:36:00.867804+0000","last_fullsized":"2024-04-19T03:36:00.867804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867631+0000","last_change":"2024-04-19T03:35:59.431379+0000","last_active":"2024-04-19T03:36:00.867631+0000","last_peered":"2024-04-19T03:36:00.867631+0000","last_clean":"2024-04-19T03:36:00.867631+0000","last_became_active":"2024-04-19T03:35:59.431065+0000","last_became_peered":"2024-04-19T03:35:59.431065+0000","last_unstale":"2024-04-19T03:36:00.867631+0000","last_undegraded":"2024-04-19T03:36:00.867631+0000","last_fullsized":"2024-04-19T03:36:00.867631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868460+0000","last_change":"2024-04-19T03:35:59.885989+0000","last_active":"2024-04-19T03:36:00.868460+0000","last_peered":"2024-04-19T03:36:00.868460+0000","last_clean":"2024-04-19T03:36:00.868460+0000","last_became_active":"2024-04-19T03:35:59.885765+0000","last_became_peered":"2024-04-19T03:35:59.885765+0000","last_unstale":"2024-04-19T03:36:00.868460+0000","last_undegraded":"2024-04-19T03:36:00.868460+0000","last_fullsized":"2024-04-19T03:36:00.868460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:35:34.459005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867795+0000","last_change":"2024-04-19T03:35:59.431967+0000","last_active":"2024-04-19T03:36:00.867795+0000","last_peered":"2024-04-19T03:36:00.867795+0000","last_clean":"2024-04-19T03:36:00.867795+0000","last_became_active":"2024-04-19T03:35:59.431521+0000","last_became_peered":"2024-04-19T03:35:59.431521+0000","last_unstale":"2024-04-19T03:36:00.867795+0000","last_undegraded":"2024-04-19T03:36:00.867795+0000","last_fullsized":"2024-04-19T03:36:00.867795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868517+0000","last_change":"2024-04-19T03:35:59.885527+0000","last_active":"2024-04-19T03:36:00.868517+0000","last_peered":"2024-04-19T03:36:00.868517+0000","last_clean":"2024-04-19T03:36:00.868517+0000","last_became_active":"2024-04-19T03:35:59.885186+0000","last_became_peered":"2024-04-19T03:35:59.885186+0000","last_unstale":"2024-04-19T03:36:00.868517+0000","last_undegraded":"2024-04-19T03:36:00.868517+0000","last_fullsized":"2024-04-19T03:36:00.868517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:29.870870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867777+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:36:00.867777+0000","last_peered":"2024-04-19T03:36:00.867777+0000","last_clean":"2024-04-19T03:36:00.867777+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:36:00.867777+0000","last_undegraded":"2024-04-19T03:36:00.867777+0000","last_fullsized":"2024-04-19T03:36:00.867777+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867975+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:36:00.867975+0000","last_peered":"2024-04-19T03:36:00.867975+0000","last_clean":"2024-04-19T03:36:00.867975+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:36:00.867975+0000","last_undegraded":"2024-04-19T03:36:00.867975+0000","last_fullsized":"2024-04-19T03:36:00.867975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867991+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:36:00.867991+0000","last_peered":"2024-04-19T03:36:00.867991+0000","last_clean":"2024-04-19T03:36:00.867991+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:36:00.867991+0000","last_undegraded":"2024-04-19T03:36:00.867991+0000","last_fullsized":"2024-04-19T03:36:00.867991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.874027+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:35:59.874027+0000","last_peered":"2024-04-19T03:35:59.874027+0000","last_clean":"2024-04-19T03:35:59.874027+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:35:59.874027+0000","last_undegraded":"2024-04-19T03:35:59.874027+0000","last_fullsized":"2024-04-19T03:35:59.874027+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.866975+0000","last_change":"2024-04-19T03:35:59.878242+0000","last_active":"2024-04-19T03:36:00.866975+0000","last_peered":"2024-04-19T03:36:00.866975+0000","last_clean":"2024-04-19T03:36:00.866975+0000","last_became_active":"2024-04-19T03:35:59.877991+0000","last_became_peered":"2024-04-19T03:35:59.877991+0000","last_unstale":"2024-04-19T03:36:00.866975+0000","last_undegraded":"2024-04-19T03:36:00.866975+0000","last_fullsized":"2024-04-19T03:36:00.866975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:59:22.544717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873236+0000","last_change":"2024-04-19T03:35:54.405842+0000","last_active":"2024-04-19T03:35:59.873236+0000","last_peered":"2024-04-19T03:35:59.873236+0000","last_clean":"2024-04-19T03:35:59.873236+0000","last_became_active":"2024-04-19T03:35:54.405465+0000","last_became_peered":"2024-04-19T03:35:54.405465+0000","last_unstale":"2024-04-19T03:35:59.873236+0000","last_undegraded":"2024-04-19T03:35:59.873236+0000","last_fullsized":"2024-04-19T03:35:59.873236+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:03.279704+0000","last_change":"2024-04-19T03:35:59.429504+0000","last_active":"2024-04-19T03:36:03.279704+0000","last_peered":"2024-04-19T03:36:03.279704+0000","last_clean":"2024-04-19T03:36:03.279704+0000","last_became_active":"2024-04-19T03:35:59.428445+0000","last_became_peered":"2024-04-19T03:35:59.428445+0000","last_unstale":"2024-04-19T03:36:03.279704+0000","last_undegraded":"2024-04-19T03:36:03.279704+0000","last_fullsized":"2024-04-19T03:36:03.279704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:23:36.587021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867969+0000","last_change":"2024-04-19T03:35:59.881612+0000","last_active":"2024-04-19T03:36:00.867969+0000","last_peered":"2024-04-19T03:36:00.867969+0000","last_clean":"2024-04-19T03:36:00.867969+0000","last_became_active":"2024-04-19T03:35:59.880798+0000","last_became_peered":"2024-04-19T03:35:59.880798+0000","last_unstale":"2024-04-19T03:36:00.867969+0000","last_undegraded":"2024-04-19T03:36:00.867969+0000","last_fullsized":"2024-04-19T03:36:00.867969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:40.745334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.863575+0000","last_change":"2024-04-19T03:35:54.404971+0000","last_active":"2024-04-19T03:35:59.863575+0000","last_peered":"2024-04-19T03:35:59.863575+0000","last_clean":"2024-04-19T03:35:59.863575+0000","last_became_active":"2024-04-19T03:35:54.404670+0000","last_became_peered":"2024-04-19T03:35:54.404670+0000","last_unstale":"2024-04-19T03:35:59.863575+0000","last_undegraded":"2024-04-19T03:35:59.863575+0000","last_fullsized":"2024-04-19T03:35:59.863575+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:47.049313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":210,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867265+0000","last_change":"2024-04-19T03:35:55.405560+0000","last_active":"2024-04-19T03:35:59.867265+0000","last_peered":"2024-04-19T03:35:59.867265+0000","last_clean":"2024-04-19T03:35:59.867265+0000","last_became_active":"2024-04-19T03:35:55.405342+0000","last_became_peered":"2024-04-19T03:35:55.405342+0000","last_unstale":"2024-04-19T03:35:59.867265+0000","last_undegraded":"2024-04-19T03:35:59.867265+0000","last_fullsized":"2024-04-19T03:35:59.867265+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:27.418444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867074+0000","last_change":"2024-04-19T03:35:59.430221+0000","last_active":"2024-04-19T03:36:00.867074+0000","last_peered":"2024-04-19T03:36:00.867074+0000","last_clean":"2024-04-19T03:36:00.867074+0000","last_became_active":"2024-04-19T03:35:59.429479+0000","last_became_peered":"2024-04-19T03:35:59.429479+0000","last_unstale":"2024-04-19T03:36:00.867074+0000","last_undegraded":"2024-04-19T03:36:00.867074+0000","last_fullsized":"2024-04-19T03:36:00.867074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868989+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:36:00.868989+0000","last_peered":"2024-04-19T03:36:00.868989+0000","last_clean":"2024-04-19T03:36:00.868989+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:36:00.868989+0000","last_undegraded":"2024-04-19T03:36:00.868989+0000","last_fullsized":"2024-04-19T03:36:00.868989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867797+0000","last_change":"2024-04-19T03:35:54.408755+0000","last_active":"2024-04-19T03:35:59.867797+0000","last_peered":"2024-04-19T03:35:59.867797+0000","last_clean":"2024-04-19T03:35:59.867797+0000","last_became_active":"2024-04-19T03:35:54.408501+0000","last_became_peered":"2024-04-19T03:35:54.408501+0000","last_unstale":"2024-04-19T03:35:59.867797+0000","last_undegraded":"2024-04-19T03:35:59.867797+0000","last_fullsized":"2024-04-19T03:35:59.867797+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:00.522853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867712+0000","last_change":"2024-04-19T03:35:59.432736+0000","last_active":"2024-04-19T03:36:00.867712+0000","last_peered":"2024-04-19T03:36:00.867712+0000","last_clean":"2024-04-19T03:36:00.867712+0000","last_became_active":"2024-04-19T03:35:59.432160+0000","last_became_peered":"2024-04-19T03:35:59.432160+0000","last_unstale":"2024-04-19T03:36:00.867712+0000","last_undegraded":"2024-04-19T03:36:00.867712+0000","last_fullsized":"2024-04-19T03:36:00.867712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:51.335488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868107+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:36:00.868107+0000","last_peered":"2024-04-19T03:36:00.868107+0000","last_clean":"2024-04-19T03:36:00.868107+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:36:00.868107+0000","last_undegraded":"2024-04-19T03:36:00.868107+0000","last_fullsized":"2024-04-19T03:36:00.868107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.867075+0000","last_change":"2024-04-19T03:35:54.405961+0000","last_active":"2024-04-19T03:35:59.867075+0000","last_peered":"2024-04-19T03:35:59.867075+0000","last_clean":"2024-04-19T03:35:59.867075+0000","last_became_active":"2024-04-19T03:35:54.405640+0000","last_became_peered":"2024-04-19T03:35:54.405640+0000","last_unstale":"2024-04-19T03:35:59.867075+0000","last_undegraded":"2024-04-19T03:35:59.867075+0000","last_fullsized":"2024-04-19T03:35:59.867075+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867408+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:36:00.867408+0000","last_peered":"2024-04-19T03:36:00.867408+0000","last_clean":"2024-04-19T03:36:00.867408+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:36:00.867408+0000","last_undegraded":"2024-04-19T03:36:00.867408+0000","last_fullsized":"2024-04-19T03:36:00.867408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868467+0000","last_change":"2024-04-19T03:35:59.885491+0000","last_active":"2024-04-19T03:36:00.868467+0000","last_peered":"2024-04-19T03:36:00.868467+0000","last_clean":"2024-04-19T03:36:00.868467+0000","last_became_active":"2024-04-19T03:35:59.885190+0000","last_became_peered":"2024-04-19T03:35:59.885190+0000","last_unstale":"2024-04-19T03:36:00.868467+0000","last_undegraded":"2024-04-19T03:36:00.868467+0000","last_fullsized":"2024-04-19T03:36:00.868467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:19.836137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.872489+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:35:59.872489+0000","last_peered":"2024-04-19T03:35:59.872489+0000","last_clean":"2024-04-19T03:35:59.872489+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:35:59.872489+0000","last_undegraded":"2024-04-19T03:35:59.872489+0000","last_fullsized":"2024-04-19T03:35:59.872489+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868035+0000","last_change":"2024-04-19T03:35:59.431391+0000","last_active":"2024-04-19T03:36:00.868035+0000","last_peered":"2024-04-19T03:36:00.868035+0000","last_clean":"2024-04-19T03:36:00.868035+0000","last_became_active":"2024-04-19T03:35:59.431063+0000","last_became_peered":"2024-04-19T03:35:59.431063+0000","last_unstale":"2024-04-19T03:36:00.868035+0000","last_undegraded":"2024-04-19T03:36:00.868035+0000","last_fullsized":"2024-04-19T03:36:00.868035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:43:07.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867786+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:36:00.867786+0000","last_peered":"2024-04-19T03:36:00.867786+0000","last_clean":"2024-04-19T03:36:00.867786+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:36:00.867786+0000","last_undegraded":"2024-04-19T03:36:00.867786+0000","last_fullsized":"2024-04-19T03:36:00.867786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.873656+0000","last_change":"2024-04-19T03:35:54.405542+0000","last_active":"2024-04-19T03:35:59.873656+0000","last_peered":"2024-04-19T03:35:59.873656+0000","last_clean":"2024-04-19T03:35:59.873656+0000","last_became_active":"2024-04-19T03:35:54.405292+0000","last_became_peered":"2024-04-19T03:35:54.405292+0000","last_unstale":"2024-04-19T03:35:59.873656+0000","last_undegraded":"2024-04-19T03:35:59.873656+0000","last_fullsized":"2024-04-19T03:35:59.873656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:37:36.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867907+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:36:00.867907+0000","last_peered":"2024-04-19T03:36:00.867907+0000","last_clean":"2024-04-19T03:36:00.867907+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:36:00.867907+0000","last_undegraded":"2024-04-19T03:36:00.867907+0000","last_fullsized":"2024-04-19T03:36:00.867907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868284+0000","last_change":"2024-04-19T03:35:59.879474+0000","last_active":"2024-04-19T03:36:00.868284+0000","last_peered":"2024-04-19T03:36:00.868284+0000","last_clean":"2024-04-19T03:36:00.868284+0000","last_became_active":"2024-04-19T03:35:59.878964+0000","last_became_peered":"2024-04-19T03:35:59.878964+0000","last_unstale":"2024-04-19T03:36:00.868284+0000","last_undegraded":"2024-04-19T03:36:00.868284+0000","last_fullsized":"2024-04-19T03:36:00.868284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:20.173075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-19T03:35:59.868556+0000","last_change":"2024-04-19T03:35:54.405958+0000","last_active":"2024-04-19T03:35:59.868556+0000","last_peered":"2024-04-19T03:35:59.868556+0000","last_clean":"2024-04-19T03:35:59.868556+0000","last_became_active":"2024-04-19T03:35:54.405578+0000","last_became_peered":"2024-04-19T03:35:54.405578+0000","last_unstale":"2024-04-19T03:35:59.868556+0000","last_undegraded":"2024-04-19T03:35:59.868556+0000","last_fullsized":"2024-04-19T03:35:59.868556+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:11.280110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868342+0000","last_change":"2024-04-19T03:35:59.433970+0000","last_active":"2024-04-19T03:36:00.868342+0000","last_peered":"2024-04-19T03:36:00.868342+0000","last_clean":"2024-04-19T03:36:00.868342+0000","last_became_active":"2024-04-19T03:35:59.433556+0000","last_became_peered":"2024-04-19T03:35:59.433556+0000","last_unstale":"2024-04-19T03:36:00.868342+0000","last_undegraded":"2024-04-19T03:36:00.868342+0000","last_fullsized":"2024-04-19T03:36:00.868342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:44.022207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868191+0000","last_change":"2024-04-19T03:35:59.879956+0000","last_active":"2024-04-19T03:36:00.868191+0000","last_peered":"2024-04-19T03:36:00.868191+0000","last_clean":"2024-04-19T03:36:00.868191+0000","last_became_active":"2024-04-19T03:35:59.879330+0000","last_became_peered":"2024-04-19T03:35:59.879330+0000","last_unstale":"2024-04-19T03:36:00.868191+0000","last_undegraded":"2024-04-19T03:36:00.868191+0000","last_fullsized":"2024-04-19T03:36:00.868191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:31.910918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867999+0000","last_change":"2024-04-19T03:35:59.432750+0000","last_active":"2024-04-19T03:36:00.867999+0000","last_peered":"2024-04-19T03:36:00.867999+0000","last_clean":"2024-04-19T03:36:00.867999+0000","last_became_active":"2024-04-19T03:35:59.432172+0000","last_became_peered":"2024-04-19T03:35:59.432172+0000","last_unstale":"2024-04-19T03:36:00.867999+0000","last_undegraded":"2024-04-19T03:36:00.867999+0000","last_fullsized":"2024-04-19T03:36:00.867999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868608+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:36:00.868608+0000","last_peered":"2024-04-19T03:36:00.868608+0000","last_clean":"2024-04-19T03:36:00.868608+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:36:00.868608+0000","last_undegraded":"2024-04-19T03:36:00.868608+0000","last_fullsized":"2024-04-19T03:36:00.868608+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868241+0000","last_change":"2024-04-19T03:35:59.434114+0000","last_active":"2024-04-19T03:36:00.868241+0000","last_peered":"2024-04-19T03:36:00.868241+0000","last_clean":"2024-04-19T03:36:00.868241+0000","last_became_active":"2024-04-19T03:35:59.433765+0000","last_became_peered":"2024-04-19T03:35:59.433765+0000","last_unstale":"2024-04-19T03:36:00.868241+0000","last_undegraded":"2024-04-19T03:36:00.868241+0000","last_fullsized":"2024-04-19T03:36:00.868241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867893+0000","last_change":"2024-04-19T03:35:59.876608+0000","last_active":"2024-04-19T03:36:00.867893+0000","last_peered":"2024-04-19T03:36:00.867893+0000","last_clean":"2024-04-19T03:36:00.867893+0000","last_became_active":"2024-04-19T03:35:59.875297+0000","last_became_peered":"2024-04-19T03:35:59.875297+0000","last_unstale":"2024-04-19T03:36:00.867893+0000","last_undegraded":"2024-04-19T03:36:00.867893+0000","last_fullsized":"2024-04-19T03:36:00.867893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868926+0000","last_change":"2024-04-19T03:35:59.432321+0000","last_active":"2024-04-19T03:36:00.868926+0000","last_peered":"2024-04-19T03:36:00.868926+0000","last_clean":"2024-04-19T03:36:00.868926+0000","last_became_active":"2024-04-19T03:35:59.431638+0000","last_became_peered":"2024-04-19T03:35:59.431638+0000","last_unstale":"2024-04-19T03:36:00.868926+0000","last_undegraded":"2024-04-19T03:36:00.868926+0000","last_fullsized":"2024-04-19T03:36:00.868926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867670+0000","last_change":"2024-04-19T03:35:59.877336+0000","last_active":"2024-04-19T03:36:00.867670+0000","last_peered":"2024-04-19T03:36:00.867670+0000","last_clean":"2024-04-19T03:36:00.867670+0000","last_became_active":"2024-04-19T03:35:59.876461+0000","last_became_peered":"2024-04-19T03:35:59.876461+0000","last_unstale":"2024-04-19T03:36:00.867670+0000","last_undegraded":"2024-04-19T03:36:00.867670+0000","last_fullsized":"2024-04-19T03:36:00.867670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868151+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:36:00.868151+0000","last_peered":"2024-04-19T03:36:00.868151+0000","last_clean":"2024-04-19T03:36:00.868151+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:36:00.868151+0000","last_undegraded":"2024-04-19T03:36:00.868151+0000","last_fullsized":"2024-04-19T03:36:00.868151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868264+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:36:00.868264+0000","last_peered":"2024-04-19T03:36:00.868264+0000","last_clean":"2024-04-19T03:36:00.868264+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:36:00.868264+0000","last_undegraded":"2024-04-19T03:36:00.868264+0000","last_fullsized":"2024-04-19T03:36:00.868264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868040+0000","last_change":"2024-04-19T03:35:59.429171+0000","last_active":"2024-04-19T03:36:00.868040+0000","last_peered":"2024-04-19T03:36:00.868040+0000","last_clean":"2024-04-19T03:36:00.868040+0000","last_became_active":"2024-04-19T03:35:59.428837+0000","last_became_peered":"2024-04-19T03:35:59.428837+0000","last_unstale":"2024-04-19T03:36:00.868040+0000","last_undegraded":"2024-04-19T03:36:00.868040+0000","last_fullsized":"2024-04-19T03:36:00.868040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:07:21.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867627+0000","last_change":"2024-04-19T03:35:59.880260+0000","last_active":"2024-04-19T03:36:00.867627+0000","last_peered":"2024-04-19T03:36:00.867627+0000","last_clean":"2024-04-19T03:36:00.867627+0000","last_became_active":"2024-04-19T03:35:59.879086+0000","last_became_peered":"2024-04-19T03:35:59.879086+0000","last_unstale":"2024-04-19T03:36:00.867627+0000","last_undegraded":"2024-04-19T03:36:00.867627+0000","last_fullsized":"2024-04-19T03:36:00.867627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867442+0000","last_change":"2024-04-19T03:35:59.880550+0000","last_active":"2024-04-19T03:36:00.867442+0000","last_peered":"2024-04-19T03:36:00.867442+0000","last_clean":"2024-04-19T03:36:00.867442+0000","last_became_active":"2024-04-19T03:35:59.879772+0000","last_became_peered":"2024-04-19T03:35:59.879772+0000","last_unstale":"2024-04-19T03:36:00.867442+0000","last_undegraded":"2024-04-19T03:36:00.867442+0000","last_fullsized":"2024-04-19T03:36:00.867442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867115+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:36:00.867115+0000","last_peered":"2024-04-19T03:36:00.867115+0000","last_clean":"2024-04-19T03:36:00.867115+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:36:00.867115+0000","last_undegraded":"2024-04-19T03:36:00.867115+0000","last_fullsized":"2024-04-19T03:36:00.867115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868363+0000","last_change":"2024-04-19T03:35:59.881028+0000","last_active":"2024-04-19T03:36:00.868363+0000","last_peered":"2024-04-19T03:36:00.868363+0000","last_clean":"2024-04-19T03:36:00.868363+0000","last_became_active":"2024-04-19T03:35:59.880088+0000","last_became_peered":"2024-04-19T03:35:59.880088+0000","last_unstale":"2024-04-19T03:36:00.868363+0000","last_undegraded":"2024-04-19T03:36:00.868363+0000","last_fullsized":"2024-04-19T03:36:00.868363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:43:52.418012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.867632+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:36:00.867632+0000","last_peered":"2024-04-19T03:36:00.867632+0000","last_clean":"2024-04-19T03:36:00.867632+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:36:00.867632+0000","last_undegraded":"2024-04-19T03:36:00.867632+0000","last_fullsized":"2024-04-19T03:36:00.867632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-19T03:36:00.868762+0000","last_change":"2024-04-19T03:35:59.882281+0000","last_active":"2024-04-19T03:36:00.868762+0000","last_peered":"2024-04-19T03:36:00.868762+0000","last_clean":"2024-04-19T03:36:00.868762+0000","last_became_active":"2024-04-19T03:35:59.880757+0000","last_became_peered":"2024-04-19T03:35:59.880757+0000","last_unstale":"2024-04-19T03:36:00.868762+0000","last_undegraded":"2024-04-19T03:36:00.868762+0000","last_fullsized":"2024-04-19T03:36:00.868762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:31.795998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":641759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":757760,"data_stored":641143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":49645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:36:17.878 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T03:36:17.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-19T03:36:18.279 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 16 2024-04-19T03:36:18.279 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 094bb330-e26a-42d1-b1be-7931c5493f05 2024-04-19T03:36:18.279 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-19T03:35:44.411658+0000 2024-04-19T03:36:18.279 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-19T03:36:00.861407+0000 2024-04-19T03:36:18.279 INFO:teuthology.orchestra.run.smithi005.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-19T03:36:18.279 INFO:teuthology.orchestra.run.smithi005.stdout:crush_version 4 2024-04-19T03:36:18.279 INFO:teuthology.orchestra.run.smithi005.stdout:full_ratio 0.95 2024-04-19T03:36:18.279 INFO:teuthology.orchestra.run.smithi005.stdout:backfillfull_ratio 0.9 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:nearfull_ratio 0.85 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:require_min_compat_client luminous 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:min_compat_client jewel 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:require_osd_release reef 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:stretch_mode_enabled false 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:pool 2 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:max_osd 3 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6800/40323,v1:172.21.15.57:6801/40323] [v2:172.21.15.57:6802/40323,v1:172.21.15.57:6803/40323] exists,up a7e36406-63c4-4d90-9e2d-6418a6750ec1 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6800/40278,v1:172.21.15.87:6801/40278] [v2:172.21.15.87:6802/40278,v1:172.21.15.87:6803/40278] exists,up 098c6748-6099-4f21-8443-fa1806e634c1 2024-04-19T03:36:18.280 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6800/40482,v1:172.21.15.129:6801/40482] [v2:172.21.15.129:6802/40482,v1:172.21.15.129:6803/40482] exists,up 05fd0106-3888-443d-b028-e3735dc03df0 2024-04-19T03:36:18.295 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6800/40323,v1:172.21.15.57:6801/40323] [v2:172.21.15.57:6802/40323,v1:172.21.15.57:6803/40323] exists,up a7e36406-63c4-4d90-9e2d-6418a6750ec1', 'osd.1 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6800/40278,v1:172.21.15.87:6801/40278] [v2:172.21.15.87:6802/40278,v1:172.21.15.87:6803/40278] exists,up 098c6748-6099-4f21-8443-fa1806e634c1', 'osd.2 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6800/40482,v1:172.21.15.129:6801/40482] [v2:172.21.15.129:6802/40482,v1:172.21.15.129:6803/40482] exists,up 05fd0106-3888-443d-b028-e3735dc03df0'] 2024-04-19T03:36:18.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-19T03:36:18.433 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-19T03:36:18.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mon.a", 2024-04-19T03:36:18.433 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster": "ceph", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "admin_socket_mode": "", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_client_required": "cephx, none", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_cluster_required": "cephx", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_debug": "true", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_service_required": "cephx", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_supported": "cephx", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_aio": "true", 2024-04-19T03:36:18.434 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_aio_poll_ms": "250", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_aio_reap_max": "16", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_async_discard": "false", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_block_size": "4096", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_debug_aio": "false", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_debug_inflight_ios": "false", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_enable_discard": "false", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_flock_retry": "3", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_inject_crash": "0", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-19T03:36:18.435 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_ioring": "false", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_ioring_hipri": "false", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_type": "", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_alloc_size": "1048576", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_allocator": "hybrid", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_buffered_io": "true", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_check_for_zeros": "false", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_compact_log_sync": "false", 2024-04-19T03:36:18.436 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_max_log_runway": "4194304", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_max_prefetch": "1048576", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_min_flush_size": "524288", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_min_log_runway": "1048576", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_replay_recovery": "false", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_sync_write": "false", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-19T03:36:18.437 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_allocation_from_file": "true", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_allocator": "hybrid", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_create": "true", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_db_create": "false", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_db_path": "", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_db_size": "0", 2024-04-19T03:36:18.438 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_path": "", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_preallocate_file": "false", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_size": "107374182400", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_wal_create": "false", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_wal_path": "", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_wal_size": "100663296", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bluefs": "true", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T03:36:18.439 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_autotune": "true", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_size": "0", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_type": "2q", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_clone_cow": "true", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-19T03:36:18.440 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_mode": "none", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_csum_type": "crc32c", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_freelist": "false", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-19T03:36:18.441 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_small_allocations": "0", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_default_buffered_read": "true", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_default_buffered_write": "false", 2024-04-19T03:36:18.442 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fail_eio": "false", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-19T03:36:18.443 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_mount": "false", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_umount": "false", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_ignore_data_csum": "false", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-19T03:36:18.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_log_op_age": "5.000000", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_alloc_size": "0", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_blob_size": "0", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_deferred_txc": "32", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_min_alloc_size": "0", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_nid_prealloc": "1024", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-19T03:36:18.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_retry_disk_reads": "3", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_rocksdb_cf": "true", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_spdk_mem": "512", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-19T03:36:18.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_tracing": "false", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-19T03:36:18.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_zero_block_detection": "false", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-19T03:36:18.448 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_cluster_require_signatures": "false", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_cluster_require_version": "2", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_require_signatures": "false", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_require_version": "2", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_service_require_signatures": "false", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_service_require_version": "2", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_sign_messages": "true", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "chdir": "", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "client_acl_type": "", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "client_asio_thread_count": "2", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "client_cache_mid": "0.750000", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "client_cache_size": "16384", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "client_caps_release_delay": "5", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "client_check_pool_perm": "true", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-19T03:36:18.449 INFO:teuthology.orchestra.run.smithi005.stdout: "client_debug_force_sync_read": "false", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_debug_getattr_caps": "false", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_debug_inject_tick_delay": "0", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_die_on_failed_remount": "false", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_dirsize_rbytes": "true", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_force_lazyio": "false", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_fs": "", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_inject_release_failure": "false", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_max_inline_size": "4096", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mds_namespace": "", 2024-04-19T03:36:18.450 INFO:teuthology.orchestra.run.smithi005.stdout: "client_metadata": "", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mount_gid": "-1", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mount_timeout": "300", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mount_uid": "-1", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mountpoint": "/", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_notify_timeout": "10", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc": "true", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_max_dirty": "104857600", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_max_objects": "1000", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_size": "209715200", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_target_dirty": "8388608", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_permissions": "true", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_quota": "true", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_quota_df": "true", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_readahead_max_bytes": "0", 2024-04-19T03:36:18.451 INFO:teuthology.orchestra.run.smithi005.stdout: "client_readahead_max_periods": "4", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "client_readahead_min": "131072", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "client_reconnect_stale": "false", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "client_shutdown_timeout": "30", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "client_snapdir": ".snap", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "client_tick_interval": "1", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "client_trace": "", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "client_try_dentry_invalidate": "false", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "client_use_faked_inos": "false", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "client_use_random_mds": "false", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_graylog": "false", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_graylog_port": "12201", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_monitors": "default=true", 2024-04-19T03:36:18.452 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_syslog": "false", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_syslog_level": "info", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "-", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_network": "", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_network_interface": "", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "compressor_zlib_isal": "false", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "compressor_zlib_level": "5", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "compressor_zlib_winsize": "-15", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "compressor_zstd_level": "1", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_alien_op_num_threads": "6", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-19T03:36:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_seastar_smp": "1", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location_hook": "", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location_hook_timeout": "10", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "daemonize": "false", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "daos_pool": "tank", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-19T03:36:18.454 INFO:teuthology.orchestra.run.smithi005.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_alienstore": "0/5", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_allow_any_pool_priority": "false", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_asok": "1/5", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_asok_assert_abort": "false", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_asserts_on_shutdown": "true", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_auth": "20/20", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_bdev": "1/3", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_bluefs": "1/5", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_bluestore": "1/5", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_buffer": "0/1", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_ceph_exporter": "1/5", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_cephfs_mirror": "0/5", 2024-04-19T03:36:18.455 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_cephsqlite": "0/5", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_client": "0/5", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_compressor": "1/5", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_context": "0/1", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_crush": "1/1", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_crypto": "1/5", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_cyanstore": "0/5", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_deliberately_leak_memory": "false", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_disable_randomized_ping": "false", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_dpdk": "1/5", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_eventtrace": "1/5", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_filer": "0/1", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_filestore": "1/3", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_finisher": "1/1", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_fuse": "1/5", 2024-04-19T03:36:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_heartbeat_testing_span": "0", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_heartbeatmap": "1/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_javaclient": "1/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_journal": "1/3", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_journaler": "0/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_kstore": "1/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_leveldb": "4/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_lockdep": "0/1", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mclock": "1/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds": "1/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_balancer": "1/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_locker": "1/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_log": "1/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_log_expire": "1/5", 2024-04-19T03:36:18.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_migrator": "1/5", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_memstore": "1/5", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mgr": "2/5", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mgrc": "1/5", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mon": "20/20", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_monc": "0/10", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_ms": "1/1", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_none": "0/5", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_objclass": "0/5", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_objectcacher": "0/5", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_objecter": "0/1", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_optracker": "0/5", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_osd": "1/5", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_paxos": "20/20", 2024-04-19T03:36:18.458 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_perfcounter": "1/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_prioritycache": "1/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rados": "0/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rbd": "0/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rbd_mirror": "0/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rbd_pwl": "0/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rbd_replay": "0/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_refs": "0/0", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_reserver": "1/1", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw": "1/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_access": "1/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_datacache": "1/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_dbstore": "1/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_flight": "1/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_sync": "1/5", 2024-04-19T03:36:18.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rocksdb": "4/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_backref": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_cache": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_cleaner": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_device": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_epm": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_journal": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_lba": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_odata": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_omap": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_onode": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_t": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_tm": "0/5", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_striper": "0/1", 2024-04-19T03:36:18.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_test": "0/5", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_throttle": "1/1", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_timer": "0/1", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_tp": "0/5", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "device_failure_prediction_mode": "none", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "err_to_graylog": "false", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "err_to_journald": "false", 2024-04-19T03:36:18.461 INFO:teuthology.orchestra.run.smithi005.stdout: "err_to_stderr": "true", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "err_to_syslog": "false", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event_tracing": "false", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_addr": "0.0.0.0", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_http_port": "9926", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_prio_limit": "5", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_sort_metrics": "true", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_stats_period": "5", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "fake_statfs_for_testing": "0", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "fatal_signal_handlers": "true", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "filer_max_purge_ops": "10", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "filer_max_truncate_ops": "128", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_apply_finisher_threads": "1", 2024-04-19T03:36:18.462 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_blackhole": "false", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_btrfs_clone_range": "true", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_btrfs_snap": "true", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_caller_concurrency": "10", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_collect_device_partition_information": "true", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_commit_timeout": "600.000000", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_debug_inject_read_err": "false", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_debug_omap_check": "false", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_debug_verify_split": "false", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_dump_file": "", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fadvise": "true", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fail_eio": "true", 2024-04-19T03:36:18.463 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fd_cache_shards": "16", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fd_cache_size": "128", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fiemap": "false", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fiemap_threshold": "4096", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_inject_stall": "0", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_journal_parallel": "false", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_journal_trailing": "false", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_journal_writeahead": "false", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_kill_at": "0", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-19T03:36:18.464 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattrs": "0", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_xattr_value_size": "0", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_merge_threshold": "-10", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_odsync_write": "false", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_omap_backend": "rocksdb", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_omap_backend_path": "", 2024-04-19T03:36:18.465 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_op_thread_timeout": "60", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_op_threads": "2", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_punch_hole": "false", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-19T03:36:18.466 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_ops": "50", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_seek_data_hole": "false", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_sloppy_crc": "false", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_splice": "false", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_split_multiple": "2", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_split_rand_factor": "20", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_update_to": "1000", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-19T03:36:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_enable": "true", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_xfs_extsize": "false", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_zfs_snap": "false", 2024-04-19T03:36:18.468 INFO:teuthology.orchestra.run.smithi005.stdout: "fio_dir": "/tmp/fio", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "094bb330-e26a-42d1-b1be-7931c5493f05", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_allow_other": "true", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_atomic_o_trunc": "true", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_big_writes": "true", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_debug": "false", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_default_permissions": "false", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_disable_pagecache": "false", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_max_write": "0", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_multithreaded": "true", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_require_active_mds": "true", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_set_user_groups": "true", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_splice_move": "true", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_splice_read": "true", 2024-04-19T03:36:18.469 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_splice_write": "true", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_use_invalidate_cb": "true", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "gss_target_name": "ceph", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_file": "", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_inject_failure": "0", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_interval": "5", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "host": "smithi005", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-19T03:36:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "inject_early_sigterm": "false", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "jaeger_agent_port": "6799", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "jaeger_tracing_enable": "false", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_aio": "true", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_align_min_size": "65536", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_block_align": "true", 2024-04-19T03:36:18.471 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_block_size": "4096", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_dio": "true", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_discard": "false", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_force_aio": "false", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_ignore_corruption": "false", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_max_write_bytes": "10485760", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_max_write_entries": "100", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_replay_from": "0", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_write_header_frequency": "0", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_zero_on_create": "false", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journaler_prefetch_periods": "10", 2024-04-19T03:36:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: "journaler_prezero_periods": "5", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "journaler_write_head_interval": "15", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "keyfile": "", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_backend": "rocksdb", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_default_stripe_size": "65536", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_fsck_on_mount": "false", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_max_bytes": "67108864", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_max_ops": "512", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_nid_prealloc": "1024", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_onode_map_size": "1024", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_sync_submit_transaction": "false", 2024-04-19T03:36:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_sync_transaction": "false", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_block_size": "65536", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_bloom_size": "0", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_cache_size": "536870912", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_compact_on_mount": "false", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_compression": "false", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_log": "", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_max_open_files": "0", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_paranoid": "false", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "librados_thread_count": "2", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "lockdep": "false", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "lockdep_force_backtrace": "false", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "log_coarse_timestamps": "true", 2024-04-19T03:36:18.474 INFO:teuthology.orchestra.run.smithi005.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_flush_on_exit": "false", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_graylog_host": "127.0.0.1", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_graylog_port": "12201", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_max_new": "1000", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_max_recent": "10000", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_stderr_prefix": "", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_stop_at_utilization": "0.970000", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": "true", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_graylog": "false", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_journald": "false", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_stderr": "false", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_syslog": "false", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "max_rotating_auth_attempts": "10", 2024-04-19T03:36:18.475 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_action_on_write_error": "1", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_alternate_name_max": "8192", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_asio_thread_count": "2", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_export_pin": "true", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_fragment_dirs": "true", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_fragment_interval": "5", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_interval": "10", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_max": "-1", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_max_until": "-1", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_merge_size": "50", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_midchunk": "0.300000", 2024-04-19T03:36:18.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_min_start": "0.200000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_minchunk": "0.001000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_mode": "0", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_need_max": "1.200000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_need_min": "0.800000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_split_bits": "3", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_split_size": "10000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_target_decay": "10.000000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_beacon_grace": "15.000000", 2024-04-19T03:36:18.477 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_beacon_interval": "4.000000", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_mid": "0.700000", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_release_free_interval": "10", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_reservation": "0.050000", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_trim_interval": "1", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_trim_threshold": "262144", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_client_prealloc_inos": "1000", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-19T03:36:18.478 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_connect_bootstrapping": "false", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_damage_table_max_entries": "10000", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_debug_auth_pins": "false", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_debug_frag": "false", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_debug_scatterstat": "false", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_debug_subtrees": "false", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_decay_halflife": "5.000000", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_default_dir_hash": "2", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_defer_session_stale": "true", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_deny_all_reconnect": "false", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dir_keys_per_op": "16384", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dir_max_commit_size": "10", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dir_max_entries": "0", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dir_prefetch": "true", 2024-04-19T03:36:18.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dump_cache_on_map": "false", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_early_reply": "true", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_enable_op_tracker": "true", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_enforce_unique_name": "true", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_export_ephemeral_random": "true", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-19T03:36:18.480 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_health_summarize_threshold": "10", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_health_dummy": "false", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_migrator_session_race": "false", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_join_fs": "", 2024-04-19T03:36:18.481 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_journal_format": "1", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_create_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_export_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_import_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_journal_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_journal_expire_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_journal_replay_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_link_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_mdstable_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_openc_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_rename_at": "0", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_events_per_segment": "1024", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_max_events": "-1", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_max_segments": "128", 2024-04-19T03:36:18.482 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_pause": "false", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_segment_size": "0", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_warn_factor": "2.000000", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_caps_per_client": "1048576", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_completed_flushes": "100000", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_completed_requests": "100000", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_export_size": "20971520", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_file_recover": "32", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_purge_files": "64", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_purge_ops": "8192", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_snaps_per_dir": "100", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_metrics_update_interval": "2", 2024-04-19T03:36:18.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_min_caps_per_client": "100", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_min_caps_working_set": "10000", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_numa_node": "-1", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_complaint_time": "30.000000", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_history_duration": "600", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_history_size": "20", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_history_slow_op_size": "20", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_log_threshold": "5", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_ping_grace": "15", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_ping_interval": "5", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-19T03:36:18.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_max_caps": "30000", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_warning_threshold": "262144", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_replay_interval": "1.000000", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_root_ino_gid": "0", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_root_ino_uid": "0", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-19T03:36:18.485 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_shutdown_check": "0", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_skip_ino": "0", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_snap_max_uid": "4294967294", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_snap_min_uid": "0", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_snap_rstat": "false", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_standby_replay_damaged": "false", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_symlink_recovery": "true", 2024-04-19T03:36:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_thrash_exports": "0", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_thrash_fragments": "0", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_tick_interval": "5.000000", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_valgrind_exit": "false", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_verify_backtrace": "1", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_verify_scatter": "false", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_wipe_sessions": "false", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool_debug": "false", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "memstore_device_bytes": "1073741824", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "memstore_page_set": "false", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "memstore_page_size": "65536", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_client_bytes": "134217728", 2024-04-19T03:36:18.487 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_client_messages": "512", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_disabled_modules": "", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_max_pg_num_change": "128", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_mds_bytes": "134217728", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_mds_messages": "128", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_mon_bytes": "134217728", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_mon_messages": "128", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_osd_bytes": "536870912", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_osd_messages": "8192", 2024-04-19T03:36:18.488 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_pool": "true", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_standby_modules": "true", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_stats_period": "5", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_stats_threshold": "5", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_tick_period": "2", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_allow_pool_delete": "true", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_allow_pool_size_one": "true", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_auth_validate_all_caps": "true", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_bytes": "104857600", 2024-04-19T03:36:18.489 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_directed_command_retry": "2", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_parallel": "3", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_log_interval": "1.000000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_ping_interval": "10.000000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_file_level": "debug", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_file": "true", 2024-04-19T03:36:18.490 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_journald": "false", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_compact_on_bootstrap": "false", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_compact_on_start": "false", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_compact_on_trim": "true", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cpu_threads": "4", 2024-04-19T03:36:18.491 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_crush_min_required_version": "hammer", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_daemon_bytes": "419430400", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_data_avail_crit": "5", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_data_avail_warn": "5", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_data_size_warn": "16106127360", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_dump_json": "false", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_dump_transactions": "false", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_extra_checks": "false", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_no_require_quincy": "false", 2024-04-19T03:36:18.492 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_no_require_reef": "false", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_down_mkfs_grace": "120", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_election_default_strategy": "1", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_election_timeout": "5.000000", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_elector_ping_divisor": "2", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_enable_op_tracker": "true", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_fake_pool_delete": "false", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_force_quorum_join": "false", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_globalid_prealloc": "10000", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_detail_to_clog": "false", 2024-04-19T03:36:18.493 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_log_update_period": "5", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_max_detail": "50", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_to_clog": "true", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_to_clog_interval": "600", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_host": "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],[v2:172.21.15.5:3302,v1:172.21.15.5:6791]", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_host_override": "", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_initial_members": "", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_lease": "5.000000", 2024-04-19T03:36:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_log_full_interval": "50", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_log_max": "10000", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_log_max_summary": "50", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_log_epochs": "500", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_osd": "10000", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_pg_per_osd": "10000", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_pool_pg_num": "65536", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mds_force_trim_to": "0", 2024-04-19T03:36:18.495 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mds_skip_sanity": "false", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_memory_autotune": "true", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_memory_target": "2147483648", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_beacon_grace": "30", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_digest_period": "5", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_inactive_grace": "60", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_min_osdmap_epochs": "500", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_complaint_time": "30", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_history_duration": "600", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_history_size": "20", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_history_slow_op_size": "20", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-19T03:36:18.496 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_log_threshold": "5", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_auto_mark_in": "false", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_cache_size": "500", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_down_out_interval": "600", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-19T03:36:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_force_trim_to": "0", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_min_down_reporters": "2", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-19T03:36:18.498 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_report_timeout": "900", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_stuck_threshold": "60", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-19T03:36:18.499 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_probe_timeout": "2.000000", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_reweight_max_change": "0.050000", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_reweight_max_osds": "4", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_interval": "86400", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_max_keys": "100", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_timeout": "300", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_session_timeout": "300", 2024-04-19T03:36:18.500 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_smart_report_timeout": "5", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stat_smooth_intervals": "6", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stretch_pool_min_size": "2", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stretch_pool_size": "4", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_debug": "false", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_provider_kill_at": "0", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_requester_kill_at": "0", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_timeout": "60.000000", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_target_pg_per_osd": "100", 2024-04-19T03:36:18.501 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_tick_interval": "5", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_timecheck_interval": "300.000000", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_use_min_delay_socket": "false", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_older_version_delay": "604800", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_misplaced": "false", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_older_version": "true", 2024-04-19T03:36:18.502 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": "", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-19T03:36:18.503 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_tracing_enabled": "false", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_op_threads": "3", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_cm": "false", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_device_name": "", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_dscp": "96", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_local_gid": "", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_port_num": "1", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-19T03:36:18.504 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_sl": "3", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_support_srq": "true", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_type": "ib", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_reap_threshold": "5", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_before_connect": "false", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_ipv4": "true", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_ipv6": "false", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_msgr1": "true", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_msgr2": "true", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_port_max": "7568", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_port_min": "6800", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-19T03:36:18.505 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_retry_count": "3", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_retry_delay": "5", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_client": "false", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_mds": "false", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_mgr": "false", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_mon": "false", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_osd": "false", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_client_mode": "crc secure", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_cluster_mode": "crc secure", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_cluster_type": "", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_compress_secure": "false", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_connection_idle_timeout": "900", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_connection_ready_timeout": "10", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_crc_data": "true", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_crc_header": "true", 2024-04-19T03:36:18.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_bad_msg": "false", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_bug": "true", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_old_message": "true", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_skipped_message": "false", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_coremask": "0xF", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_enable_tso": "true", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_hugepages": "", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-19T03:36:18.507 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_lro": "true", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_memory_channel": "4", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_pmd": "", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_port_id": "0", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dump_on_send": "false", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_initial_backoff": "0.200000", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_delay_max": "1.000000", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_delay_type": "", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_network_congestion": "0", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_socket_failures": "0", 2024-04-19T03:36:18.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_learn_addr_from_peer": "true", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_max_accept_failures": "4", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_max_backoff": "15.000000", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_mon_client_mode": "secure crc", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_mon_service_mode": "secure crc", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_osd_compress_min_size": "1024", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_osd_compress_mode": "none", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_pq_min_cost": "65536", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_public_type": "", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_service_mode": "crc secure", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_tcp_listen_backlog": "512", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_tcp_nodelay": "true", 2024-04-19T03:36:18.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_tcp_rcvbuf": "0", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_type": "async+posix", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "no_config_file": "false", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_completion_locks_per_session": "32", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_inflight_ops": "1024", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_tick_interval": "5.000000", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_timeout": "10.000000", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "objectstore_blackhole": "false", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "openssl_engine_opts": "", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_delay_time": "5.000000", 2024-04-19T03:36:18.510 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_hist_halflife": "1000", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_max_low_ops": "2", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_max_ops": "4", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_slop": "0.020000", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_asio_thread_count": "2", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_async_recovery_min_cost": "100", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backfill_scan_max": "512", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backfill_scan_min": "64", 2024-04-19T03:36:18.511 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backoff_on_degraded": "false", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backoff_on_peering": "false", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backoff_on_unfound": "true", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_beacon_report_interval": "300", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bench_duration": "30", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bench_max_block_size": "67108864", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_blkin_trace_all": "false", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_check_for_log_corruption": "false", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T03:36:18.512 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_class_update_on_start": "true", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_client_message_cap": "256", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_client_message_size_cap": "524288000", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_client_op_priority": "63", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_client_watch_timeout": "30", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_command_max_records": "256", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_compact_on_start": "false", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_crush_update_on_start": "true", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_crush_update_weight_set": "true", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-19T03:36:18.513 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_feed_pullee": "-1", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_misdirected_ops": "false", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_no_acting_change": "false", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_no_purge_strays": "false", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_op_order": "false", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-19T03:36:18.514 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_shutdown": "false", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_verify_snaps": "false", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_keys": "1024", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-19T03:36:18.515 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_stride": "524288", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_default_notify_timeout": "30", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_delete_sleep": "0.000000", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_discard_disconnected_ops": "true", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_enable_op_tracker": "true", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_info": "true", 2024-04-19T03:36:18.516 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_shutdown": "true", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_function_tracing": "false", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_grace": "20", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_interval": "6", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_min_peers": "10", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_min_size": "2000", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_stale": "600", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_hit_set_max_size": "100000", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_hit_set_min_size": "1000", 2024-04-19T03:36:18.517 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_journal_size": "5120", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_kill_backfill_at": "0", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_cache_size": "50", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_dedup": "true", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_message_max": "40", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_share_max_epochs": "40", 2024-04-19T03:36:18.518 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_attr_name_len": "100", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_attr_size": "0", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_backfills": "1", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_markdown_count": "5", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_markdown_period": "600", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_object_name_len": "2048", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_object_namespace_len": "256", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_object_size": "134217728", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_pg_blocked_by": "16", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_pg_log_entries": "10000", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_pgls": "1024", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_push_cost": "8388608", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_push_objects": "10", 2024-04-19T03:36:18.519 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_scrubs": "3", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_trimming_pgs": "2", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_write_op_reply_len": "64", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_write_size": "90", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_profile": "balanced", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-19T03:36:18.520 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_base": "805306368", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_cache_min": "134217728", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_target": "4294967296", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_target_autotune": "false", 2024-04-19T03:36:18.521 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_min_pg_log_entries": "250", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_min_recovery_priority": "0", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_report_interval": "5", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_num_cache_shards": "32", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_num_op_tracker_shard": "32", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_numa_auto_affinity": "true", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_numa_node": "-1", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_numa_prefer_iface": "true", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-19T03:36:18.522 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_objecter_finishers": "1", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_objectstore": "bluestore", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_objectstore_fuse": "false", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_objectstore_tracing": "false", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_complaint_time": "30.000000", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_history_duration": "600", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_history_size": "20", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_history_slow_op_size": "20", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_log_threshold": "5", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_shards": "0", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_shards_hdd": "5", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_shards_ssd": "8", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-19T03:36:18.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_pq_min_cost": "65536", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_queue_cut_off": "high", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_thread_timeout": "15", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_open_classes_on_start": "true", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_os_flags": "0", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_peering_op_priority": "255", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_delete_cost": "1048576", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_delete_priority": "5", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_log_dups_tracked": "10000", 2024-04-19T03:36:18.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_log_trim_max": "10000", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_log_trim_min": "100", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_crimson": "false", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-19T03:36:18.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flags": "0", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_min_size": "0", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_pg_num": "32", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_pgp_num": "0", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_size": "2", 2024-04-19T03:36:18.526 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_type": "replicated", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_push_per_object_cost": "1000", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recover_clone_overlap": "true", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_cost": "20971520", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_active": "0", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-19T03:36:18.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_single_start": "1", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_op_priority": "3", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_priority": "5", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_sleep": "0.000000", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_repair_during_recovery": "false", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_requested_scrub_priority": "120", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_auto_repair": "false", 2024-04-19T03:36:18.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_begin_hour": "0", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_begin_week_day": "0", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_chunk_max": "25", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_chunk_min": "5", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_cost": "52428800", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_during_recovery": "false", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_end_hour": "0", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_end_week_day": "0", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_event_cost": "4096", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_invalid_stats": "true", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-19T03:36:18.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_max_preemptions": "5", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_priority": "5", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_sleep": "0.000000", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_skip_data_digest": "false", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_smart_report_timeout": "5", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_cost": "1048576", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_priority": "5", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-19T03:36:18.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_target_transaction_size": "30", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-19T03:36:18.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tracing": "false", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_use_stale_snap": "false", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "osdc_blkin_trace_all": "false", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_kill_at": "0", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_max_join_drift": "10", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_min": "500", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_min_wait": "0.050000", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_propose_interval": "1.000000", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_service_trim_max": "500", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_service_trim_min": "250", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_stash_full_interval": "25", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_trim_max": "500", 2024-04-19T03:36:18.532 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_trim_min": "250", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "perf": "true", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "-", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrv": "", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "public_bind_addr": "-", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "public_network": "", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "public_network_interface": "", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "qat_compressor_enabled": "false", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "qat_compressor_session_max_number": "256", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "rados_mon_op_timeout": "0", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "rados_osd_op_timeout": "0", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "rados_tracing": "false", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_atime_update_interval": "60", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-19T03:36:18.533 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_balance_parent_reads": "false", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_balance_snap_reads": "false", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_blkin_trace_all": "false", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache": "true", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_policy": "writearound", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_size": "33554432", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_clone_copy_on_read": "false", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_compression_hint": "none", 2024-04-19T03:36:18.534 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_concurrent_management_ops": "10", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_clone_format": "auto", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_data_pool": "", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_features": "61", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_format": "2", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_map_options": "", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_order": "22", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_pool": "rbd", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_stripe_count": "0", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_stripe_unit": "0", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-19T03:36:18.535 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_enable_alloc_hint": "true", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_io_scheduler": "simple", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_order": "24", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_pool": "", 2024-04-19T03:36:18.536 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_splay_width": "4", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_localize_parent_reads": "false", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_localize_snap_reads": "false", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-19T03:36:18.537 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-19T03:36:18.538 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mtime_update_interval": "60", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_non_blocking_aio": "true", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_op_thread_timeout": "60", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_op_threads": "1", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_parent_cache_enabled": "false", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_plugins": "", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_bps_burst": "0", 2024-04-19T03:36:18.539 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_bps_limit": "0", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_exclude_ops": "0", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_iops_burst": "0", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_iops_limit": "0", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-19T03:36:18.540 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_read_from_replica_policy": "default", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_skip_partial_discard": "true", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_tracing": "false", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_validate_names": "true", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_validate_pool": "true", 2024-04-19T03:36:18.541 INFO:teuthology.orchestra.run.smithi005.stdout: "restapi_base_url": "", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "restapi_log_level": "", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_acl_grants_max_num": "100", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_admin_entry": "admin", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_backend_store": "rados", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_barbican_url": "", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_beast_enable_async": "true", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cache_enabled": "true", 2024-04-19T03:36:18.542 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cache_expiry_interval": "900", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cache_lru_size": "10000", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_config_store": "rados", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_content_length_compat": "false", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_copy_obj_progress": "true", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cors_rules_max_num": "100", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cross_domain_policy": "", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_addr": "", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_password": "", 2024-04-19T03:36:18.543 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_username": "", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_require_ssl": "true", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-19T03:36:18.544 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_addr": "", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_auth": "token", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_namespace": "", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_prefix": "", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_token_file": "", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_buffersize": "524288", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-19T03:36:18.545 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_low_speed_time": "300", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_log_changes_size": "1000", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_log_num_shards": "128", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-19T03:36:18.546 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_log_window": "30", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-19T03:36:18.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dns_name": "", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dns_s3website_name": "", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dynamic_resharding": "true", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_gc_threads": "true", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_lc_threads": "true", 2024-04-19T03:36:18.548 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_ops_log": "false", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_quota_threads": "true", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_static_website": "false", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_usage_log": "false", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enforce_swift_acls": "true", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_exit_timeout_secs": "120", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_expose_bucket": "false", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_extended_http_attrs": "", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_filter": "none", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_frontends": "beast port=7480", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_deferred": "50", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_objs": "32", 2024-04-19T03:36:18.549 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_processor_period": "3600", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_init_timeout": "300", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-19T03:36:18.550 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_domain": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_password": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_password_path": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_project": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_tenant": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_token": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_token_path": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_user": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_api_version": "2", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_domain": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_password": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_project": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_user": "", 2024-04-19T03:36:18.551 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_url": "", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_debug_interval": "-1", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_lock_max_time": "90", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_max_objs": "32", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_max_rules": "1000", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_max_worker": "3", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_thread_delay": "0", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_dnattr": "uid", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-19T03:36:18.552 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_searchfilter": "", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_log_http_headers": "", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_log_object_name_utc": "false", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_attr_name_len": "0", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_attr_size": "0", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_chunk_size": "4194304", 2024-04-19T03:36:18.553 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_listing_results": "1000", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_notify_retries": "10", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_put_param_size": "1048576", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_put_size": "5368709120", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_slo_entries": "1000", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_md_log_max_shards": "64", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-19T03:36:18.554 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_mp_lock_max_time": "600", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_max_gc": "300", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-19T03:36:18.555 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_num_async_rados_threads": "32", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_num_control_oids": "8", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_numa_node": "-1", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_objexp_chunk_size": "100", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_objexp_gc_interval": "600", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_op_thread_timeout": "600", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_op_tracing": "false", 2024-04-19T03:36:18.556 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_opa_token": "", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_opa_url": "", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_opa_verify_ssl": "true", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ops_log_rados": "false", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ops_log_socket_path": "", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_period_push_interval": "2.000000", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_print_continue": "true", 2024-04-19T03:36:18.557 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_rados_tracing": "false", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_realm": "", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_realm_id": "", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_region": "", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-19T03:36:18.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_request_uri": "", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_batch_size": "64", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_max_aio": "128", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_num_logs": "16", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_thread_interval": "600", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_resolve_cname": "false", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_run_sync_thread": "true", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-19T03:36:18.559 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_scheduler_type": "throttler", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_script_uri": "", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_service_provider_name": "", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_client_id": "", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_client_secret": "", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_entry": "sts", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_key": "sts", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_min_session_duration": "900", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_token_introspection_url": "", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_account_in_url": "false", 2024-04-19T03:36:18.560 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_auth_entry": "auth", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_auth_url": "", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_custom_header": "", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_need_stats": "true", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_tenant_name": "", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_token_expiration": "86400", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_url": "", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_url_prefix": "swift", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_lease_period": "120", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-19T03:36:18.561 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_thread_pool_size": "512", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_comment": "", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_createby": "", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_encoding": "", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_flag": "false", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_origin": "", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_tracker": "", 2024-04-19T03:36:18.562 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_trust_forwarded_https": "false", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_usage_max_shards": "32", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_usage_max_user_shards": "1", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_use_opa_authz": "false", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_max_buckets": "1000", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_policies_max_num": "100", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_unique_email": "true", 2024-04-19T03:36:18.563 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_verify_ssl": "true", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zone": "", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zone_id": "", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zonegroup": "", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zonegroup_id": "", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rgwlc_auto_session_clear": "true", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_block_size": "4096", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-19T03:36:18.564 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_size": "536870912", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_index_type": "binary_search", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_partition_filters": "false", 2024-04-19T03:36:18.565 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_perf": "false", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "run_dir": "/var/run/ceph", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_block_create": "true", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_cache_lru_size": "67108864", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_default_max_object_size": "16777216", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_device_size": "53687091200", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_journal_batch_capacity": "16", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-19T03:36:18.566 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_main_device_type": "SSD", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_segment_size": "67108864", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "set_keepcaps": "false", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "setgroup": "", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "setuser": "", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "setuser_match_path": "", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "thp": "false", 2024-04-19T03:36:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: "threadpool_default_timeout": "60", 2024-04-19T03:36:18.568 INFO:teuthology.orchestra.run.smithi005.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-19T03:36:18.568 INFO:teuthology.orchestra.run.smithi005.stdout: "throttler_perf_counter": "true" 2024-04-19T03:36:18.568 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-19T03:36:18.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-19T03:36:18.727 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a: {} 2024-04-19T03:36:18.737 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b: {} 2024-04-19T03:36:18.747 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c: {} 2024-04-19T03:36:18.748 INFO:teuthology.orchestra.run.smithi005.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:36:18.749 INFO:teuthology.orchestra.run.smithi005.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:36:18.749 INFO:teuthology.orchestra.run.smithi005.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:36:18.761 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-19T03:36:18.761 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-19T03:36:18.785 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-19T03:36:18.785 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-19T03:36:18.785 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-19T03:36:18.786 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-19T03:36:18.786 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:18.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:18.786 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-19T03:36:18.786 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-19T03:36:18.786 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:36:18.787 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:36:18.787 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-19T03:36:18.787 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T03:36:18.787 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T03:36:18.787 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-19T03:36:18.787 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-19T03:36:18.788 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-19T03:36:18.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:18.788 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-19T03:36:18.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:18.789 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-19T03:36:18.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:36:18.791 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:18.788+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:18.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:18.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-19T03:36:18.884 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-04-19T03:36:18.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:36:18.886 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-19T03:36:18.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-19T03:36:18.889 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:18.888+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:18.930 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-04-19T03:36:18.930 INFO:teuthology.orchestra.run.smithi129.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T03:36:18.930 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-04-19T03:36:18.942 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:18.942 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:18.954 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:18.969 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:18.991 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:18.998 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:18.998+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:19.011 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-04-19T03:36:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:36:19.091 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:19.090+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:19.095 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:19.095 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:19.108 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:19.192 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:19.192+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:19.292 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:19.292+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:19.294 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:19.294 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:19.306 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:19.338 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:36:19.356 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-19T03:36:19.372 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-19T03:36:19.373 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-19T03:36:19.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-19T03:36:19.373 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-19T03:36:19.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:19.373 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-19T03:36:19.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-19T03:36:19.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-19T03:36:19.373 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-19T03:36:19.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:19.373 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-19T03:36:19.393 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:19.392+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:19.433 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-19T03:36:19.433 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-19T03:36:19.433 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-19T03:36:19.433 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-19T03:36:19.434 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42278sec preferred_lft 42278sec 2024-04-19T03:36:19.435 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-04-19T03:36:19.435 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-19T03:36:19.435 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-19T03:36:19.435 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-19T03:36:19.435 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-19T03:36:19.435 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-19T03:36:19.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:19.435 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-19T03:36:19.436 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-19T03:36:19.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-04-19T03:36:19.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-04-19T03:36:19.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-04-19T03:36:19.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-19T03:36:19.436 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-19T03:36:19.448 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:19.448 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:19.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:19.500 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:19.499+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:19.595 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:19.594+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:19.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:19.622 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-19T03:36:19.626 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:19.626 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:19.636 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:19.656 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-19T03:36:19.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:19.658 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-19T03:36:19.696 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:19.696+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:19.731 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-19T03:36:19.731 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-19T03:36:19.731 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-19T03:36:19.731 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-19T03:36:19.731 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-19T03:36:19.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:19.732 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-19T03:36:19.732 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-19T03:36:19.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-19T03:36:19.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-19T03:36:19.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-19T03:36:19.732 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-19T03:36:19.797 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:19.797+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:19.804 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:19.804 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:19.814 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:36:19.898 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:19.898+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:19.955 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:19.955 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:19.965 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:36:19.999 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:19.998+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:20.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:20.024 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-19T03:36:20.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:20.047 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-04-19T03:36:20.092 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:20.092 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:20.099 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:20.099+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:20.102 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:36:20.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:20.109 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-19T03:36:20.109 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-19T03:36:20.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-19T03:36:20.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-19T03:36:20.109 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-19T03:36:20.200 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:20.200+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:20.220 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-19T03:36:20.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:20.221 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-19T03:36:20.221 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-19T03:36:20.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-19T03:36:20.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-19T03:36:20.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-19T03:36:20.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-19T03:36:20.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-19T03:36:20.221 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-19T03:36:20.229 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:20.229 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:20.239 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:20.301 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:20.300+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:20.391 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:20.391 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:20.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:20.403 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:20.402+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:20.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:20.437 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2024-04-19T03:36:20.437 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-19T03:36:20.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-19T03:36:20.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-04-19T03:36:20.437 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-19T03:36:20.503 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:20.503+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:20.545 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:20.546 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:20.550 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-19T03:36:20.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-19T03:36:20.550 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:20.557 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:20.570 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-19T03:36:20.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-19T03:36:20.570 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:20.604 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:20.603+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:20.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-04-19T03:36:20.705 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:20.705+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:20.706 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-19T03:36:20.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-19T03:36:20.743 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:20.743 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:20.754 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:20.780 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-19T03:36:20.782 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-19T03:36:20.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:20.782 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-04-19T03:36:20.805 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:20.805+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:20.845 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-19T03:36:20.845 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-19T03:36:20.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-04-19T03:36:20.894 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:20.894 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:20.905 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:20.906 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:20.906+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:20.922 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-19T03:36:20.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-19T03:36:20.992 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-19T03:36:20.994 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-19T03:36:20.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:20.994 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-04-19T03:36:20.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-04-19T03:36:20.993+0000 7f4a54b355c0 -1 init, newargv = 0x5621e5e9a0f0 newargc=15 2024-04-19T03:36:20.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[43762]: starting ceph client 2024-04-19T03:36:21.000 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[43762]: starting fuse 2024-04-19T03:36:21.007 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:21.007+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:21.018 INFO:teuthology.orchestra.run.smithi005.stdout:47 2024-04-19T03:36:21.018 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-04-19T03:36:21.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-19T03:36:21.019 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-04-19T03:36:21.020 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-04-19T03:36:21.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:36:21.031 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:21.031 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:21.041 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:21.108 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:21.107+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:21.156 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.43762.asok 2024-04-19T03:36:21.169 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:21.169 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:21.179 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:36:21.221 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:21.220+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:21.223 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:21.264 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-04-19T03:36:21.265 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:21.266 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:36:21.310 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:21.309+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:21.320 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-04-19T03:36:21.321 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-04-19T03:36:21.321 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-04-19T03:36:21.321 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-04-19T03:36:21.331 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:36:21.336 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43762.asok 2024-04-19T03:36:21.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:21.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43762.asok status 2024-04-19T03:36:21.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:36:21.410 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:21.410+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:21.460 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-04-19T03:36:21.460 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-04-19T03:36:21.460 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-04-19T03:36:21.460 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-04-19T03:36:21.460 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-04-19T03:36:21.470 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:36:21.474 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-19T03:36:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-04-19T03:36:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "646b8c7d293d8ec31a40c69f7b3237b19c1be24d", 2024-04-19T03:36:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)", 2024-04-19T03:36:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-04-19T03:36:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-04-19T03:36:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-19T03:36:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "43762", 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4526, 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4526 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 371913714 2024-04-19T03:36:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 371913714 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.4526 192.168.0.1:0/371913714", 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/371913714", 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 6, 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 17, 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-04-19T03:36:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-04-19T03:36:21.477 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-19T03:36:21.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:21.487 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-04-19T03:36:21.487 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:21.506 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-04-19T03:36:21.506 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:21.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:36:21.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:21.511 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:21.511+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:21.578 INFO:teuthology.run_tasks:Running task workunit... 2024-04-19T03:36:21.592 INFO:tasks.workunit:Pulling workunits from ref 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:36:21.593 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-19T03:36:21.593 INFO:tasks.workunit:timeout=3h 2024-04-19T03:36:21.593 INFO:tasks.workunit:cleanup=True 2024-04-19T03:36:21.593 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:21.612 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:21.611+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:21.637 INFO:teuthology.orchestra.run.smithi005.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:21.638 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-19T03:36:21.638 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 2fh/47d Inode: 1 Links: 2 2024-04-19T03:36:21.638 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:36:21.638 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-19T03:36:21.638 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-19T03:36:21.638 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-19 03:35:59.862349676 +0000 2024-04-19T03:36:21.638 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-19 03:36:21.576252810 +0000 2024-04-19T03:36:21.638 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-04-19T03:36:21.638 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-19T03:36:21.638 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-19T03:36:21.640 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-04-19T03:36:21.640 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-04-19T03:36:21.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-04-19T03:36:21.640 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-04-19T03:36:21.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.640 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4176.0:117 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-19T03:36:21.640 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:55.663014+0000", 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.974745771999999, 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011051686, 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4176", 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.5:0/937063019", 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 117 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663014+0000", 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663014+0000", 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663013+0000", 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663018+0000", 2024-04-19T03:36:21.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2230000000000001e-06 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663023+0000", 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7610000000000004e-06 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663026+0000", 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0199999999999999e-06 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.668661+0000", 2024-04-19T03:36:21.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0056344749999999999 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.668712+0000", 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1146999999999997e-05 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.668794+0000", 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.669742+0000", 2024-04-19T03:36:21.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00094858300000000002 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.674018+0000", 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0042757430000000003 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.674043+0000", 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5204000000000001e-05 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.674065+0000", 2024-04-19T03:36:21.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2220000000000001e-05 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.864972+0000", 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772787693000001, 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020146939999999999, 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864972+0000", 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864972+0000", 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864970+0000", 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864978+0000", 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1009999999999992e-06 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864991+0000", 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2565000000000001e-05 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865002+0000", 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1752e-05 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865335+0000", 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033266300000000002 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865343+0000", 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4479999999999997e-06 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.868511+0000", 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031683589999999999 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.868654+0000", 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014347399999999999 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869165+0000", 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000510521 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877353+0000", 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081882329999999996 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885033+0000", 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0076802809999999997 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885081+0000", 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7309999999999999e-05 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885119+0000", 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7888e-05 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.651 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865281+0000", 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772478714000002, 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020007094999999999, 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865281+0000", 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865281+0000", 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865280+0000", 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.999999 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865287+0000", 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5939999999999996e-06 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865310+0000", 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2118999999999999e-05 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865319+0000", 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3610000000000007e-06 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865404+0000", 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4580000000000007e-05 2024-04-19T03:36:21.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865407+0000", 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8639999999999998e-06 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870359+0000", 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049516769999999998 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870574+0000", 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00021452999999999999 2024-04-19T03:36:21.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871405+0000", 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00083110900000000001 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.878884+0000", 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0074790020000000002 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885171+0000", 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062872309999999999 2024-04-19T03:36:21.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885225+0000", 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3984999999999999e-05 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885288+0000", 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2873000000000006e-05 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.657 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865327+0000", 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772432849000001, 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020798000000000001, 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865327+0000", 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865327+0000", 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865326+0000", 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.999999 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865330+0000", 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4000000000000002e-06 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865337+0000", 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7569999999999998e-06 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865343+0000", 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0430000000000004e-06 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865444+0000", 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101285 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865450+0000", 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9020000000000004e-06 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871867+0000", 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0064165539999999997 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872009+0000", 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000142686 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872450+0000", 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044029200000000001 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.878892+0000", 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0064419380000000004 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886066+0000", 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071747249999999999 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886102+0000", 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6049e-05 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886125+0000", 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2144999999999999e-05 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865355+0000", 2024-04-19T03:36:21.663 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772404215999998, 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020879427999999998, 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865355+0000", 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865355+0000", 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865355+0000", 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865358+0000", 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3230000000000002e-06 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865363+0000", 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9389999999999996e-06 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865367+0000", 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9689999999999996e-06 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865488+0000", 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012105800000000001 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865493+0000", 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872696+0000", 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0072032729999999996 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872939+0000", 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024303000000000001 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.873608+0000", 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00066881099999999995 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879311+0000", 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057030020000000004 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886171+0000", 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068602079999999996 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886211+0000", 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9799000000000003e-05 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886235+0000", 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3978e-05 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865377+0000", 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772382532000002, 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019593360000000001, 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865377+0000", 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865377+0000", 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865377+0000", 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865379+0000", 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4739999999999999e-06 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865385+0000", 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7150000000000003e-06 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865389+0000", 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3329999999999998e-06 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3004999999999999e-05 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865439+0000", 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8460000000000002e-06 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869950+0000", 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045107130000000004 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870210+0000", 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026069 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870431+0000", 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000220903 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877544+0000", 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071126000000000002 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.884861+0000", 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073172059999999997 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.884923+0000", 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1697000000000002e-05 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.884970+0000", 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7555999999999997e-05 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865399+0000", 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.77236078, 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012472834, 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865399+0000", 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865399+0000", 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865398+0000", 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0629999999999999e-06 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865409+0000", 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2659999999999998e-06 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865418+0000", 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7389999999999994e-06 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865443+0000", 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.461e-05 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865446+0000", 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5209999999999998e-06 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.868883+0000", 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003436747 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869277+0000", 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00039403300000000001 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869599+0000", 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032215299999999999 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876564+0000", 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069648109999999996 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877766+0000", 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001201843 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877824+0000", 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8322000000000002e-05 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877871+0000", 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7135000000000002e-05 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865423+0000", 2024-04-19T03:36:21.680 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772336079999999, 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020937292999999999, 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865423+0000", 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865423+0000", 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865423+0000", 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865426+0000", 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6100000000000002e-06 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6509999999999998e-06 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865438+0000", 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6350000000000003e-06 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865528+0000", 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0756999999999999e-05 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865532+0000", 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8600000000000003e-06 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874629+0000", 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090970300000000007 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874711+0000", 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1431e-05 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874828+0000", 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011722000000000001 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879333+0000", 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045049089999999996 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886281+0000", 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069481120000000002 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886317+0000", 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5661000000000003e-05 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886361+0000", 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3949999999999998e-05 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:23 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865443+0000", 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772316792000002, 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021024181999999999, 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865443+0000", 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865443+0000", 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865442+0000", 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865445+0000", 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9849999999999998e-06 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865453+0000", 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3640000000000001e-06 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865457+0000", 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0729999999999998e-06 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865561+0000", 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010390099999999999 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865565+0000", 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5210000000000004e-06 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.875300+0000", 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097347839999999998 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.875403+0000", 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010281 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.875565+0000", 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016187100000000001 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879414+0000", 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038492399999999999 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886404+0000", 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006990235 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886440+0000", 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5969000000000001e-05 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886467+0000", 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6820000000000001e-05 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865493+0000", 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772266868999999, 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021094736999999999, 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865493+0000", 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865493+0000", 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865492+0000", 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.999999 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865499+0000", 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865510+0000", 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0908e-05 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865519+0000", 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3640000000000005e-06 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865593+0000", 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4134999999999994e-05 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865598+0000", 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9030000000000003e-06 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876345+0000", 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010746966 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017434800000000001 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876655+0000", 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013551899999999999 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.880344+0000", 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0036890460000000001 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886533+0000", 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061885830000000001 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886565+0000", 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2418e-05 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886587+0000", 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2098000000000001e-05 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865526+0000", 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772233193000002, 2024-04-19T03:36:21.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021141666999999999, 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865526+0000", 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865526+0000", 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865526+0000", 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865530+0000", 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4880000000000001e-06 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865537+0000", 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5479999999999998e-06 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865542+0000", 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6189999999999999e-06 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1481000000000001e-05 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865628+0000", 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1300000000000003e-06 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877668+0000", 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012040392 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877765+0000", 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6966000000000006e-05 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877888+0000", 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012308999999999999 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.880381+0000", 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002492378 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886620+0000", 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062392359999999996 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886648+0000", 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7614e-05 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886668+0000", 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0220999999999998e-05 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772200809000001, 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019564664999999998, 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865558+0000", 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865562+0000", 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1749999999999998e-06 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865569+0000", 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4960000000000001e-06 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865575+0000", 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3389999999999998e-06 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865612+0000", 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6816999999999997e-05 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871509+0000", 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058929500000000001 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871619+0000", 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110104 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871802+0000", 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018343499999999999 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877647+0000", 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058446390000000004 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885021+0000", 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073736089999999997 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885078+0000", 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7265999999999997e-05 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885123+0000", 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5330000000000001e-05 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772172942000001, 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012481570000000001, 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865598+0000", 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2439000000000001e-05 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865607+0000", 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8729999999999996e-06 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865614+0000", 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1160000000000001e-06 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865655+0000", 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0305000000000001e-05 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7900000000000001e-06 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869993+0000", 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043349019999999999 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870069+0000", 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5972999999999999e-05 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-04-19T03:36:21.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870250+0000", 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018126000000000001 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876571+0000", 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063200610000000001 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877967+0000", 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013962810000000001 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.878030+0000", 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3163999999999994e-05 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.878068+0000", 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8099000000000002e-05 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865633+0000", 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772126592999999, 2024-04-19T03:36:21.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011993627, 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865633+0000", 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865633+0000", 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865632+0000", 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865644+0000", 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2315e-05 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865653+0000", 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4999999999999999e-06 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865659+0000", 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4949999999999996e-06 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865700+0000", 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1e-05 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865706+0000", 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7300000000000002e-06 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871256+0000", 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005550157 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871468+0000", 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000211392 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871705+0000", 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000237505 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877454+0000", 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057490359999999999 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877532+0000", 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7276999999999999e-05 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877580+0000", 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8128999999999999e-05 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877626+0000", 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6754e-05 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865673+0000", 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772086602999998, 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024800043000000001, 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865673+0000", 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865673+0000", 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865672+0000", 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9080000000000003e-06 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865684+0000", 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865691+0000", 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7209999999999997e-06 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865720+0000", 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9580000000000001e-05 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865723+0000", 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.367e-06 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.873006+0000", 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0072833389999999998 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.873168+0000", 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016260100000000001 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.873634+0000", 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00046559999999999999 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879021+0000", 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0053870410000000004 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890414+0000", 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011392813 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890443+0000", 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8904999999999999e-05 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890473+0000", 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0017000000000001e-05 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865698+0000", 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772060966000002, 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024778535000000001, 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865698+0000", 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865698+0000", 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865698+0000", 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865701+0000", 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0019999999999998e-06 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865707+0000", 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8819999999999998e-06 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865718+0000", 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0822000000000001e-05 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865747+0000", 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9779999999999999e-05 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865751+0000", 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.72e-06 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.868664+0000", 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0029124429999999998 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869276+0000", 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061240899999999996 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869626+0000", 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00035039400000000002 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874373+0000", 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047462479999999998 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890386+0000", 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016013118 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890439+0000", 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2787999999999997e-05 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890477+0000", 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8402000000000003e-05 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.731 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865727+0000", 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.772032729999999, 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024826745000000001, 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865727+0000", 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865727+0000", 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865726+0000", 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865746+0000", 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0157e-05 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865756+0000", 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0071000000000001e-05 2024-04-19T03:36:21.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865763+0000", 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.613e-06 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865791+0000", 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8116e-05 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865794+0000", 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.39e-06 2024-04-19T03:36:21.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874800+0000", 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090065570000000001 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874929+0000", 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012838899999999999 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.875092+0000", 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000163585 2024-04-19T03:36:21.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879320+0000", 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.004228341 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890502+0000", 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011181695 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890532+0000", 2024-04-19T03:36:21.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0256e-05 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890553+0000", 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1049000000000001e-05 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.771987245999998, 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015742387, 2024-04-19T03:36:21.737 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865775+0000", 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7850000000000002e-06 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865782+0000", 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0210000000000002e-06 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6829999999999996e-06 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865816+0000", 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7699e-05 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865818+0000", 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7219999999999999e-06 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872509+0000", 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066908740000000003 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872632+0000", 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000122543 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016291600000000001 2024-04-19T03:36:21.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877934+0000", 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051389729999999998 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.881456+0000", 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035219209999999999 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.881489+0000", 2024-04-19T03:36:21.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3463000000000001e-05 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.881515+0000", 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5415999999999999e-05 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865803+0000", 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.771956489000001, 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024663378, 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.743 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865803+0000", 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865803+0000", 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865802+0000", 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865807+0000", 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2799999999999997e-06 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865816+0000", 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0219999999999993e-06 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0480000000000004e-06 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865865+0000", 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3157e-05 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865870+0000", 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2750000000000003e-06 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871478+0000", 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0056079210000000001 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871728+0000", 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024980800000000002 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871865+0000", 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000136837 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:21.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876364+0000", 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0044996000000000003 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01404011 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890441+0000", 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6720000000000001e-05 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890466+0000", 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5199999999999999e-05 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865833+0000", 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.771926910000001, 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024798388000000001, 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865833+0000", 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865833+0000", 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865832+0000", 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865848+0000", 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5642999999999999e-05 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865857+0000", 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3160000000000003e-06 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865863+0000", 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4790000000000001e-06 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865895+0000", 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865899+0000", 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9199999999999997e-06 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876389+0000", 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010489179 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:21.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876512+0000", 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012365400000000001 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890631+0000", 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014118656 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:21.753 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-04-19T03:36:21.755 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:21.754+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:21.755 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:21.789 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:36:21.852 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-19T03:36:21.855 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:21.855+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:21.909 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:21.909 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:21.909 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:21.910 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:21.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:21.957 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:21.957+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:22.058 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:22.058+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:22.063 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:22.063 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:22.063 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:22.063 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:22.063 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:22.075 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:22.159 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:22.158+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:22.219 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:22.219 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:22.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:22.219 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.351908921, 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:22.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:22.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:22.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.351864126999999, 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:22.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:22.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:22.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.351808532, 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:22.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.351768194000002, 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.238 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:22.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:22.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:22.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:22.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.351738201, 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:22.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:22.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.351708475999999, 2024-04-19T03:36:22.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:22.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.351667921000001, 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.256 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:22.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.351645300000001, 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.262 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:22.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:22.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:22.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.351616906, 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:22.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:22.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.343215287, 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:22.271 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:22.275 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.343162935999999, 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:22.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.343064233, 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:22.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:22.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:22.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.343011151999999, 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.342964574, 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.290 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:22.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:22.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:22.294 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.342645267999998, 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:22.298 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.341894743000001, 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:22.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:22.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:22.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.341834257999999, 2024-04-19T03:36:22.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:22.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.341792278, 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:22.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:22.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.341697354000001, 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:22.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:22.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:22.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:22.316 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.316 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.316 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.340404283000002, 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:22.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:22.320 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:22.322 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:22.321+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:22.322 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:22.350 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:36:22.423 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:22.423+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:22.464 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:22.464 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:22.464 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:22.464 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:22.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:22.523 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:22.523+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:22.601 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:22.601 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:22.601 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:22.601 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:22.601 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:22.611 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:22.652 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:22.651+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:22.725 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:22.725+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:22.779 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.911989552000001, 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.911931531, 2024-04-19T03:36:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.911885885, 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.911832664999999, 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.911796506999998, 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.911729255000001, 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.911694169, 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.911653635, 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.91160399, 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.907963403, 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.907384006000001, 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.905626092999999, 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.904952051999999, 2024-04-19T03:36:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.904743135, 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.904666402, 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.904406073000001, 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.901472688999998, 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.901224658, 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.901201193999999, 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.257234132000001, 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:22.868 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:22.869 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:36:22.870 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:22.868+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:22.971 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:22.970+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:23.010 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-04-19T03:36:23.011 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-04-19T03:36:23.011 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-04-19T03:36:23.011 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-04-19T03:36:23.021 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:36:23.072 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:23.071+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:23.148 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-04-19T03:36:23.148 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-04-19T03:36:23.149 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-04-19T03:36:23.149 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-04-19T03:36:23.149 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-04-19T03:36:23.158 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:36:23.173 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:23.173+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:23.275 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:23.274+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:23.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:23.288 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-04-19T03:36:23.288 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-04-19T03:36:23.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-04-19T03:36:23.288 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-04-19T03:36:23.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.288 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.4176.0:117 2.0 2:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-04-19T03:36:23.288 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:55.663014+0000", 2024-04-19T03:36:23.288 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 27.622317831, 2024-04-19T03:36:23.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011051686, 2024-04-19T03:36:23.289 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.289 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.289 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-04-19T03:36:23.289 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.4176", 2024-04-19T03:36:23.289 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "172.21.15.5:0/937063019", 2024-04-19T03:36:23.289 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 117 2024-04-19T03:36:23.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.289 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663014+0000", 2024-04-19T03:36:23.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663014+0000", 2024-04-19T03:36:23.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663013+0000", 2024-04-19T03:36:23.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663018+0000", 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2230000000000001e-06 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663023+0000", 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7610000000000004e-06 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.663026+0000", 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0199999999999999e-06 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.668661+0000", 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0056344749999999999 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.668712+0000", 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1146999999999997e-05 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.668794+0000", 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.669742+0000", 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00094858300000000002 2024-04-19T03:36:23.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.674018+0000", 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0042757430000000003 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.674043+0000", 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5204000000000001e-05 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:55.674065+0000", 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2220000000000001e-05 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.864972+0000", 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.420359752, 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020146939999999999, 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.297 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864972+0000", 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864972+0000", 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864970+0000", 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864978+0000", 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1009999999999992e-06 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.864991+0000", 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2565000000000001e-05 2024-04-19T03:36:23.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865002+0000", 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1752e-05 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865335+0000", 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00033266300000000002 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:23.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865343+0000", 2024-04-19T03:36:23.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4479999999999997e-06 2024-04-19T03:36:23.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.868511+0000", 2024-04-19T03:36:23.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031683589999999999 2024-04-19T03:36:23.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.868654+0000", 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014347399999999999 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869165+0000", 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000510521 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877353+0000", 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081882329999999996 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885033+0000", 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0076802809999999997 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885081+0000", 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7309999999999999e-05 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885119+0000", 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7888e-05 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865281+0000", 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.420050773, 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020007094999999999, 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865281+0000", 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865281+0000", 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865280+0000", 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.999999 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865287+0000", 2024-04-19T03:36:23.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5939999999999996e-06 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865310+0000", 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2118999999999999e-05 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865319+0000", 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3610000000000007e-06 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865404+0000", 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4580000000000007e-05 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865407+0000", 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8639999999999998e-06 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870359+0000", 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049516769999999998 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870574+0000", 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00021452999999999999 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871405+0000", 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00083110900000000001 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.878884+0000", 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0074790020000000002 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885171+0000", 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062872309999999999 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885225+0000", 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3984999999999999e-05 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885288+0000", 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2873000000000006e-05 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865327+0000", 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.420004907999999, 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020798000000000001, 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865327+0000", 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865327+0000", 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865326+0000", 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.999999 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865330+0000", 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4000000000000002e-06 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865337+0000", 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7569999999999998e-06 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865343+0000", 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0430000000000004e-06 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865444+0000", 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101285 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865450+0000", 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9020000000000004e-06 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871867+0000", 2024-04-19T03:36:23.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0064165539999999997 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872009+0000", 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000142686 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872450+0000", 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044029200000000001 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.878892+0000", 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0064419380000000004 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886066+0000", 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071747249999999999 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886102+0000", 2024-04-19T03:36:23.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6049e-05 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886125+0000", 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2144999999999999e-05 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.318 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865355+0000", 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419976275, 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020879427999999998, 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865355+0000", 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865355+0000", 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865355+0000", 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865358+0000", 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3230000000000002e-06 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865363+0000", 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9389999999999996e-06 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865367+0000", 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9689999999999996e-06 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865488+0000", 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012105800000000001 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865493+0000", 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872696+0000", 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0072032729999999996 2024-04-19T03:36:23.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872939+0000", 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024303000000000001 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.873608+0000", 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00066881099999999995 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879311+0000", 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057030020000000004 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886171+0000", 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068602079999999996 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886211+0000", 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9799000000000003e-05 2024-04-19T03:36:23.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886235+0000", 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3978e-05 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:11 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865377+0000", 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419954591, 2024-04-19T03:36:23.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019593360000000001, 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865377+0000", 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865377+0000", 2024-04-19T03:36:23.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865377+0000", 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865379+0000", 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4739999999999999e-06 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865385+0000", 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7150000000000003e-06 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865389+0000", 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3329999999999998e-06 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3004999999999999e-05 2024-04-19T03:36:23.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865439+0000", 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8460000000000002e-06 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869950+0000", 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045107130000000004 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870210+0000", 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00026069 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870431+0000", 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000220903 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877544+0000", 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071126000000000002 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.884861+0000", 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073172059999999997 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.884923+0000", 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1697000000000002e-05 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.884970+0000", 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7555999999999997e-05 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:12 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865399+0000", 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419932839000001, 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012472834, 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.332 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865399+0000", 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865399+0000", 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865398+0000", 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0629999999999999e-06 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865409+0000", 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2659999999999998e-06 2024-04-19T03:36:23.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865418+0000", 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7389999999999994e-06 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865443+0000", 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.461e-05 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:23.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865446+0000", 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5209999999999998e-06 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.868883+0000", 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003436747 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869277+0000", 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00039403300000000001 2024-04-19T03:36:23.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869599+0000", 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032215299999999999 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876564+0000", 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069648109999999996 2024-04-19T03:36:23.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877766+0000", 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001201843 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877824+0000", 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8322000000000002e-05 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877871+0000", 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7135000000000002e-05 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:22 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865423+0000", 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419908139, 2024-04-19T03:36:23.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020937292999999999, 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865423+0000", 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865423+0000", 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865423+0000", 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865426+0000", 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6100000000000002e-06 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6509999999999998e-06 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865438+0000", 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6350000000000003e-06 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865528+0000", 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0756999999999999e-05 2024-04-19T03:36:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865532+0000", 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8600000000000003e-06 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874629+0000", 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090970300000000007 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874711+0000", 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1431e-05 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874828+0000", 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011722000000000001 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879333+0000", 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045049089999999996 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886281+0000", 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069481120000000002 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886317+0000", 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5661000000000003e-05 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886361+0000", 2024-04-19T03:36:23.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3949999999999998e-05 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:23 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865443+0000", 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419888851, 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021024181999999999, 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.346 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865443+0000", 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865443+0000", 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865442+0000", 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865445+0000", 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9849999999999998e-06 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865453+0000", 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3640000000000001e-06 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865457+0000", 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0729999999999998e-06 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865561+0000", 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010390099999999999 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865565+0000", 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5210000000000004e-06 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.875300+0000", 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097347839999999998 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.875403+0000", 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010281 2024-04-19T03:36:23.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.875565+0000", 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016187100000000001 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879414+0000", 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038492399999999999 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886404+0000", 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006990235 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886440+0000", 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5969000000000001e-05 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886467+0000", 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6820000000000001e-05 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865493+0000", 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419838928000001, 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021094736999999999, 2024-04-19T03:36:23.353 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865493+0000", 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865493+0000", 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865492+0000", 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.999999 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865499+0000", 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865510+0000", 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0908e-05 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865519+0000", 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3640000000000005e-06 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865593+0000", 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4134999999999994e-05 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865598+0000", 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9030000000000003e-06 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876345+0000", 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010746966 2024-04-19T03:36:23.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017434800000000001 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876655+0000", 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013551899999999999 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.880344+0000", 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0036890460000000001 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886533+0000", 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061885830000000001 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886565+0000", 2024-04-19T03:36:23.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2418e-05 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886587+0000", 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2098000000000001e-05 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865526+0000", 2024-04-19T03:36:23.360 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419805252, 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021141666999999999, 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865526+0000", 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865526+0000", 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865526+0000", 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865530+0000", 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4880000000000001e-06 2024-04-19T03:36:23.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865537+0000", 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5479999999999998e-06 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865542+0000", 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6189999999999999e-06 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1481000000000001e-05 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865628+0000", 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1300000000000003e-06 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877668+0000", 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012040392 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877765+0000", 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6966000000000006e-05 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877888+0000", 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012308999999999999 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.880381+0000", 2024-04-19T03:36:23.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002492378 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886620+0000", 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0062392359999999996 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886648+0000", 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7614e-05 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.886668+0000", 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0220999999999998e-05 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419772867999999, 2024-04-19T03:36:23.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019564664999999998, 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865558+0000", 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865562+0000", 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1749999999999998e-06 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865569+0000", 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4960000000000001e-06 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865575+0000", 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3389999999999998e-06 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865612+0000", 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6816999999999997e-05 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871509+0000", 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058929500000000001 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871619+0000", 2024-04-19T03:36:23.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110104 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871802+0000", 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018343499999999999 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877647+0000", 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058446390000000004 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885021+0000", 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073736089999999997 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885078+0000", 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7265999999999997e-05 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.885123+0000", 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5330000000000001e-05 2024-04-19T03:36:23.373 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419745000999999, 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012481570000000001, 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865598+0000", 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2439000000000001e-05 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865607+0000", 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8729999999999996e-06 2024-04-19T03:36:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865614+0000", 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1160000000000001e-06 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865655+0000", 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0305000000000001e-05 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7900000000000001e-06 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869993+0000", 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043349019999999999 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870069+0000", 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5972999999999999e-05 2024-04-19T03:36:23.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.870250+0000", 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018126000000000001 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876571+0000", 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0063200610000000001 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877967+0000", 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013962810000000001 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.878030+0000", 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3163999999999994e-05 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.878068+0000", 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8099000000000002e-05 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.380 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865633+0000", 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419698652000001, 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011993627, 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865633+0000", 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865633+0000", 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865632+0000", 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865644+0000", 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2315e-05 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865653+0000", 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4999999999999999e-06 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865659+0000", 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4949999999999996e-06 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865700+0000", 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1e-05 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865706+0000", 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7300000000000002e-06 2024-04-19T03:36:23.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871256+0000", 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005550157 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871468+0000", 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000211392 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-04-19T03:36:23.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871705+0000", 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000237505 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877454+0000", 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057490359999999999 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877532+0000", 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7276999999999999e-05 2024-04-19T03:36:23.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877580+0000", 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8128999999999999e-05 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877626+0000", 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6754e-05 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865673+0000", 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419658662, 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024800043000000001, 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865673+0000", 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865673+0000", 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865672+0000", 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9080000000000003e-06 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865684+0000", 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865691+0000", 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7209999999999997e-06 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865720+0000", 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9580000000000001e-05 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865723+0000", 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.367e-06 2024-04-19T03:36:23.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.873006+0000", 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0072833389999999998 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.873168+0000", 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016260100000000001 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.873634+0000", 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00046559999999999999 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879021+0000", 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0053870410000000004 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890414+0000", 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011392813 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890443+0000", 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8904999999999999e-05 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890473+0000", 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0017000000000001e-05 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865698+0000", 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419633025, 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024778535000000001, 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865698+0000", 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865698+0000", 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865698+0000", 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865701+0000", 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0019999999999998e-06 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865707+0000", 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8819999999999998e-06 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865718+0000", 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0822000000000001e-05 2024-04-19T03:36:23.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865747+0000", 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9779999999999999e-05 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865751+0000", 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.72e-06 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.868664+0000", 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0029124429999999998 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869276+0000", 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061240899999999996 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.869626+0000", 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00035039400000000002 2024-04-19T03:36:23.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874373+0000", 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047462479999999998 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890386+0000", 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016013118 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890439+0000", 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2787999999999997e-05 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890477+0000", 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8402000000000003e-05 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.401 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865727+0000", 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419604789000001, 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024826745000000001, 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865727+0000", 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865727+0000", 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865726+0000", 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865746+0000", 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0157e-05 2024-04-19T03:36:23.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865756+0000", 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0071000000000001e-05 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865763+0000", 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.613e-06 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865791+0000", 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8116e-05 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865794+0000", 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.39e-06 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874800+0000", 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090065570000000001 2024-04-19T03:36:23.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.874929+0000", 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012838899999999999 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.875092+0000", 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000163585 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.879320+0000", 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.004228341 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890502+0000", 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011181695 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890532+0000", 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0256e-05 2024-04-19T03:36:23.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890553+0000", 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1049000000000001e-05 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:23.408 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419559305, 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015742387, 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:23.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865775+0000", 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7850000000000002e-06 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865782+0000", 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0210000000000002e-06 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6829999999999996e-06 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865816+0000", 2024-04-19T03:36:23.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7699e-05 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865818+0000", 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7219999999999999e-06 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872509+0000", 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066908740000000003 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872632+0000", 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000122543 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016291600000000001 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.877934+0000", 2024-04-19T03:36:23.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051389729999999998 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.881456+0000", 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035219209999999999 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.881489+0000", 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3463000000000001e-05 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.881515+0000", 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5415999999999999e-05 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:19 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865803+0000", 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419528547999999, 2024-04-19T03:36:23.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024663378, 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865803+0000", 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865803+0000", 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865802+0000", 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865807+0000", 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2799999999999997e-06 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865816+0000", 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0219999999999993e-06 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0480000000000004e-06 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865865+0000", 2024-04-19T03:36:23.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3157e-05 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op must wait for map", 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865870+0000", 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2750000000000003e-06 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871478+0000", 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0056079210000000001 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871728+0000", 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024980800000000002 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.871865+0000", 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000136837 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876364+0000", 2024-04-19T03:36:23.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0044996000000000003 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01404011 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890441+0000", 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6720000000000001e-05 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890466+0000", 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5199999999999999e-05 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:21 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-04-19T03:35:59.865833+0000", 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.419498968999999, 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024798388000000001, 2024-04-19T03:36:23.422 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865833+0000", 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865833+0000", 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865832+0000", 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865848+0000", 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5642999999999999e-05 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865857+0000", 2024-04-19T03:36:23.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3160000000000003e-06 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865863+0000", 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4790000000000001e-06 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865895+0000", 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.865899+0000", 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9199999999999997e-06 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876389+0000", 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010489179 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.876512+0000", 2024-04-19T03:36:23.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012365400000000001 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-04-19T03:35:59.890631+0000", 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014118656 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-04-19T03:36:23.427 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-04-19T03:36:23.429 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:23.430 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:23.428+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:23.454 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:23.476 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:23.497 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-04-19T03:36:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:36:23.530 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:23.529+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:23.581 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:23.582 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:23.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:23.631 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:23.631+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:23.732 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:36:23.732+0000 7fca150f5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40480) UID: 0 2024-04-19T03:36:23.735 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:23.735 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:23.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:23.834 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:23.833+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:23.890 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:23.891 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:23.902 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:23.941 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:36:23.941 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:36:23.941 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-04-19T03:36:23.941 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi129.front.sepia.ceph.com 2024-04-19T03:36:23.941 INFO:teuthology.orchestra.console.smithi129:Power off 2024-04-19T03:36:23.941 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T03:36:23.951 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:23.945+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:23.964 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-04-19T03:36:23.964 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:36:23.988 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-04-19T03:36:24.037 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:24.035+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:24.040 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:24.040 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:24.051 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:24.136 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:24.136+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:24.218 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:24.218 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:24.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:24.237 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:24.237+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:24.338 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:24.338+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:24.355 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:24.355 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:24.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:24.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:36:24.439 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:24.439+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:24.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:24.573 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:24.573+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:24.641 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:24.640+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:24.718 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:24.718 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:24.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:24.773 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:24.773+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:24.842 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:24.842+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:24.871 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:24.871 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:24.883 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:24.944 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:24.943+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:25.019 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:25.019 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:25.030 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:25.045 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:25.044+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:25.146 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:25.145+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:25.198 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:25.199 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:25.209 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:25.253 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:25.252+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:25.336 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:25.336 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:25.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:25.347 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:25.347+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:36:25.448 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:25.448+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:25.497 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:25.498 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:25.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:25.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:36:25.550 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:25.550+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:25.649 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:25.649+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:25.682 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:25.694 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:25.694 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:25.694 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:25.695 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:25.695 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:25.703 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:25.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:25.723 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-04-19T03:36:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:25.725 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:36:25.790 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:25.790+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:25.852 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:25.852+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.026390696, 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.894 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:25.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:25.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.900 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.026345901999999, 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:25.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:25.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.906 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.026290307, 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:25.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.026249968999998, 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:25.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:25.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.026219976, 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.918 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:25.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:25.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:25.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.026190250999999, 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:25.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.026149696000001, 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:25.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:25.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:25.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:25.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.026127075000002, 2024-04-19T03:36:25.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.026098681000001, 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:25.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:25.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.017697062, 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:25.944 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:25.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.017644710999999, 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.952 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.017546008, 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:25.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:25.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.017492926999999, 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.957 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:25.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:25.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.017446349, 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.961 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:25.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.017127042999999, 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:25.965 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.969 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.016376518000001, 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:25.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:25.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.973 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.016316032999999, 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:25.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:25.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:25.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.016274053, 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:25.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:25.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.016179129000001, 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:25.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:25.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.014886057999998, 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:25.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:25.989 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:25.991 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:25.991 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:25.990+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:26.092 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:26.091+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:26.131 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:26.131 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:26.131 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:26.131 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:26.141 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:26.192 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:26.192+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:26.267 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:26.267 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:26.268 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:26.268 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:26.277 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:26.293 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:26.293+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:26.394 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:26.394+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:26.406 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:26.406 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:26.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:26.406 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:26.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.406 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:26.406 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.53859778, 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:26.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:26.411 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.538539758999999, 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:26.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:26.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:26.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:26.416 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.538494112999999, 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:26.421 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.538440893000001, 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:26.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:26.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:26.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.538404735, 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:26.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.538337482999999, 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:26.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.538302396999999, 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.437 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.538261862999999, 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.444 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.538212217999998, 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:26.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.448 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.534571630999999, 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:26.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:26.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.533992233999999, 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.453 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:26.457 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.532234321000001, 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:26.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:26.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.461 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.531560280000001, 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:26.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:26.464 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.531351362999999, 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:26.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:26.468 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.531274629999999, 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:26.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:26.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.531014300999999, 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.528080917, 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:26.476 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:26.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.527832885999999, 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.527809422000001, 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:26.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:26.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:26.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 21.883842359999999, 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:26.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:26.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:26.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:26.493 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.493 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.493 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.493 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:26.493 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:26.493 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:26.494 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:26.495 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:26.494+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:26.595 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:26.595+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:26.647 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:26.647 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:26.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:26.704 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:26.704+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:26.797 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:26.797+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:26.802 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:26.802 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:26.802 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:26.802 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:26.802 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:26.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:26.898 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:26.898+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:26.998 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:26.998+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:27.000 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:27.000 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:27.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.133378593, 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:27.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:27.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:27.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:27.007 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.133333798999999, 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:27.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.133278204, 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:27.014 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:27.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:27.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.020 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.133237866000002, 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:27.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:27.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.133207873, 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:27.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:27.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.032 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.133178147999999, 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:27.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:27.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:27.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.133137593000001, 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:27.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:27.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:27.045 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.045 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.045 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.046 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.046 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:27.046 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.133114972000001, 2024-04-19T03:36:27.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:27.046 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.047 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:27.047 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:27.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:27.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:27.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:27.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:27.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:27.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:27.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:27.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:27.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:27.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:27.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:27.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.055 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.055 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.055 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.055 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:27.055 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.133086578, 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:27.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:27.060 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.124684959, 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:27.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:27.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:27.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:27.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:27.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:27.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:27.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:27.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:27.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:27.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:27.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:27.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:27.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:27.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:27.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:27.068 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.068 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.068 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.069 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:27.069 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:27.069 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.124632607999999, 2024-04-19T03:36:27.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:27.069 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.069 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.070 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:27.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:27.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:27.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:27.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:27.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:27.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:27.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:27.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:27.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:27.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:27.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:27.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.124533905, 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.124480823999999, 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:27.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:27.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:27.087 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.124434246, 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:27.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:27.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:27.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.124114939999998, 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:27.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.123364415000001, 2024-04-19T03:36:27.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.123303929999999, 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:27.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:27.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.12326195, 2024-04-19T03:36:27.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:27.109 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.123167026000001, 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:27.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:27.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.121873955000002, 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:27.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:27.117 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:27.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:27.120 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:27.118+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:27.219 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:27.219+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:27.255 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:27.256 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:27.256 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:27.266 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:27.320 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:27.319+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:27.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:36:27.392 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:27.392 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:27.393 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:27.393 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:27.393 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:27.403 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:27.447 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:27.446+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:27.521 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:27.521+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.663477295, 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:27.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:27.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.536 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.663419273999999, 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.541 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.663373627999999, 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:27.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:27.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:27.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:27.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.663320408000001, 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:27.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.66328425, 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.663216997999999, 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.663181911999999, 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.663141377999999, 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.663091733000002, 2024-04-19T03:36:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.659451145999999, 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.658871748999999, 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.657113836000001, 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.656439795000001, 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.656230877999999, 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.656154144999999, 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.655893815999999, 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.652960432, 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.652712400999999, 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.652688937000001, 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.008721874999999, 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:27.620 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:27.622 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:27.623 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:27.623+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:27.725 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:27.724+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:27.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:27.775 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:27.775 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:27.775 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:27.775 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:27.787 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:27.825 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:27.825+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:27.900 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:27.921 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:27.927 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:27.926+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:27.943 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-04-19T03:36:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:36:27.973 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:27.973 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:27.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:27.989 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:36:28.028 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:28.028+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:28.099 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-04-19T03:36:28.127 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:28.127 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:28.128 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:28.128+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:28.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:28.229 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:28.228+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:28.278 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:28.278 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:28.288 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:28.331 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:28.330+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:28.374 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:36:28.431 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:28.431+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:28.458 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:28.459 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:28.469 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:28.532 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:28.531+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:28.596 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:28.596 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:28.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:28.650 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:28.650+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:28.734 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:28.733+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:28.758 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:28.758 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:28.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:28.854 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:28.854+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:28.936 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:28.936+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:28.954 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:28.955 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:28.967 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:29.036 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:29.036+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:29.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-19T03:36:29.138 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:29.137+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:29.156 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:29.156 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:29.168 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:29.238 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:29.238+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:29.300 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:29.300 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:29.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:29.339 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:29.339+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:29.440 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:29.440+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:29.480 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:29.480 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:29.490 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:29.541 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:29.541+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:29.618 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:29.618 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:29.628 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:29.641 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:29.641+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:29.742 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:29.742+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:29.781 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:29.781 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:29.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:29.843 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:29.842+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:29.935 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:29.936 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:29.944 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:29.944+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:29.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:29.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:36:30.045 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:30.045+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:30.130 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:30.136 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.269012355000001, 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.268967561, 2024-04-19T03:36:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.268911966000001, 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.268871627999999, 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.268841635000001, 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.26881191, 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.268771354999998, 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.268748733999999, 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.268720340000002, 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:30.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.260318721000001, 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.26026637, 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.260167667000001, 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.260114586, 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.260068008000001, 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.259748702, 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.258998176999999, 2024-04-19T03:36:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.258937692, 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.258895712000001, 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.258800787999999, 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.257507716999999, 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:30.254 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:30.255 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:30.256 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:30.257 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:30.257 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:30.255+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:30.257 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:30.258 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:30.258 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:30.356 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:30.356+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:30.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:36:30.389 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:30.389 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:30.389 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:30.390 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:30.399 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:30.457 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:30.457+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:30.527 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:30.528 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:30.537 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:30.558 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:30.558+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:30.659 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:30.658+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:30.666 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.798461895999999, 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.798403874999998, 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.798358229000002, 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.798305009, 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.798268851, 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.798201598999999, 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.798166512999998, 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.798125979000002, 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.798076334000001, 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.794435747000001, 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.793856349999999, 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.792098437, 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.791424396, 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.791215479000002, 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.791138746000001, 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.790878416999998, 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.787945033, 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.787697002000002, 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.787673538, 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.143706475999998, 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:30.759 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:30.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:30.761 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:30.760+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:30.861 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:30.860+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:30.913 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:30.913 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:30.913 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:30.913 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:30.925 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:30.969 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:30.969+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:31.062 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:31.062+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:31.068 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:31.068 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:31.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:31.163 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:31.162+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:31.264 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:31.264+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.402531388, 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:31.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:31.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:31.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.402486593999999, 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:31.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:31.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:31.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:31.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.402430999, 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:31.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:31.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:31.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.288 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.402390660999998, 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:31.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.294 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.402360668, 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:31.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:31.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:31.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:31.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.402330942999999, 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.300 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:31.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:31.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:31.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:31.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:31.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:31.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.402290388000001, 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:31.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:31.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:31.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:31.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.402267767000001, 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:31.312 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.316 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.402239373, 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:31.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:31.321 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.393837754, 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:31.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:31.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:31.325 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.393785402999999, 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:31.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:31.329 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.3936867, 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:31.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.393633618999999, 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.393587041, 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.393267734999998, 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:31.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:31.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:31.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.392517210000001, 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.392456724999999, 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.392414745, 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.392319821000001, 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:31.358 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:31.362 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.391026750000002, 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:31.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:31.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:31.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:31.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:31.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:31.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:31.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:31.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:31.366 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:31.368 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:31.368 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:31.367+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:31.385 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:36:31.468 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:31.468+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:31.508 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:31.508 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:31.508 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:31.509 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:31.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:31.568 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:31.568+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:31.646 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:31.646 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:31.646 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:31.646 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:31.646 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:31.655 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:31.669 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:31.669+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:31.770 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:31.770+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.916636560000001, 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.784 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.916578539, 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:31.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:31.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:31.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.916532892999999, 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.795 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:31.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:31.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:31.800 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.916479673000001, 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:31.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:31.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:31.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.916443515000001, 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:31.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.916376263, 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:31.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:31.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:31.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.916341177, 2024-04-19T03:36:31.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.916300643, 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:31.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:31.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.916250997999999, 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:31.824 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.912610410999999, 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:31.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:31.832 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.912031014, 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:31.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:31.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.910273101000001, 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:31.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:31.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.909599060000001, 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:31.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.909390143, 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.844 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:31.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:31.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.909313409999999, 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.909053081, 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.855 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.906119697000001, 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:31.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:31.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:31.859 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.905871665999999, 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.905848202000001, 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:31.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:31.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.26188114, 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:31.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:31.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:31.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:31.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:31.871 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.872 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.872 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.872 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:31.872 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:31.872 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:31.873 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:31.872+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:31.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:31.974 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:31.974+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:32.024 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:32.025 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:32.025 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:32.025 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:32.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:32.080 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:32.080+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:32.099 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:36:32.176 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:32.176+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:32.178 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:32.178 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:32.178 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:32.178 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:32.179 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:32.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:32.209 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-04-19T03:36:32.259 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:32.277 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:32.276+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:32.376 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.509270033999996, 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.509225239999999, 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.509169645, 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.509129307000002, 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.509099313999997, 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.509069588999999, 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.509029034000001, 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.509006413000002, 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.508978018999997, 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.5005764, 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.500524048999999, 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.500425346, 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.500372265000003, 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.500325687, 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.500006380999999, 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.499255855999998, 2024-04-19T03:36:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.499195370999999, 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.499153391, 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.499058466999998, 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.497765395999998, 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:32.475 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:32.477 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:32.476+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:32.477 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:32.477 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:32.478 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:32.479 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:32.480 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:32.578 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:32.577+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:32.613 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:32.613 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:32.624 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:32.679 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:32.679+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:32.780 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:32.780+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:32.792 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:32.792 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:32.802 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:32.881 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:32.881+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:32.929 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:32.929 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:32.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:32.983 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:32.983+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:33.083 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:33.083+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:33.091 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:33.092 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:33.103 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:33.184 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:33.183+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:33.285 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:33.284+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:33.288 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:33.288 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:33.300 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:33.386 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:33.385+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:33.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:36:33.442 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:33.443 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:33.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:33.486 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:33.486+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:33.585 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:33.651 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:33.653 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:33.654 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:33.652+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:33.753 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:33.752+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:33.819 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:33.819 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:33.831 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:33.872 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:33.871+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:33.955 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:33.954+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:33.999 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:33.999 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:34.009 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:34.056 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:34.056+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:34.157 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:34.156+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:34.159 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:34.159 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:34.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:34.258 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:34.258+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:34.357 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:34.357 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:34.359 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:34.358+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:34.369 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:34.392 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:36:34.460 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:34.459+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:34.480 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:36:34.513 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:34.514 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:34.525 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:34.569 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:34.568+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:34.651 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:34.657 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:34.657 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:34.661 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:34.660+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:34.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:34.672 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:34.673 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:34.673 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:34.673 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:34.676 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:34.676 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:34.762 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:34.762+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:34.834 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:34.835 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:34.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:34.864 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:34.863+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:34.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-04-19T03:36:34.965 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:34.964+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:35.013 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.146244948000003, 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:35.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:35.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:35.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.146186927000002, 2024-04-19T03:36:35.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:35.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:35.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.024 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.146141280999998, 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.146088061, 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.030 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:35.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:35.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:35.035 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.146051903, 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:35.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:35.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.145984650999999, 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:35.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.145949565000002, 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:35.046 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:35.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.049 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.145909031000002, 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:35.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:35.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.145859385999998, 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:35.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.142218798999998, 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:35.061 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.141639402000003, 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.139881488999997, 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:35.066 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:35.070 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.139207448000001, 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:35.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:35.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:35.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.138998530999999, 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:35.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:35.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:35.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.138921797999998, 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.081 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.138661468999999, 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.135728084999997, 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.135480053999999, 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.135456589999997, 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:35.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.096 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.491489527999999, 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:35.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:35.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:35.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.101 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:35.102 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:35.102 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:35.103 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:35.102+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:35.104 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:35.204 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:35.202+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:35.256 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:35.256 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:35.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:35.309 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:35.308+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:35.405 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:35.404+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:35.454 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:35.455 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:35.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:35.510 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:35.509+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:35.607 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:35.605+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:35.610 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.743447918999998, 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:35.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:35.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:35.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.618 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.618 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:35.618 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.743403125, 2024-04-19T03:36:35.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:35.618 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.618 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.618 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:35.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:35.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:35.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:35.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:35.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:35.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:35.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.625 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.626 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.626 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:35.626 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.743347530000001, 2024-04-19T03:36:35.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:35.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:35.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:35.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:35.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.633 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.634 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.634 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:35.634 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.743307192000003, 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:35.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:35.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:35.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:35.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.641 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.641 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.743277198999998, 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:35.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:35.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:35.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:35.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:35.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.743247474, 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.648 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.649 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:35.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:35.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:35.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.743206919000002, 2024-04-19T03:36:35.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:35.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.661 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.743184298000003, 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:35.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:35.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:35.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.666 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.667 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:35.667 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:35.667 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.743155903999998, 2024-04-19T03:36:35.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:35.667 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.667 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:35.668 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:35.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:35.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:35.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:35.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:35.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:35.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:35.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:35.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:35.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:35.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:35.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:35.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.676 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.734754285000001, 2024-04-19T03:36:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.677 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:35.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:35.681 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.734701934, 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:35.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:35.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:35.686 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.734603231000001, 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:35.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.734550149999997, 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.734503572000001, 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.695 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:35.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:35.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:35.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:35.699 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.734184266, 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:35.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:35.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:35.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:35.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:35.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:35.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:35.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:35.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:35.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:35.705 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.705 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.705 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.733433740999999, 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:35.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:35.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:35.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:35.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:35.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.733373256, 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.711 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:35.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:35.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:35.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:35.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:35.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:35.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:35.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:35.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:35.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:35.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.718 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.718 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.718 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:35.719 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:35.719 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.733331276000001, 2024-04-19T03:36:35.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:35.719 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.719 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.719 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:35.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:35.723 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.733236351999999, 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:35.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:35.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:35.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:35.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.728 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.731943281, 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:35.729 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:35.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:35.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.732 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:35.733 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:35.733 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:35.735 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:35.735 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:35.733+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:35.835 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:35.834+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:35.868 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:35.868 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:35.868 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:35.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:35.936 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:35.935+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:36.005 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:36.005 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:36.005 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:36.005 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:36.005 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:36.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:36.059 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:36.058+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:36.138 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:36.136+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.276416605999998, 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.144 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:36.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:36.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.149 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.276358584999997, 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:36.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:36.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.276312939, 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:36.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:36.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.276259719000002, 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:36.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.276223561000002, 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.276156309000001, 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:36.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:36.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:36.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.276121222999997, 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.177 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:36.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:36.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.276080688999997, 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:36.181 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:36.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:36.184 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.276031044, 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.272390457, 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:36.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:36.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.271811059999997, 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.193 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:36.197 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.270053146999999, 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:36.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:36.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.269379106000002, 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:36.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:36.205 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.269170189, 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:36.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.209 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.269093456, 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:36.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.268833127000001, 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:36.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:36.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.265899742999999, 2024-04-19T03:36:36.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:36.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.265651712, 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:36.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:36.225 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.265628247999999, 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:36.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:36.229 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.621661186000001, 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:36.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:36.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:36.235 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:36.235 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:36:36.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:36.247 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:36.246+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:36.346 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-19T03:36:36.348 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:36.348+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:36.399 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:36.399 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:36.399 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:36.400 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:36.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:36:36.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:36.447 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-04-19T03:36:36.449 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:36.449+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:36.550 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:36.549+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:36.552 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:36.552 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:36.553 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:36.553 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:36.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:36.651 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:36.650+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:36.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:36.752 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:36.751+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:36.753 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:36.753 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:36.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:36.753 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:36.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.753 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.885804886000003, 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:36.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:36.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.885760091999998, 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:36.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:36.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:36.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.885704496999999, 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:36.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:36.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.885664159000001, 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.772 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:36.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:36.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:36.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:36.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.885634166000003, 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:36.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:36.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:36.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.885604440999998, 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:36.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:36.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:36.789 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.885563886, 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:36.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:36.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.885541265000001, 2024-04-19T03:36:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:36.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:36.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:36.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.885512871000003, 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:36.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:36.805 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.877111251999999, 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:36.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.809 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.877058900999998, 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:36.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:36.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.876960197999999, 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:36.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.876907117000002, 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:36.818 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:36.822 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.876860538999999, 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:36.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:36.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.876541232999998, 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.830 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.875790707999997, 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:36.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.875730222999998, 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.875688242999999, 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.839 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:36.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:36.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.875593319000004, 2024-04-19T03:36:36.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:36.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.874300247999997, 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:36.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:36.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:36.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:36.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:36.851 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.851 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.851 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.851 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:36.851 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:36.851 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:36.852 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:36.853 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:36.853 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:36.851+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:36.861 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:36.862 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:36.865 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:36.865 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:36.954 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:36.952+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:36.987 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:36.987 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:36.997 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:37.054 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:37.053+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:37.124 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:37.124 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:37.134 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:37.175 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:37.174+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:37.256 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:37.255+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:37.301 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:37.301 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:37.311 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:37.358 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:37.357+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:37.398 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:36:37.459 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:37.458+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:37.466 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:37.466 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:37.479 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:37.560 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:37.559+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:37.661 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:37.660+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:37.664 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:37.664 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:37.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:37.762 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:37.761+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:37.862 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:37.862 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:37.863 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:37.862+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:37.873 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:37.965 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:37.963+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:38.002 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:38.002 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:38.012 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:38.065 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:38.064+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:38.140 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:38.140 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:38.150 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:38.166 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:38.164+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:38.266 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:38.265+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:38.317 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:38.317 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:38.327 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:38.371 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:38.370+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:38.468 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:38.468+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:38.480 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:38.480 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:38.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:38.569 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:38.569+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:38.669 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:38.668+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:38.676 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:38.676 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:38.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:38.772 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:38.771+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:38.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:36:38.872 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:38.871+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:38.874 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:38.874 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:38.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:38.972 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:38.971+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:39.016 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:39.017 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:39.027 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:39.037 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:39.057 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:39.061 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:39.061 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:39.073 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:39.072+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:39.154 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:39.155 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:39.165 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:39.208 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:39.207+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:39.275 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:39.274+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:39.293 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:39.293 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:39.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:39.293 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:39.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.293 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.425925665999998, 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:39.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:39.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:39.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.425867644999997, 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:39.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:39.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.304 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.425821999, 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:39.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:39.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.425768779000002, 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.310 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:39.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:39.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:39.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:39.315 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.425732621000002, 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:39.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:39.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:39.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.425665369000001, 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:39.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.425630282999997, 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.326 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:39.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:39.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:39.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.425589748999997, 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.333 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.425540104, 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:39.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.338 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.338 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.338 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:39.338 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:39.338 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.421899517, 2024-04-19T03:36:39.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:39.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.421320119999997, 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.346 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.419562206999998, 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:39.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.418888166000002, 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:39.351 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:39.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:39.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.354 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.418679249, 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:39.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.418602516, 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:39.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.362 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.418342187, 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:39.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:39.366 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.415408802999998, 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:39.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:39.370 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.415160772, 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.415137307999998, 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:39.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 34.771170245999997, 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:39.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:39.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:39.383 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:39.385 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:39.384+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:39.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:39.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:36:39.485 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:39.484+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:39.537 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:39.537 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:39.537 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:39.537 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:39.549 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:39.590 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:39.589+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:39.687 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:39.687+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:39.734 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:39.735 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:39.735 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:39.735 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:39.735 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:39.746 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:39.790 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:39.789+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:39.889 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:39.888+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:39.891 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:39.891 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:39.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:39.891 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:39.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.891 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.891 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.024021624, 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:39.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:39.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:39.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:39.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.023976830000002, 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:39.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:39.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.903 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.023921235000003, 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:39.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.909 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.023880896999998, 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:39.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.915 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.023850904, 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:39.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:39.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:39.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.023821179000002, 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:39.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.023780623999997, 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.928 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.023758002999998, 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.934 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:39.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:39.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.023729609, 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:39.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.943 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.015327990000003, 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:39.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:39.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.015275639000002, 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:39.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:39.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:39.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:39.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.015176936000003, 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:39.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:39.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.015123854999999, 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:39.956 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.960 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.015077277000003, 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.014757971000002, 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.014007446000001, 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.969 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:39.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.013946961000002, 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:39.977 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.013904981000003, 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:39.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.013810057000001, 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:39.982 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:39.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.986 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.012516986000001, 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:39.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:39.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:39.990 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:39.992 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:39.990+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:39.992 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:40.092 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:40.091+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:40.122 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:40.123 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:40.123 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:40.123 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:40.132 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:40.193 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:40.192+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:40.258 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:40.259 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:40.259 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:40.269 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:40.313 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:40.312+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:40.395 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:40.394+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:40.397 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:40.397 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:40.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.530240743, 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:40.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:40.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:40.403 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.530182721999999, 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:40.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:40.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:40.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.408 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.530137076000003, 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:40.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.530083855999997, 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.414 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:40.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:40.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:40.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:40.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.530047697999997, 2024-04-19T03:36:40.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.529980446000003, 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:40.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:40.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.529945359999999, 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:40.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.529904825999999, 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:40.439 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.529855181000002, 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:40.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.526214594000002, 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:40.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:40.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.525635197, 2024-04-19T03:36:40.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.523877284000001, 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:40.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:40.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.523203242999998, 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:40.460 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.522994326000003, 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:40.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.522917593000003, 2024-04-19T03:36:40.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:40.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:40.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:40.468 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.522657264000003, 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:40.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:40.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.519723880000001, 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:40.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.519475849000003, 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.519452385000001, 2024-04-19T03:36:40.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.483 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.875485322999999, 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:40.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:40.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:40.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:40.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:40.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:40.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.489 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:40.489 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:40.489 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:36:40.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:40.532 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:40.531+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:40.597 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:40.595+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:40.641 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:40.642 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:40.642 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:40.642 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:40.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:40.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-04-19T03:36:40.737 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:40.736+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:40.799 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:40.798+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:40.839 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:40.839 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:40.839 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:40.840 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:40.840 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:40.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:40.935 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:40.934+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:41.000 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:40.998+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:41.039 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:41.039 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.172217551000003, 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.172172756999998, 2024-04-19T03:36:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.172117161999999, 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.172076824000001, 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.172046831000003, 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.172017105999998, 2024-04-19T03:36:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.171976551, 2024-04-19T03:36:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.171953930000001, 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.171925536000003, 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.163523916999999, 2024-04-19T03:36:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.163471565999998, 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.163372862999999, 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.163319782000002, 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.163273203999999, 2024-04-19T03:36:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.162953897999998, 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.162203372999997, 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.162142887999998, 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.162100907999999, 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.162005983999997, 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.160712912999998, 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:41.154 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:41.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:41.156 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:41.155+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:41.157 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:41.257 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:41.256+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:41.296 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:41.296 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:41.296 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:41.296 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:41.307 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:41.324 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:41.345 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:41.345 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:41.348 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:41.348 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:41.357 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:41.356+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:41.458 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:41.457+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:41.474 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:41.474 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:41.485 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:41.549 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T03:36:41.549 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:36:41.549 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T03:36:41.549 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2024-04-19T03:36:41.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-19T03:36:41.569 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:41.568+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:41.651 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:41.652 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:41.660 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:41.659+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:41.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:41.761 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:41.761+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:41.813 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:41.813 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:41.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:41.868 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:41.867+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:41.964 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:41.962+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:41.967 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:41.967 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:41.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:42.064 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:42.063+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:42.165 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:42.165 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:42.165 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:42.165+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:42.177 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:42.266 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:42.265+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:42.313 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:42.313 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:42.323 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:42.367 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:42.366+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:42.411 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-19T03:36:42.450 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:42.450 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:42.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:42.467 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:42.466+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:42.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:36:42.568 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:42.567+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:42.627 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:42.628 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:42.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:42.670 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:42.669+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:42.771 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:42.769+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:42.788 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:42.789 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:42.800 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:42.872 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:42.871+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:42.973 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:42.972+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:42.986 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:42.986 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:42.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:43.084 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:43.083+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:43.175 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:43.173+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:43.186 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:43.186 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:43.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:43.275 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:43.274+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:43.326 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:43.326 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:43.336 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:43.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:36:43.376 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:43.375+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:43.416 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:36:43.465 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:43.465 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:43.475 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:43.477 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:43.476+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:43.525 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:43.546 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:43.549 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:43.550 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:43.578 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:43.577+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:43.604 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.737196169000001, 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:43.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:43.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:43.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.737138148, 2024-04-19T03:36:43.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:43.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.737092502000003, 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:43.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:43.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:43.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.737039281999998, 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:43.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.737003123999997, 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:43.626 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.631 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.736935871999997, 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:43.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:43.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:43.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.736900786, 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:43.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.640 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.736860252, 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:43.644 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.736810607000002, 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:43.648 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.733170020000003, 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:43.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.652 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.732590623, 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:43.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:43.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:43.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.730832710000001, 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:43.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.730158668999998, 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:43.661 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:43.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:43.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.729949752000003, 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:43.668 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.729873019000003, 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:43.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.729612690000003, 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:43.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:43.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.726679306000001, 2024-04-19T03:36:43.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:43.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:43.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.726431275000003, 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:43.680 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:43.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:43.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 43.726407811000001, 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:43.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:43.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.082440749, 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:43.688 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:43.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:43.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:43.693 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:43.695 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:43.694+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:43.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:43.796 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:43.794+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:43.848 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:43.848 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:43.848 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:43.848 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:43.860 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:43.896 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:43.896+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:43.997 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:43.996+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:44.045 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:44.046 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:44.046 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:44.057 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:44.099 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:44.098+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:44.199 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:44.198+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:44.245 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:44.245 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:44.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.378131064999998, 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:44.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:44.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:44.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:44.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.378086271000001, 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:44.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:44.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:44.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:44.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:44.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:44.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.378030676000002, 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.258 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:44.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:44.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.377990337999996, 2024-04-19T03:36:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.377960344999998, 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.270 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:44.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:44.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.377930620000001, 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:44.276 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:44.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.377890065000003, 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:44.282 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:44.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:44.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.288 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.377867444000003, 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:44.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.377839049999999, 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:44.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:44.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.297 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.369437431000001, 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.369385080000001, 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.302 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.369286377000002, 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:44.310 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.369233295999997, 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:44.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.369186718000002, 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:44.315 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:44.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.368867412, 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:44.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.368116886999999, 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.324 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.368056402000001, 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.332 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.368014422000002, 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.367919497999999, 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:44.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.366626427, 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:44.341 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:44.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.344 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:44.345 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:44.345 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:44.346 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:44.347 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:44.345+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:44.447 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:44.446+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:44.478 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:44.478 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:44.478 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:44.478 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:44.488 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:44.548 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:44.547+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:44.615 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:44.615 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:44.616 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:44.625 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:44.649 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:44.648+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:44.750 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:44.748+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:44.753 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:44.753 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:44.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.886098070999999, 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:44.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:44.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.759 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.886040049999998, 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:44.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:44.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.885994404000002, 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.765 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:44.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:44.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.771 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.885941184000004, 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.885905026000003, 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.782 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.885837774000002, 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:44.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:44.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:44.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.787 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.885802687999998, 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:44.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.885762153999998, 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:44.795 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.885712509000001, 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:44.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:44.799 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.882071922000002, 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:44.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.803 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.881492524999999, 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:44.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:44.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.879734612, 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.808 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:44.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.812 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.879060570999997, 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:44.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.878851654000002, 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.816 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.878774921000002, 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:44.820 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:44.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:44.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.878514592000002, 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.827 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.875581208, 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.875333177000002, 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:44.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:44.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.875309713, 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.231342650999999, 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:44.839 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:44.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:44.844 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:44.846 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:44.850 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:44.849+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:44.951 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:44.951+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:44.998 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:44.998 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:44.998 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:44.998 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:45.009 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:45.054 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:45.053+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:45.151 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:45.151 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:45.152 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:45.152 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:45.152 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:45.153 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:45.153+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:45.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:45.254 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:45.254+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:45.351 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:45.351 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:45.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:45.351 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:45.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.351 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:45.351 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.483622134999997, 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:45.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:45.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:45.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.357 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.483577341, 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:45.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:45.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:45.363 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.483521746000001, 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:45.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:45.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.483481408000003, 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:45.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:45.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.375 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.483451414999998, 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:45.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.381 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.48342169, 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:45.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:45.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.483381135000002, 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:45.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:45.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.483358514000003, 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:45.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:45.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:45.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:45.398 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.483330119999998, 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:45.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.474928501000001, 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:45.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.47487615, 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:45.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:45.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.474777447000001, 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.474724365999997, 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.416 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.474677788000001, 2024-04-19T03:36:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.474358482, 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.473607956999999, 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.473547472, 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.473505492000001, 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.473410567999998, 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.472117496999999, 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:45.449 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:45.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:36:45.452 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:45.452 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:45.450+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:45.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:45.552 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:45.551+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:45.584 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:45.584 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:45.585 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:45.585 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:45.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:45.652 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:45.651+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:45.716 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:45.742 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:45.743 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:45.753 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:45.752+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:45.763 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:45.763 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:45.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:45.854 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:45.853+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:45.941 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:45.941 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:45.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:45.954 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:45.953+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:46.055 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:46.054+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:46.102 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:46.102 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:46.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:46.156 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:46.155+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:46.257 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:46.256+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:46.298 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:46.299 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:46.310 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:46.358 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:46.357+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:46.459 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:46.457+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:46.496 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:46.496 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:46.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~17s 2024-04-19T03:36:46.508 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:46.560 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:46.558+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:46.642 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:46.642 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:46.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:46.696 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:46.695+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:46.757 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:36:46.760 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:46.759+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:46.782 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:46.782 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:46.793 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:46.877 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:46.876+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:46.960 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:46.960 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:46.962 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:46.961+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:46.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:47.064 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:47.063+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:47.122 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:47.122 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:47.133 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:47.165 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:47.165+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:47.266 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:47.266+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:47.319 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:47.320 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:47.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:47.367 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:47.367+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:47.426 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T03:36:47.426 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:36:47.426 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-19T03:36:47.426 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T03:36:47.426 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T03:36:47.426 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-19T03:36:47.468 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:47.466+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:47.474 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:47.474 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:47.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:47.561 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:47.561 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T03:36:47.561 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:47.569 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:47.568+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:47.617 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:47.617 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:47.627 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:47.670 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:47.669+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:47.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:36:47.753 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:47.753 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:47.763 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:47.771 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:47.770+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:47.872 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:47.871+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:47.892 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:47.892 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:47.902 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:47.912 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:47.933 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:47.936 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:47.936 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:47.973 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:47.972+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:48.053 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:48.053 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:48.053 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:48.054 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:48.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:48.108 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:48.107+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:48.174 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:48.174+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:48.207 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:48.207 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:48.207 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:48.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:48.275 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:48.275+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:48.376 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:48.375+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:48.410 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:48.410 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.539667874000003, 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:48.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:48.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:48.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.539623079999998, 2024-04-19T03:36:48.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:48.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:48.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:48.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:48.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.423 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.539567484999999, 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:48.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:48.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.539527147000001, 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:48.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:48.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:48.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.539497154000003, 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.441 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.539467428999998, 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:48.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:48.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:48.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.539426874, 2024-04-19T03:36:48.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:48.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.539404253000001, 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:48.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.458 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.539375859000003, 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.463 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.530974239999999, 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:48.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.530921888999998, 2024-04-19T03:36:48.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.472 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.530823185999999, 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:48.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.530770105000002, 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.477 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:48.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:48.481 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.530723526999999, 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:48.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:48.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:48.485 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.530404220999998, 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.529653695999997, 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:48.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.529593210999998, 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.529551230999999, 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:48.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:48.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.529456306999997, 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.503 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:48.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.528163235999997, 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:48.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:48.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:48.511 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:48.513 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:48.512+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:48.513 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:48.614 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:48.613+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:48.642 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:48.642 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:48.642 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:48.642 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:48.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:48.715 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:48.714+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:48.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:36:48.815 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:48.815+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:48.818 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:48.819 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:48.819 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:48.819 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:48.819 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:48.829 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:48.916 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:48.915+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:48.998 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.130765545000003, 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.130707524000002, 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.130661877999998, 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.014 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.130608658, 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:49.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:49.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:49.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:49.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:49.020 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.020 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.020 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.021 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.021 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:49.021 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.1305725, 2024-04-19T03:36:49.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:49.021 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.021 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.026 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.130505247999999, 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:49.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:49.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:49.032 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.032 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.032 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.130470162000002, 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:49.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:49.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.036 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.130429628000002, 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:49.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:49.040 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.130379982999997, 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:49.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:49.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.126739395999998, 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:49.044 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:49.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.126159999000002, 2024-04-19T03:36:49.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:49.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.124402086000003, 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:49.056 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.123728045, 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.123519127999998, 2024-04-19T03:36:49.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.123442394999998, 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.123182065999998, 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.071 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.120248682000003, 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:49.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:49.075 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.120000650999998, 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:49.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.119977187000003, 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:49.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.476010125000002, 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.083 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:49.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:49.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:49.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:49.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:49.088 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:49.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:49.090 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:49.088+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:49.190 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:49.189+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:49.241 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:49.241 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:49.241 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:49.241 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:49.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:49.296 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:49.295+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:49.393 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:49.391+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:49.395 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:49.395 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:49.395 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:49.395 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:49.395 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:49.407 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:49.493 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:49.492+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:49.594 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:49.593+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:49.595 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:49.595 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:49.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:49.595 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.728280050000002, 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:49.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.601 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.728235255999998, 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:49.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:49.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:49.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:49.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.728179660999999, 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.613 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.728139323000001, 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:49.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:49.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:49.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.728109330000002, 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:49.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:49.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:49.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:49.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.625 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.728079604999998, 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:49.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:49.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:49.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:49.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.72803905, 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:49.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.633 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.633 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:49.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:49.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:49.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.728016429, 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:49.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:49.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.727988035000003, 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:49.643 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:49.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:49.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.647 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.719586415999999, 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:49.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.719534064999998, 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.652 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:49.656 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.719435361999999, 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:49.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:49.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.660 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.719382281000001, 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.719335702999999, 2024-04-19T03:36:49.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:49.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.719016396999997, 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:49.668 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:49.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:49.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.718265872000003, 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.672 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:49.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:49.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:49.676 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.718205386999998, 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:49.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.718163406999999, 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.680 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.684 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.718068483000003, 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.688 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.716775411999997, 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:49.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:49.692 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:49.694 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:49.735 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:49.734+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:49.769 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:36:49.796 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:49.794+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:49.829 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:49.829 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:49.829 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:49.830 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:49.839 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:49.897 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:49.896+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:49.937 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:49.998 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:49.997+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:50.006 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:50.006 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:50.006 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:50.006 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:50.007 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:50.017 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:50.099 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:50.098+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:50.112 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:50.133 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:50.137 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:50.137 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:50.145 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:50.145 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:50.155 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:50.200 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:50.199+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:50.301 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:50.300+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:50.307 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:50.307 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:50.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:50.402 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:50.401+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:50.504 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:50.502+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:50.505 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:50.506 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:50.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:50.604 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:50.603+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:50.659 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:50.659 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:50.670 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:50.705 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:50.704+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:50.800 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:50.800 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:50.805 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:50.803+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:50.810 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:50.907 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:50.905+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:50.977 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:50.977 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:50.987 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:51.007 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:51.006+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:51.108 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:51.106+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:51.113 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:51.114 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:51.124 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:51.209 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:51.208+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:51.276 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:51.276 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:51.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:51.310 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:51.309+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:51.412 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:51.410+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:51.430 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:51.430 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:51.442 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:51.513 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:51.512+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:51.586 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:51.586 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:51.598 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:51.613 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:51.612+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:51.715 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:51.714+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:51.726 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:51.726 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:51.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:51.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:36:51.816 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:51.814+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:51.863 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:51.864 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:51.874 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:51.916 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:51.914+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:52.016 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:52.015+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:52.042 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:52.042 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:52.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:52.117 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:52.116+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:52.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:36:52.203 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:52.203 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:52.215 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:52.238 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:36:52.255 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:52.254+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:52.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~23s 2024-04-19T03:36:52.318 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:52.317+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:52.319 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:52.340 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:52.344 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:52.344 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:52.398 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:52.399 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:52.399 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:52.399 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:52.399 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:52.410 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:52.451 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:52.450+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:52.520 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:52.519+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:52.572 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T03:36:52.572 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:36:52.573 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T03:36:52.573 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2024-04-19T03:36:52.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-19T03:36:52.598 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:52.598 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:52.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.730988363000002, 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:52.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:52.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:52.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:52.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:52.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:52.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:52.605 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.730943568999997, 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:52.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:52.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:52.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.730887973999998, 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:52.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:52.618 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.730847636, 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:52.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:52.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:52.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.624 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.730817643000002, 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:52.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:52.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:52.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:52.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.631 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.730787917999997, 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:52.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.730747362999999, 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:52.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:52.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:52.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.730724742, 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:52.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:52.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.730696348000002, 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:52.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:52.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.722294728999998, 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:52.653 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:52.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.722242377999997, 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:52.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:52.661 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.722143674999998, 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:52.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.722090594000001, 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.722044015999998, 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:52.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:52.674 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.721724709999997, 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:52.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:52.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:52.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:52.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.720974185000003, 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:52.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:52.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:52.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.720913699999997, 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.720871719999998, 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.691 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.720776796000003, 2024-04-19T03:36:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:52.693 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:52.697 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.719483725000003, 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:52.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:52.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:52.700 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:52.701 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:52.701 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:52.702 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:52.703 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:52.701+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:52.802 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:52.802+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:52.833 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:52.833 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:52.833 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:52.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:52.927 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:52.926+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:53.005 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:53.003+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:53.010 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:53.010 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:53.010 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:53.010 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:53.010 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:53.019 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:53.105 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:53.104+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:53.190 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:53.190 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:53.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:53.190 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:53.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.190 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.190 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:53.190 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.322235358999997, 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:53.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:53.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.322177338000003, 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.322131691999999, 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:53.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:53.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:53.206 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.322078472000001, 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:53.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:53.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.211 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.322042314000001, 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:53.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:53.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.321975062, 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.217 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.321939976000003, 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:53.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:53.226 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.321899442000003, 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.321849796999999, 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:53.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.234 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.318209209999999, 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:53.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.317629813000003, 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.239 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:53.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.315871899999998, 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:53.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.315197859000001, 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.248 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:53.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.314988941999999, 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:53.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.314912208999999, 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:53.259 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.31465188, 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.311718495999997, 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:53.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:53.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.267 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.311470464999999, 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:53.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.311447000999998, 2024-04-19T03:36:53.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:53.275 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 48.667479939000003, 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:53.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:53.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:53.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:53.282 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.283 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.283 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.283 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:53.283 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:53.283 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:53.284 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:53.283+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:53.285 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-19T03:36:53.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:53.384 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:53.384+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:53.437 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:53.438 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:53.449 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:53.485 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:53.485+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:53.586 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:53.586+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:53.591 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:53.592 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:53.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:53.688 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:53.687+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:53.748 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:53.748 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:53.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:53.748 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:53.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.748 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.880567560999999, 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:53.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:53.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.880522767000002, 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.756 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:53.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:53.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:53.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.880467172000003, 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.763 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:53.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:53.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:53.770 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.880426833999998, 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:53.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.880396841, 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:53.777 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:53.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:53.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.880367116000002, 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.784 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:53.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.880326560999997, 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.791 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:53.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:53.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.880303939999997, 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.798 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.803 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.880275546, 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:53.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:53.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.808 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.871873927000003, 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:53.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.871821576000002, 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.814 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:53.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.871722873000003, 2024-04-19T03:36:53.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.871669791999999, 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:53.824 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:53.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.871623214000003, 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.829 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:53.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:53.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:53.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:53.834 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.871303908000002, 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:53.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:53.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.870553383000001, 2024-04-19T03:36:53.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:53.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.870492898000002, 2024-04-19T03:36:53.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:53.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:53.849 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.870450918000003, 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:53.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:53.854 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.870355994000001, 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:53.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:53.859 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.869062923000001, 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:53.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:53.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:53.863 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:53.865 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:53.864+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:53.866 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:53.966 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:53.965+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:53.997 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:53.997 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:54.007 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:54.091 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:54.090+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:54.168 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:54.167+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:54.173 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:54.174 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:54.174 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:54.174 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:54.174 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:54.184 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:54.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:36:54.269 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:54.268+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:54.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:54.353 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:54.353 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:54.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:54.353 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:54.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.353 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:54.353 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.485595339, 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:54.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:54.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:54.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.485537317999999, 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:54.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:54.364 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.485491672000002, 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.485438451999997, 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:54.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.485402293999996, 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.375 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:54.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:54.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.485335042000003, 2024-04-19T03:36:54.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:54.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:54.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:54.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.485299955999999, 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:54.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:54.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.389 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.485259421999999, 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:54.393 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.485209777000001, 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:54.397 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.481569190000002, 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:54.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:54.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.480989792999999, 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:54.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:54.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.47923188, 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.406 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:54.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:54.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:54.410 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.478557838999997, 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:54.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:54.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.478348922000002, 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:54.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:54.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:54.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.478272189000002, 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:54.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.478011860000002, 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.475078476, 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:54.429 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.474830445000002, 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:54.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:54.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.474806981, 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:54.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:54.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 49.830839918999999, 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:54.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:54.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:54.442 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:54.444 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:54.443+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:54.444 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:54.542 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:54.545 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:54.543+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:54.563 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:54.564 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:54.567 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:54.568 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:54.597 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:54.597 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:54.608 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:54.649 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:54.648+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:54.746 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:54.745+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:54.794 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:54.794 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:54.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:54.847 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:54.846+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:54.948 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:54.947+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:54.991 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:54.991 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:55.002 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:55.049 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:55.048+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:55.131 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:55.131 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:55.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:55.150 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:55.149+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:55.250 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:36:55.251 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:55.249+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:55.311 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:55.311 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:55.321 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:55.352 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:55.351+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:55.449 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:55.449 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:55.452 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:55.451+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:55.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:55.553 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:55.552+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:55.611 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:55.611 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:55.623 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:55.654 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:55.654+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:55.755 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:55.754+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:55.765 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:55.766 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:55.777 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:55.862 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:55.861+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:55.957 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:55.955+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:55.964 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:55.964 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:55.976 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:56.058 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:56.057+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:56.107 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:56.117 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:56.158 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:56.157+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:56.259 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:56.258+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:56.295 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:56.360 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:56.360+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:56.461 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:56.460+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:56.462 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:56.462 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:56.473 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:56.562 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:56.561+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:56.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:36:56.627 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:56.627 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:56.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:56.664 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:56.663+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:56.733 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:56.758 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:56.758 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:56.759 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:56.760 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:56.764 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:56.763+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:56.782 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:56.782 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:56.782 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:56.782 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:56.782 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:56.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:56.865 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:56.864+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:56.966 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:56.965+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:56.982 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:56.982 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.115132043999999, 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.115087250000002, 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.115031655000003, 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.114991316999998, 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.114961323999999, 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.114931599000002, 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.114891043999997, 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.114868422999997, 2024-04-19T03:36:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.114840029, 2024-04-19T03:36:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.106438410000003, 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.106386059000002, 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.106287356000003, 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.106234274999998, 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.106187697000003, 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.105868391000001, 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.105117866000001, 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.105057381000002, 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.105015401000003, 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.104920477, 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.103627406000001, 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:57.090 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:57.091 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:57.090+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:57.091 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:57.192 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:57.191+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:57.225 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:57.225 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:57.225 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:57.226 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:57.235 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:57.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:36:57.293 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:57.292+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:57.364 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:57.364 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:57.364 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:57.364 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:57.364 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:57.374 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:57.394 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:57.393+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:57.495 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:57.494+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.677298508, 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:57.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:57.550 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.677240486999999, 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:57.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.555 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.677194841000002, 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:57.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:57.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.560 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.677141620999997, 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:57.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.677105462999997, 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.566 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:57.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:57.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:57.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:57.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:57.571 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.677038211000003, 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:57.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:57.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:57.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.677003124999999, 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:57.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:57.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.580 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.676962590999999, 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:57.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:57.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:57.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.676912946000002, 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:57.584 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.673272359000002, 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.672692961999999, 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.592 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:57.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.670935049000001, 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:57.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:57.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:57.600 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.670261007999997, 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:57.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:57.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:57.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.670052091000002, 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.669975358000002, 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:57.611 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.669715029000002, 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:57.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:57.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.666781645, 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.618 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.666533614000002, 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:57.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.666510150000001, 2024-04-19T03:36:57.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 53.022543087999999, 2024-04-19T03:36:57.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:57.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:57.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:57.632 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:57.632 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:57.633 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:57.632+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:57.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:57.734 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:57.733+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:57.786 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:57.786 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:57.786 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:57.786 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:57.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:57.841 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:57.840+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:57.936 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:57.934+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:57.940 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:57.940 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:57.940 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:36:57.940 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:36:57.940 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:57.952 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:58.036 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:58.035+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:58.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-04-19T03:36:58.137 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:58.136+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.272916850999998, 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:36:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:36:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:36:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:36:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:36:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.272872057000001, 2024-04-19T03:36:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.272816462000002, 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:36:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.272776124000004, 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:36:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.272746130999998, 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.272716406000001, 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:36:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:36:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.272675851000002, 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:36:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.272653230000003, 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.182 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:36:58.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:36:58.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:36:58.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.272624835999999, 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:36:58.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.264223217000001, 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:36:58.191 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.264170866000001, 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:36:58.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:36:58.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:36:58.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.264072163000002, 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:36:58.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:36:58.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.264019081999997, 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:36:58.204 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.208 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.263972504000002, 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.263653198, 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:36:58.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:36:58.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.262902672999999, 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:36:58.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:36:58.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.221 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.221 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:58.222 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:58.222 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.262842188, 2024-04-19T03:36:58.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:36:58.222 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.222 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.223 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:58.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:36:58.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:36:58.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.262800208000002, 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:36:58.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:36:58.231 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.231 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.231 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.262705283999999, 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:36:58.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:36:58.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.261412213, 2024-04-19T03:36:58.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:36:58.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.239 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:36:58.240 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:36:58.240 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:58.241 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:58.242 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:58.240+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:36:58.286 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T03:36:58.286 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:36:58.286 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T03:36:58.286 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 1.000000 2024-04-19T03:36:58.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-19T03:36:58.342 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:58.341+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:58.376 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:58.377 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:58.377 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:36:58.377 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:58.386 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:58.444 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:58.441+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:58.543 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:58.543+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:58.553 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:58.554 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:36:58.554 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:36:58.554 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:36:58.554 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:58.564 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:58.648 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:58.647+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:58.733 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:36:58.733 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:36:58.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:36:58.733 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.86580446, 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:36:58.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:36:58.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:58.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.865746438999999, 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.739 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:36:58.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.744 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.865700793000002, 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:36:58.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:36:58.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:36:58.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.865647572999997, 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:58.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.865611415000004, 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.755 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:36:58.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.760 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.865544163000003, 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:58.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.765 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.865509076999999, 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:36:58.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:36:58.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.865468542999999, 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.865418898000001, 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.861778311000002, 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.861198913999999, 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.859441001, 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:58.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.858766959999997, 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:58.790 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:36:58.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.858558043000002, 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:36:58.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.858481310000002, 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.858220981000002, 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:36:58.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:36:58.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.855287597, 2024-04-19T03:36:58.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:36:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.855039566000002, 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:36:58.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.812 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.855016102, 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:36:58.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 54.211049039999999, 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:36:58.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:36:58.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:36:58.822 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:36:58.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:36:58.824 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:58.823+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:58.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:58.924 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:58.923+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:58.978 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:36:58.978 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:36:58.978 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:36:58.978 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:36:58.987 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:36:58.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:36:59.008 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:36:59.008 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:36:59.008 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:36:59.008 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:36:59.012 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:36:59.012 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:36:59.025 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:59.024+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:59.126 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:59.125+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:59.176 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:59.222 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:59.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:36:59.264 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:59.263+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-19T03:36:59.328 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:59.327+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:59.411 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:59.411 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:59.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:36:59.466 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:59.465+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:59.530 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:36:59.529+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:36:59.556 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:59.557 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:59.567 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:36:59.652 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:59.651+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:59.732 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:59.731+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:59.734 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:59.734 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:59.744 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:36:59.833 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:59.832+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:36:59.911 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:36:59.911 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:36:59.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:36:59.963 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:36:59.962+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:00.035 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:00.034+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:00.075 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:00.075 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:00.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:00.136 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:00.134+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:00.229 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:00.229 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:00.236 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:00.235+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:00.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:00.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:37:00.338 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:00.337+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:00.426 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:00.426 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:00.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:00.439 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:00.438+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:00.541 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:00.539+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:00.570 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:00.570 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:00.580 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:00.641 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:00.640+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:00.742 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:00.741+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:00.747 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:00.747 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:00.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:00.844 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:00.843+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:00.924 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:00.924 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:00.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:00.979 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:00.978+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:01.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:01.045 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:01.044+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:01.086 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:01.089 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:01.099 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:01.176 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:01.183 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:01.182+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:01.198 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:01.201 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:01.202 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:01.247 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:01.246+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:01.271 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:37:01.287 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:01.287 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:01.299 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:01.348 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:01.347+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:01.449 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:01.447+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:01.487 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:01.487 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:01.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:01.487 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:01.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.487 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:01.487 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:01.487 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.619369955000003, 2024-04-19T03:37:01.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:01.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:01.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:01.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:01.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:01.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:01.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:01.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.493 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.619325160999999, 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:01.499 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.619269566, 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:01.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:01.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:01.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:01.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.506 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.619229228000002, 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:01.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:01.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:01.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:01.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:01.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:01.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:01.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.619199234999996, 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:01.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:01.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.519 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.619169509999999, 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:01.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:01.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:01.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:01.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:01.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.526 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.619128955000001, 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:01.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:01.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:01.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:01.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:01.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:01.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:01.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:01.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.619106334000001, 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:01.533 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:01.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:01.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:01.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:01.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.619077939999997, 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:01.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:01.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:01.544 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.610676321, 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:01.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:01.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:01.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:01.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:01.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:01.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.550 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.550 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:01.550 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:01.550 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.610623969999999, 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:01.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:01.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:01.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:01.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:01.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.610525267, 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.555 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:01.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.559 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.610472186000003, 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:01.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.610425608, 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:01.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:01.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.610106301999998, 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:01.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.609355776999998, 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:01.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.577 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.609295291999999, 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:01.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.609253312, 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:01.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.609158387999997, 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:01.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.607865316999998, 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:01.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:01.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.594 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.595 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.595 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:01.595 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:01.595 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:01.596 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:01.597 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:01.595+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:01.697 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:01.696+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:01.733 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:01.734 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:01.745 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:01.799 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:01.798+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:01.899 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:01.898+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:01.912 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:01.913 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:01.922 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:02.001 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:02.000+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:02.091 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.223629248000002, 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.223571227000001, 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.223525580999997, 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.223472360999999, 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.223436202999999, 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.223368950999998, 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.223333865000001, 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.223293331000001, 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.223243686000004, 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.219603098999997, 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.219023702000001, 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.217265789000002, 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.216591747999999, 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.216382830999997, 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.216306097999997, 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.216045768999997, 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.213112385000002, 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.212864353999997, 2024-04-19T03:37:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.212840890000003, 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 57.568873828000001, 2024-04-19T03:37:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:02.202 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:02.204 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:02.203+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:02.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:02.305 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:02.304+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:02.356 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:02.356 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:02.356 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:02.356 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:02.367 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:02.405 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:02.404+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:02.506 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:02.505+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:02.509 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:02.509 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:02.509 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:02.509 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:02.510 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:02.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:02.608 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:02.606+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:02.709 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:02.708+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.841361550000002, 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.841316755999998, 2024-04-19T03:37:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.841261160999998, 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.841220823, 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.841190830000002, 2024-04-19T03:37:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:02.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:02.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:02.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:02.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.841161104999998, 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:02.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:02.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.841120549999999, 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:02.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.841097929, 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:02.761 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:02.765 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.841069535000003, 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:02.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.770 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.832667915999998, 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.774 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.832615564999998, 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:02.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:02.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.832516861999999, 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.779 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:02.783 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.832463781000001, 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:02.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.787 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.832417202999999, 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:02.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:02.792 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.832097896999997, 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:02.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.831347372000003, 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:02.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:02.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:02.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.831286886999997, 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:02.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.831244906999999, 2024-04-19T03:37:02.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:02.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.809 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.831149983000003, 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:02.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:02.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.829856911999997, 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:02.814 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:02.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:02.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.817 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:02.818 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:02.818 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:02.819 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:02.818+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:02.819 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:02.919 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:02.918+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:02.960 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:02.960 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:02.961 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:02.961 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:02.970 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:03.054 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:03.053+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:03.121 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:03.120+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:03.138 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:03.138 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:03.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:03.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:03.232 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:03.231+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:03.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:37:03.319 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:03.319 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:03.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:03.319 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:03.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.319 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:03.319 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.450291257000003, 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:03.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:03.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:03.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:03.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:03.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:03.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:03.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.450233236000003, 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:03.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:03.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:03.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:03.332 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.333 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.333 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.450187589999999, 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:03.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:03.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:03.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:03.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.450134370000001, 2024-04-19T03:37:03.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:03.345 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.345 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.345 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:03.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:03.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:03.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:03.350 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.450098212, 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.450030959999999, 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:03.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:03.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:03.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:03.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:03.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.361 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:03.362 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:03.362 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.449995874000003, 2024-04-19T03:37:03.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:03.362 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.449955340000002, 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.449905694999998, 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.446265107999999, 2024-04-19T03:37:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:03.382 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:03.383 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.445685711000003, 2024-04-19T03:37:03.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:03.383 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.383 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.383 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:03.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:03.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.390 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.443927797999997, 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:03.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:03.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.395 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.443253757000001, 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:03.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:03.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.443044839999999, 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:03.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:03.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:03.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:03.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:03.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:03.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:03.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.442968106999999, 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:03.406 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:03.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:03.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:03.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.442707777999999, 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:03.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:03.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.439774393999997, 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:03.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:03.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.418 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.439526362999999, 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.439502898999997, 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:03.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:03.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:03.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:03.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:03.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.426 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 58.795535837000003, 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:03.427 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:03.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:03.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:03.432 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:03.434 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:03.432+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:03.434 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:03.435 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:03.435 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:03.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:03.436 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:03.437 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:03.437 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:03.437 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:03.535 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:03.534+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:03.590 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:03.590 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:03.601 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:03.636 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:03.635+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:03.737 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:03.736+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:03.786 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:03.787 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:03.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:03.838 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:03.838+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:03.940 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:03.939+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:03.985 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:03.985 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:03.996 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:04.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-04-19T03:37:04.041 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:04.040+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:04.129 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:04.129 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:04.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:04.181 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:04.180+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:04.243 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:04.242+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:37:04.281 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-19T03:37:04.281 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-04-19T03:37:04.281 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi129.front.sepia.ceph.com 2024-04-19T03:37:04.281 INFO:teuthology.orchestra.console.smithi129:Power on 2024-04-19T03:37:04.282 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T03:37:04.308 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2024-04-19T03:37:04.308 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:37:04.318 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:04.318 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:04.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:04.333 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-19T03:37:04.344 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:04.343+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:04.444 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:04.443+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:04.487 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:04.487 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:04.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:04.545 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:04.544+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:04.646 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:04.645+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:04.649 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:04.649 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:04.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:04.747 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:04.747+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:04.847 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:04.847 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:04.848 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:04.846+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:04.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:04.949 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:04.947+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:05.044 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:05.044 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:05.049 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:05.048+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:05.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:05.151 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:05.150+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:05.190 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:05.190 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:05.201 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:05.252 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:05.250+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:05.353 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:05.351+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:05.367 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:05.367 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:05.378 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:05.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:05.453 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:05.452+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:05.504 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:05.504 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:05.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:05.558 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:05.557+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:05.622 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:05.655 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:05.654+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:05.659 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:05.660 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:05.660 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:05.660 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:05.663 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:05.663 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:05.666 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:05.666 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:05.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:05.756 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:05.755+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:05.857 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:05.856+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:05.862 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:05.863 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:05.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:05.958 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:05.957+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:06.059 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:06.057+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:06.061 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:06.061 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.193969151999994, 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:06.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:06.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:06.068 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.193924358000004, 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:06.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:06.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:06.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.074 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.193868762999998, 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:06.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:06.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.193828425000007, 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.193798431999994, 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.087 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:06.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:06.093 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.193768707000004, 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:06.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:06.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:06.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.099 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.193728152000006, 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.193705531000006, 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:06.106 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.193677136999995, 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:06.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:06.115 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.185275517999997, 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:06.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.119 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.185223167000004, 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:06.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:06.123 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.185124463999998, 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.185071382999993, 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.128 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:06.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:06.132 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.185024804999998, 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.136 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.184705499000003, 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:06.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:06.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.183954974000002, 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.141 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:06.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:06.145 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.183894488999996, 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:06.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.183852509000005, 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.183757584999995, 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.154 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:06.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.182464514000003, 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:06.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:06.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:06.162 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:06.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:06.164 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:06.162+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:06.265 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:06.264+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:06.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:37:06.305 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:06.305 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:06.305 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:06.305 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:06.315 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:06.365 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:06.365+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:06.466 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:06.465+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:06.483 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:06.483 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:06.483 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:06.483 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:06.483 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:06.494 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:06.567 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:06.566+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:06.622 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.754885818999995, 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.754827797999994, 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:06.633 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.754782152000004, 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.754728932000006, 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.754692774000006, 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.754625521999998, 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.754590436000001, 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.754549901999994, 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.754500257000004, 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.750859669999997, 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.750280273000001, 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.748522359999996, 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.747848318999999, 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.747639402000004, 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.747562669000004, 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.747302340000005, 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.744368956000002, 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.744120925000004, 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.744097460999996, 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 62.100130399000001, 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:06.712 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:06.713 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:06.712+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:06.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:06.814 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:06.813+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:06.865 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:06.865 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:06.865 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:06.865 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:06.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:06.917 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:06.916+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:07.018 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:07.017+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:07.061 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:07.061 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:07.061 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:07.061 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:07.061 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:07.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:07.119 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:07.118+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:07.221 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:07.219+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:07.261 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:07.261 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:07.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:07.261 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:07.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.261 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.261 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.393759505000006, 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:07.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.267 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.393714711000001, 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:07.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:07.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.273 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.393659115999995, 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:07.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:07.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.393618778000004, 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:07.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:07.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:07.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:07.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.393588785000006, 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:07.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:07.291 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.393559060000001, 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:07.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:07.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.393518505000003, 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:07.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:07.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.393495884000004, 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:07.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:07.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.393467490000006, 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:07.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:07.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.385065870999995, 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.313 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.385013520000001, 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:07.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:07.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.384914816999995, 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:07.325 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.384861736000005, 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.384815157999995, 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.330 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:07.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:07.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:07.334 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.384495852000001, 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:07.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:07.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.383745327, 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.342 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.383684841999994, 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.383642862000002, 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:07.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.383547938000007, 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:07.355 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.382254867, 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:07.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:07.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:07.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:07.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.359 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:07.359 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:07.359 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:07.361 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:37:07.361 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:07.362 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:07.359+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:07.461 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:07.460+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:07.493 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:07.493 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:07.493 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:07.494 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:07.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:07.562 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:07.561+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:07.631 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:07.631 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:07.631 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:07.631 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:07.631 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:07.641 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:07.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:07.685 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:07.684+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:07.764 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:07.764+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:07.769 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.902313367999994, 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:07.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:07.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:07.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.778 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.778 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:07.778 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.902255346999993, 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:07.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.902209701000004, 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.784 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:07.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:07.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:07.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:07.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:07.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:07.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:07.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.790 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.902156481000006, 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:07.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:07.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:07.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.902120323000005, 2024-04-19T03:37:07.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:07.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:07.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.802 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.902053070999997, 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:07.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:07.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.902017985000001, 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:07.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:07.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.901977450999993, 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:07.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:07.816 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.901927806000003, 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:07.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:07.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:07.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.898287218999997, 2024-04-19T03:37:07.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:07.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:07.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.825 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:07.826 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:07.826 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.897707822000001, 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:07.830 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.833 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:07.833 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:07.833 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.895949908999995, 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.895275867999999, 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:07.841 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.895066951000004, 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:07.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:07.845 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.894990218000004, 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:07.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:07.849 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.894729889000004, 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:07.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.891796505000002, 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:07.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:07.856 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.891548474000004, 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.860 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.891525009999995, 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:07.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 63.247557948000001, 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:07.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:07.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:07.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:07.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:07.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:07.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.870 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:07.870 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:07.870 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:07.871 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:07.872 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:07.870+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:07.872 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:07.882 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:07.882 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:07.883 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:07.883 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:07.886 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:07.886 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:07.972 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:07.971+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:08.023 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:08.023 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:08.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:08.073 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:08.072+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:08.174 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:08.173+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:08.178 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:08.179 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:08.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:08.275 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:08.274+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:08.333 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:08.333 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:08.334 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:37:08.346 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:08.391 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:08.390+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:08.447 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-04-19T03:37:08.477 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:08.476+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:08.479 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:08.479 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:08.490 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:08.549 INFO:teuthology.orchestra.console.smithi129:Power on completed 2024-04-19T03:37:08.578 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:08.578+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:08.650 DEBUG:teuthology.orchestra.console.smithi129:Waiting for login prompt 2024-04-19T03:37:08.650 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi129 2024-04-19T03:37:08.659 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:08.659 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:08.668 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:08.679 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:08.678+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:08.782 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:08.780+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:08.795 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:08.795 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:08.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:08.882 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:08.880+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:08.956 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:08.956 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:08.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:09.009 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:09.008+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:09.083 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:09.083+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:09.154 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:09.154 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:09.165 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:09.208 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:09.207+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:09.285 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:09.283+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:09.307 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:09.307 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:09.319 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:09.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:37:09.386 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:09.385+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:09.459 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:09.459 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:09.470 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:09.487 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:09.486+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:09.588 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:09.587+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:09.596 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:09.597 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:09.606 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:09.689 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:09.688+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:09.732 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:09.732 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:09.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:09.790 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:09.790+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:09.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-04-19T03:37:09.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:09.891 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:09.889+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:09.894 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:09.894 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:09.905 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:09.992 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:09.991+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:10.090 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:10.092 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:10.092 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:10.092 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:10.092 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:10.092 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:10.093 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:10.091+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:10.103 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:10.116 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:10.117 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:10.120 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:10.121 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:10.194 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:10.192+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:10.292 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.424567823000004, 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.424523028999999, 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.424467433999993, 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.424427096000002, 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.424397103000004, 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.424367377999999, 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.424326823000001, 2024-04-19T03:37:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.424304202000002, 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.424275808000004, 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.415874188999993, 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.415821837999999, 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:10.354 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.415723134999993, 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:10.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:10.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:10.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.415670054000003, 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:10.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:10.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.415623475999993, 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:10.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:10.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:10.367 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.415304169999999, 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:10.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.414553644999998, 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:10.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:10.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.414493160000006, 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:10.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:10.380 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.41445118, 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:10.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:10.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.414356256000005, 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:10.385 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:10.389 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.413063184999999, 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:10.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:10.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:10.395 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:37:10.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:10.396 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:10.393+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:10.498 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:10.495+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:10.530 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:10.530 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:10.530 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:10.530 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:10.540 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:10.597 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:10.596+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:10.666 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:10.666 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:10.666 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:10.666 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:10.666 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:10.676 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:10.717 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:10.716+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:10.799 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:10.798+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:10.846 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:10.846 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:10.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:10.847 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:10.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.847 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.847 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:10.847 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.977828490999997, 2024-04-19T03:37:10.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:10.848 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.848 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.848 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:10.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:10.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:10.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:10.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:10.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:10.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:10.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:10.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:10.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:10.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:10.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:10.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:10.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:10.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:10.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:10.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:10.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:10.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:10.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:10.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:10.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.977770469999996, 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:10.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:10.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.977724824000006, 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.865 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:10.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:10.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:10.870 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.977671603999994, 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:10.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.875 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.977635445999994, 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:10.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:10.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:10.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:10.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.881 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.977568194, 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:10.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:10.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:10.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.977533108000003, 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:10.887 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:10.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.977492573999996, 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.894 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.977442929000006, 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:10.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.973802341999999, 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:10.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:10.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:10.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.973222945000003, 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:10.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:10.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:10.908 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.971465031999998, 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:10.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.970790991000001, 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:10.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:10.916 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.970582074000006, 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:10.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.970505341000006, 2024-04-19T03:37:10.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:10.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.970245012000007, 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:10.924 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.967311628000004, 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:10.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.967063597000006, 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:10.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.935 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.967040132999998, 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:10.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 66.323073070999996, 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:10.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:10.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:10.945 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:10.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:10.947 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:10.946+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:11.048 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:11.046+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:11.099 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:11.099 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:11.099 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:11.099 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:11.111 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:11.148 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:11.148+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:11.250 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:11.249+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:11.296 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:11.297 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:11.297 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:11.297 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:11.297 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:11.308 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:11.351 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:11.350+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:11.452 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:11.451+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:11.498 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.630618588000004, 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.630573794, 2024-04-19T03:37:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.630518198999994, 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.630477861000003, 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.630447868000005, 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.630418143, 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.630377588000002, 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.630354967000002, 2024-04-19T03:37:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.630326573000005, 2024-04-19T03:37:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.621924953999994, 2024-04-19T03:37:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:11.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:11.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:11.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:11.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.621872603, 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.621773899999994, 2024-04-19T03:37:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.621720819000004, 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.621674240999994, 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.621354934999999, 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.620604409999999, 2024-04-19T03:37:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.620543925000007, 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.620501945000001, 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:11.618 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.620407021000005, 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:11.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:11.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:11.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.619113949999999, 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:11.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:11.626 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:11.628 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:11.629 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:11.627+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:11.729 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:11.728+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:11.767 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:11.767 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:11.767 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:11.777 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:11.829 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:11.829+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:11.904 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:11.904 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:11.904 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:11.904 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:11.905 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:11.914 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:11.959 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:11.958+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:12.032 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:12.032+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:12.042 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.175221707999995, 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:12.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:12.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:12.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:12.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.175163686999994, 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:12.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:12.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.054 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.175118041000005, 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:12.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.175064821000007, 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.060 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:12.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:12.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:12.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.175028663000006, 2024-04-19T03:37:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:12.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:12.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:12.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:12.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:12.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:12.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.174961410999998, 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:12.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.078 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.174926325000001, 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:12.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.082 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.174885790999994, 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.174836146000004, 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.090 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.171195558999997, 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.094 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.170616162000002, 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:12.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.168858248999996, 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.099 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.168184208, 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:12.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:12.107 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.167975291000005, 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:12.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:12.111 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.167898558000005, 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:12.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.167638229000005, 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:12.115 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:12.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:12.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.164704845000003, 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:12.122 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.164456814000005, 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:12.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:12.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:12.126 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 72.164433349999996, 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:12.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:12.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:12.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:12.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:12.133 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.133 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.133 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.133 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 67.520466287999994, 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:12.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:12.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:12.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:12.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.138 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.139 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.139 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:12.139 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:12.139 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:12.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:12.141 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:12.141 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:12.140+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:12.241 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:12.241+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:12.294 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:12.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:12.341 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:12.342 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:12.341+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:12.378 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:12.379 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:12.383 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:12.384 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:12.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:37:12.443 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:12.442+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:12.449 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:12.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:12.545 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:12.544+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:12.645 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:12.644+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:12.646 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:12.647 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:12.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:12.747 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:12.746+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:12.797 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:12.847 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:12.846+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:12.923 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:12.923 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:12.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:12.948 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:12.947+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:13.049 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:13.048+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:13.060 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:13.060 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:13.071 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:13.151 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:13.150+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:13.224 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:13.224 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:13.236 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:13.251 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:13.251+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:13.317 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:37:13.352 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:13.351+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:13.380 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:13.380 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:13.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:13.453 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:13.452+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:13.554 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:13.553+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:13.578 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:13.578 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:13.590 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:13.655 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:13.653+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:13.721 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:13.721 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:13.732 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:13.755 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:13.755+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:13.856 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:13.856+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:13.858 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:13.859 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:13.869 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:13.957 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:13.956+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:13.996 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:13.996 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:14.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:14.058 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:14.057+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:14.158 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:14.159 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:14.159 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:14.158+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:14.170 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:14.260 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:14.258+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:14.356 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:14.356 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:14.361 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:14.360+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:14.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:14.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:14.462 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:14.461+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:14.554 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:14.559 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:14.563 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:14.562+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:14.565 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:14.580 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:14.583 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:14.584 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:14.664 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:14.663+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:14.695 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:14.695 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:14.695 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:14.704 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:14.766 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:14.765+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:14.867 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:14.866+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:14.872 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:14.872 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:14.872 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:14.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:14.967 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:14.967+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:15.051 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.183373908999997, 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.052 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:15.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.183315887999996, 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:15.057 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:15.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.183270242000006, 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:15.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.068 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.183217021999994, 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:15.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:15.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.074 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.183180863999993, 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:15.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.183113612, 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.080 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:15.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:15.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.183078526000003, 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:15.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.090 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.183037991999996, 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:15.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.182988347000006, 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:15.095 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:15.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.179347759999999, 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:15.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:15.103 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.178768363000003, 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:15.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:15.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:15.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:15.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.177010449999997, 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:15.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.176336409000001, 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:15.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.116 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.176127492000006, 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:15.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:15.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.176050759000006, 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:15.121 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:15.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.175790430000006, 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:15.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:15.128 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.172857046000004, 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.172609015000006, 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:15.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.172585550999997, 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:15.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 70.528618488999996, 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:15.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:15.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:15.146 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:15.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:15.149 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:15.146+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:15.248 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:15.248+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:15.304 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:15.304 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:15.304 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:15.304 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:15.315 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:15.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:37:15.360 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:15.359+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:15.450 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:15.448+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:15.458 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:15.458 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:15.458 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:15.458 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:15.458 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:15.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:15.550 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:15.550+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:15.651 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:15.650+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:15.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-04-19T03:37:15.658 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.790942552999994, 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.790897759000003, 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.790842163999997, 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.790801826000006, 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.790771832999994, 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.790742108000003, 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.790701553000005, 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.790678932000006, 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.790650537999994, 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.782248918999997, 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.782196568000003, 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.782097864999997, 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.782044783999993, 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.781998205999997, 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.781678900000003, 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.780928375000002, 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.780867889999996, 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.780825910000004, 2024-04-19T03:37:15.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:15.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:15.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.780730985999995, 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:15.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:15.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.779437915000003, 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:15.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:15.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:15.759 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:15.761 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:15.761 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:15.760+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:15.862 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:15.861+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:15.893 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:15.894 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:15.894 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:15.894 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:15.903 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:15.962 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:15.962+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:16.029 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:16.030 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:16.030 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:16.030 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:16.030 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:16.043 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:16.063 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:16.062+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:16.164 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:16.163+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.303395757000004, 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:16.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:16.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:16.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:16.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:16.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:16.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.177 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.303337736000003, 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:16.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:16.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.303292089999999, 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:16.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:16.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.303238870000001, 2024-04-19T03:37:16.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:16.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.194 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.303202712000001, 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.195 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.303135459999993, 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.201 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:16.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.303100373999996, 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:16.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:16.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:16.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:16.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:16.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:16.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:16.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:16.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.303059840000003, 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:16.212 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:16.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.303010194999999, 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:16.216 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:16.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:16.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:16.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.220 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.220 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.299369608000006, 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.298790210999996, 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.225 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:16.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:16.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.229 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.297032298000005, 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:16.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:16.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:16.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:16.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.234 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.296358256999994, 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:16.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:16.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:16.238 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.296149339999999, 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:16.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:16.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:16.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:16.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:16.242 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.296072606999999, 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.243 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:16.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:16.250 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.250 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.250 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.295812278, 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:16.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:16.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:16.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.292878893999998, 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:16.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:16.259 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.292630862999999, 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:16.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:16.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:16.263 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:16.264 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 76.292607399000005, 2024-04-19T03:37:16.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:16.264 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.264 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.264 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:16.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:16.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:16.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:16.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:16.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.268 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.269 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:16.269 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:16.269 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 71.648640337000003, 2024-04-19T03:37:16.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:16.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:16.270 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:16.270 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:16.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:16.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:16.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:16.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:16.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:16.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:16.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:16.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:16.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:16.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:16.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:16.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:16.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:16.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:16.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:16.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:16.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:16.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:16.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:16.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:16.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:16.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:16.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:16.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.277 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.278 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.278 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:16.278 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:16.278 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:16.280 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:16.279+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:16.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:16.323 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:37:16.381 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:16.380+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:16.434 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:16.434 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:16.434 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:16.434 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:16.445 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:16.490 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:16.489+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:16.583 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:16.582+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:16.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:16.588 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:16.588 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:16.588 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:16.588 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:16.588 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:16.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:16.684 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:16.684+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:16.767 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:16.785 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:16.784+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:16.786 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:16.786 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:16.788 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:16.793 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:16.793 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:16.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:16.886 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:16.885+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:16.927 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:16.927 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:16.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:16.987 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:16.986+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:17.064 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:17.064 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:17.075 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:17.118 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:17.117+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:17.189 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:17.189+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:17.202 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:17.202 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:17.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:17.291 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:17.289+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:17.363 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:17.364 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:17.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:17.391 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:17.390+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:17.492 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:17.491+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:17.561 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:17.561 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:17.573 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:17.593 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:17.593+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:17.694 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:17.694+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:17.758 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:17.758 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:17.770 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:17.795 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:17.794+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:17.896 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:17.895+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:17.902 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:17.902 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:17.912 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:17.997 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:17.996+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:18.081 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:18.081 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:18.091 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:18.098 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:18.097+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:18.198 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:18.197+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:18.259 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:18.259 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:18.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:18.311 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:18.310+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:18.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:37:18.399 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:18.398+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:18.420 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:18.420 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:18.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:18.515 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:18.514+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:18.601 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:18.600+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:18.616 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:18.616 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:18.628 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:18.702 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:18.702+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:18.794 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:18.802 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:18.801+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:18.814 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:18.814 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:18.827 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:18.904 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:18.903+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:18.958 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:18.959 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:18.962 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:18.969 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:18.983 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:18.988 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:18.988 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:19.010 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:19.009+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:19.106 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:19.105+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:19.135 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:19.136 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:19.136 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:19.136 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:19.136 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:19.146 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:19.230 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:19.229+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:19.308 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:19.307+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:19.314 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:19.314 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.447118435999997, 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:19.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:19.320 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.447060414999996, 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.325 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.447014769000006, 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:19.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:19.331 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.446961548999994, 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:19.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:19.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.336 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.446925390999994, 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:19.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:19.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:19.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:19.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.343 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.446858139, 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:19.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:19.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:19.349 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.446823053000003, 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:19.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.446782518999996, 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:19.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:19.357 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.446732874000006, 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:19.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.443092286999999, 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.362 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:19.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:19.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.366 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.442512890000003, 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.370 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.440754976999997, 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:19.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.440080936000001, 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.375 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:19.378 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.439872019000006, 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:19.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.439795286000006, 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:19.383 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:19.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.439534957000006, 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:19.387 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:19.390 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.436601573000004, 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:19.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.436353542000006, 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:19.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.436330077999997, 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:19.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:19.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 74.792363015999996, 2024-04-19T03:37:19.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:19.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:19.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:19.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:19.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.409 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:19.409 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:19.409 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:19.411 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:19.410+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:37:19.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:19.511 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:19.510+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:19.563 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:19.563 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:19.563 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:19.563 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:19.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:19.612 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:19.611+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:19.713 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:19.712+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:19.717 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:19.718 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:19.718 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:19.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:19.814 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:19.812+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:19.874 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:19.874 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:19.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:19.874 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:19.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.006831564999999, 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:19.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.006786770999994, 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:19.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:19.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.006731176000002, 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.887 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:19.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:19.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:19.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.006690837999997, 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:19.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:19.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:19.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:19.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:19.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.006660844999999, 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:19.900 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:19.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.006631119999994, 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:19.911 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.006590564999996, 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:19.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:19.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:19.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.917 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.006567943999997, 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.006539549999999, 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.998137931000002, 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:19.931 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.998085579999994, 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:19.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:19.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:19.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.997986877000002, 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.997933795999998, 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:19.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.943 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.997887218000002, 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:19.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:19.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:19.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.997567911999994, 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.996817386999993, 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.952 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:19.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:19.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.996756902000001, 2024-04-19T03:37:19.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:19.960 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.996714921999995, 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.996619998, 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.995326926999994, 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:19.972 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:19.974 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:19.974 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:19.973+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:20.075 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:20.074+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:20.104 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:20.104 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:20.104 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:20.104 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:20.114 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:20.176 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:20.175+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:20.242 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:20.242 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:20.242 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:20.252 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:20.295 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:20.294+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:20.378 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:20.378+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:20.380 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:20.380 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:20.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:20.380 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:20.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.380 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.380 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:20.380 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.512901150000005, 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:20.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.512843129000004, 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:20.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:20.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:20.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:20.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.512797483, 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.391 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:20.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.396 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.512744263000002, 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:20.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.512708105000002, 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:20.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:20.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:20.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.512640852999994, 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:20.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:20.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.412 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.512605766999997, 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:20.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.416 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.512565233000004, 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:20.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:20.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.512515587999999, 2024-04-19T03:37:20.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:20.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:20.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.508875001000007, 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:20.424 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.428 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:20.429 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:20.429 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.508295603999997, 2024-04-19T03:37:20.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:20.429 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.429 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.429 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:20.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:20.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.506537691000005, 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:20.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:20.438 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.505863649999995, 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:20.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.505654733, 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:20.442 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:20.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:20.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.505578, 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.449 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.505317671, 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.502384286999998, 2024-04-19T03:37:20.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.502136256, 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:20.457 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:20.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:20.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.502112792000005, 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 75.858145730000004, 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:20.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:20.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:20.470 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:20.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:20.513 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:20.512+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:20.580 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:20.580+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:20.624 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:20.624 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:20.624 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:20.624 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:20.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:20.682 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:20.682+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:20.777 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:20.778 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:20.778 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:20.778 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:20.778 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:20.784 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:20.782+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:20.789 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:20.885 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:20.885+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.109419002999999, 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.109374208999995, 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.109318614000003, 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.109278275999998, 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.109248282999999, 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.109218557999995, 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.109178002999997, 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.109155381999997, 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.109126988, 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.100725369000003, 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.100673017999995, 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.100574315000003, 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.100521233999999, 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.100474656000003, 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.100155349999994, 2024-04-19T03:37:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.099404824999993, 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.099344340000002, 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.099302359999996, 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.099207436, 2024-04-19T03:37:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.097914364999994, 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:21.074 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:21.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:21.076 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:21.077 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:21.075+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:21.176 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:21.175+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:21.217 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:21.217 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:21.217 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:21.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:21.251 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:21.271 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:21.272 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:21.277 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:21.277 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:21.311 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:21.310+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:21.378 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:21.377+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:21.405 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:21.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:37:21.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~52s 2024-04-19T03:37:21.479 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:21.478+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:21.572 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:21.572 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:21.579 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:21.578+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:21.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:21.680 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:21.680+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:21.733 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:21.733 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:21.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:21.785 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:21.785+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:21.882 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:21.882+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:21.929 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:21.929 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:21.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:21.983 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:21.982+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:22.084 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:22.083+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:22.126 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:22.126 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:22.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:22.186 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:22.185+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:22.267 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:22.267 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:22.277 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:22.319 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:22.318+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:22.345 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:37:22.390 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:22.390+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:22.446 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:22.446 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:22.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:22.500 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:22.499+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:22.583 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:22.583 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:22.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:22.595 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:22.594+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:22.694 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:22.694+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:22.746 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:22.747 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:22.758 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:22.799 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:22.799+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:22.896 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:22.896+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:22.944 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:22.944 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:22.956 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:22.997 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:22.997+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:23.098 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:23.098+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:23.144 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:23.145 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:23.156 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:23.199 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:23.198+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:23.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:23.289 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:23.290 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:23.300 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:23.301 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:23.300+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:23.401 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:23.400+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:23.427 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:23.427 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:23.437 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:23.495 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:23.515 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:23.515 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:23.516 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:23.516 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:23.521 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:23.522 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:23.522 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:23.521+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:23.603 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:23.603+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:23.606 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.738931117000007, 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:23.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.738873096000006, 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.612 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:23.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:23.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:23.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:23.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:23.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:23.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:23.618 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.738827450000002, 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:23.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:23.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:23.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.623 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.738774230000004, 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:23.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:23.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:23.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:23.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.738738072000004, 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:23.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.738670819999996, 2024-04-19T03:37:23.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:23.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.738635733999999, 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.738595200000006, 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:23.647 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.738545555000002, 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:23.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.734904967999995, 2024-04-19T03:37:23.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.655 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.734325570999999, 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:23.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.659 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.732567657999994, 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.663 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.731893616999997, 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.731684700000002, 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.670 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.731607967000002, 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:23.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:23.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.731347638000003, 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.728414254, 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:23.678 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.728166223000002, 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.682 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:23.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:23.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.728142758999994, 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.689 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 79.084175697000006, 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:23.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:23.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:23.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:23.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:23.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:23.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.695 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:23.695 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:23.695 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:23.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:23.741 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:23.741+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:23.804 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:23.803+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:23.849 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:23.849 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:23.849 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:23.849 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:23.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:23.904 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:23.904+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:24.005 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:24.005+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:24.047 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:24.047 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:24.047 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:24.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:24.106 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:24.106+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:24.203 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.203 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.335615636, 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:24.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:24.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.209 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.335570841999996, 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:24.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.215 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.335515247000004, 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:24.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:24.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:24.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:24.221 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.335474908999998, 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:24.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:24.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:24.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:24.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.335444916, 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:24.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:24.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:24.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.335415190999996, 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:24.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:24.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:24.239 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.335374635999997, 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:24.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:24.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:24.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.335352014999998, 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:24.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:24.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.335323621000001, 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:24.250 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.326922002000003, 2024-04-19T03:37:24.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:24.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.326869650999996, 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:24.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.326770948000004, 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:24.262 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:24.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.326717866999999, 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.266 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.326671289000004, 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.270 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:24.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:24.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:24.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.326351982999995, 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:24.274 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:24.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:24.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:24.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.325601457999994, 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:24.278 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.325540973000003, 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.282 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:24.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.286 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.325498992999997, 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:24.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:24.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.325404069000001, 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.324110997999995, 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:24.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:24.299 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:24.299 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:24.300 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:24.301 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:24.299+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:24.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:37:24.401 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:24.400+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:24.433 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:24.433 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:24.433 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:24.433 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:24.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:24.501 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:24.501+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:24.602 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:24.602+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:24.610 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:24.610 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:24.611 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:24.611 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:24.620 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:24.703 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:24.702+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:24.749 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.882126752999994, 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:24.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:24.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.882068731999993, 2024-04-19T03:37:24.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:24.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.882023086000004, 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:24.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:24.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.881969866000006, 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:24.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:24.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:24.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.881933708000005, 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:24.772 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:24.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:24.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.881866455999997, 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:24.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:24.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:24.783 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.88183137, 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:24.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.881790835999993, 2024-04-19T03:37:24.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:24.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.881741191000003, 2024-04-19T03:37:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:24.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.878100603999997, 2024-04-19T03:37:24.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:24.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.877521207000001, 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.875763293999995, 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.804 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:24.808 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.875089252999999, 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.874880336000004, 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.812 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.874803603000004, 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.816 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.874543274000004, 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:24.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.871609890000002, 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:24.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:24.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.871361859000004, 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:24.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.871338394999995, 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:24.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:24.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 80.227371332999994, 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:24.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:24.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:24.847 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:24.847 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:24.848 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:24.849 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:24.848+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:24.949 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:24.949+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:25.002 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:25.002 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:25.002 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:25.002 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:25.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:25.050 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:25.049+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:25.151 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:25.151+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:25.199 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:25.199 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:25.199 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:25.199 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:25.200 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:25.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:25.252 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:25.252+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:25.353 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:25.353+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:37:25.399 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:25.399 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:25.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.532186035999999, 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.532141241999994, 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.532085647000002, 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.532045308999997, 2024-04-19T03:37:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.532015315999999, 2024-04-19T03:37:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.531985590999994, 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.531945035999996, 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.531922414999997, 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.531894020999999, 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.523492402000002, 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.523440050999994, 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.523341348000002, 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.523288266999998, 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.523241689000002, 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.522922382999994, 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.522171857999993, 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.522111373000001, 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.522069392999995, 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.521974469, 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.520681397999994, 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:25.495 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:25.497 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:25.497 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:25.496+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:25.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:25.598 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:25.598+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:25.636 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:25.636 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:25.636 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:25.636 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:25.646 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:25.690 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:25.699 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:25.698+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:25.711 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:25.715 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:25.715 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:25.773 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:25.774 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:25.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:25.825 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:25.824+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:25.901 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:25.900+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:25.951 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:25.951 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:25.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:26.007 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:26.007+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:26.103 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:26.102+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:26.115 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:26.115 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:26.126 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:26.210 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:26.210+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:26.305 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:26.304+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:26.312 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:26.312 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:26.323 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:26.407 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:26.407+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:26.507 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:26.506+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:26.509 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:26.509 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:26.520 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:26.608 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:26.608+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:26.649 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:26.649 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:26.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:26.709 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:26.708+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:26.785 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:26.786 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:26.796 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:26.810 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:26.810+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:26.911 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:26.911+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:26.963 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:26.963 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:26.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:27.017 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:27.017+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:27.113 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:27.113+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:27.126 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:27.126 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:27.138 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:27.221 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:27.221+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:27.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~58s 2024-04-19T03:37:27.316 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:27.315+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:27.321 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:27.322 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:27.334 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:27.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:37:27.418 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:27.418+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:27.517 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:27.517+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:27.520 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:27.520 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:27.532 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:27.618 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:27.618+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:27.662 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:27.662 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:27.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:27.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:27.718 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:27.718+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:27.798 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:27.799 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:27.808 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:27.852 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:27.851+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:27.890 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:27.910 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:27.914 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:27.914 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:27.919 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:27.918+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:27.938 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:27.938 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:27.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:27.938 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:27.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.938 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.070723043000001, 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:27.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.070665022, 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.944 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:27.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:27.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.950 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.070619375999996, 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:27.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:27.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.070566155999998, 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:27.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.961 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.070529997999998, 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:27.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:27.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:27.967 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.070462746000004, 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:27.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:27.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.070427660000007, 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:27.974 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:27.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:27.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.978 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.070387126, 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:27.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.982 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.070337480999996, 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:27.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:27.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.066696894000003, 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:27.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.066117496999993, 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.991 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:27.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.064359584000002, 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:27.999 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.063685543000005, 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:28.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:28.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.063476625999996, 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:28.003 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:28.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.063399892999996, 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:28.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.063139563999997, 2024-04-19T03:37:28.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:28.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.060206179999994, 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:28.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.018 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.059958148999996, 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:28.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:28.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.059934685000002, 2024-04-19T03:37:28.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:28.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 83.415967623, 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:28.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:28.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:28.032 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:28.034 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:28.033+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:28.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:28.134 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:28.134+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:28.187 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:28.187 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:28.187 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:28.187 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:28.198 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:28.235 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:28.235+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:28.336 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:28.335+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:28.373 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:37:28.385 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:28.385 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:28.386 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:28.386 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:28.386 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:28.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:28.436 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:28.436+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:28.538 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:28.537+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:28.542 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:28.542 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.674667381000006, 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:28.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:28.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.674622587000002, 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:28.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.674566991999995, 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.674526654000005, 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.561 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:28.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.674496661000006, 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.674466936000002, 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.674426381000004, 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.674403760000004, 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.674375366000007, 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.665973746999995, 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.665921396000002, 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.665822692999996, 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.665769612000005, 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.665723033999996, 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.665403728000001, 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.664653203, 2024-04-19T03:37:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.664592717999994, 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.664550738000003, 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.664455813999993, 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.663162743000001, 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:28.641 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:28.642 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:28.643 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:28.642+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:28.743 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:28.742+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:28.782 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:28.783 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:28.783 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:28.783 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:28.794 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:28.878 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:28.877+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:28.946 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:28.945+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:28.960 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:28.961 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:28.961 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:28.961 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:28.961 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:28.971 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:29.055 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:29.054+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.273322575999998, 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.141 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:29.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:29.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.273264554999997, 2024-04-19T03:37:29.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:29.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.273218908999993, 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:29.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.273165688999995, 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.158 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:29.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:29.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.273129530999995, 2024-04-19T03:37:29.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.168 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.273062279000001, 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.273027193000004, 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.177 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.272986658999997, 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:29.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.181 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.272937013999993, 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:29.185 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.269296427, 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:29.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:29.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:29.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.268717030000005, 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.266959116999999, 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:29.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:29.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.266285076000003, 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:29.201 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.266076158999994, 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:29.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:29.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:29.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.265999425999993, 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:29.205 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:29.209 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.265739096999994, 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.262805713000006, 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.213 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:29.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:29.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:29.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.262557681999994, 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 89.262534217999999, 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:29.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:29.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 84.618567155999997, 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:29.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:29.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.229 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:29.230 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:29.230 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:29.231 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:29.230+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:29.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:29.332 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:29.331+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:29.382 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:29.382 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:29.382 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:29.382 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:29.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:29.432 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:29.432+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:29.534 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:29.534+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:29.580 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:29.580 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:29.580 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:29.580 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:29.580 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:29.592 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:29.635 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:29.634+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:29.736 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.869168970999993, 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:29.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:29.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.869124177000003, 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:29.743 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:29.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:29.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:29.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.869068581999997, 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.749 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:29.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:29.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:29.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:29.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:29.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.869028244000006, 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.756 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.868998250999994, 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:29.762 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:29.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:29.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:29.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.772 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:29.772 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.868968526000003, 2024-04-19T03:37:29.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:29.772 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.772 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.772 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:29.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:29.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:29.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:29.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:29.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:29.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:29.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:29.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:29.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:29.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:29.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:29.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:29.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:29.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:29.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:29.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:29.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:29.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:29.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:29.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:29.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:29.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:29.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:29.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:29.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:29.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:29.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:29.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:29.784 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.784 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.785 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.785 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.785 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:29.785 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.868927971000005, 2024-04-19T03:37:29.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:29.786 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.786 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.786 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:29.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:29.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:29.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:29.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:29.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:29.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:29.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:29.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:29.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:29.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:29.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:29.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:29.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:29.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:29.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:29.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:29.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:29.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:29.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:29.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:29.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:29.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:29.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:29.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:29.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.797 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.798 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.798 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:29.798 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.868905350000006, 2024-04-19T03:37:29.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:29.798 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.798 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:29.798 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.802 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.868876955999994, 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:29.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.860475336999997, 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.807 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:29.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:29.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:29.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.860422986000003, 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:29.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:29.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:29.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:29.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.860324282999997, 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.817 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:29.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.860271202000007, 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:29.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:29.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.860224623999997, 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.826 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:29.830 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.859905318000003, 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.834 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.859154793000002, 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:29.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:29.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.859094307999996, 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.839 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:29.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:29.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:29.843 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.859052328000004, 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:29.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:29.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:29.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:29.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.847 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.848 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:29.848 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:29.848 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.858957403999995, 2024-04-19T03:37:29.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:29.848 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.849 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:29.849 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:29.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:29.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:29.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:29.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:29.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:29.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:29.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:29.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:29.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:29.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:29.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:29.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:29.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:29.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:29.854 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.854 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.855 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.855 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:29.855 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:29.855 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.857664333000002, 2024-04-19T03:37:29.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:29.855 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:29.856 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:29.856 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:29.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:29.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:29.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:29.859 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:29.860 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:29.735+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:29.861 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:29.903 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:29.902+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:29.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:29.978 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:29.978+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:29.997 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:29.998 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:29.998 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:29.998 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:30.007 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:30.080 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:30.079+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:30.159 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:30.175 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:30.176 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:30.176 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:30.180 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:30.179+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:30.186 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:30.196 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:30.196 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:30.197 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:30.197 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:30.200 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:30.201 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:30.281 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:30.280+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:30.353 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:30.353 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:30.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:30.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:37:30.407 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:30.407+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:30.482 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:30.482+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:30.516 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:30.517 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:30.528 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:30.612 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:30.612+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:30.688 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:30.688+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:30.713 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:30.713 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:30.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:30.790 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:30.789+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:30.891 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:30.891+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:30.910 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:30.910 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:30.922 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:30.993 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:30.990+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:31.050 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:31.051 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:31.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:31.092 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:31.092+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:31.193 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:31.192+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:31.227 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:31.228 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:31.237 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:31.322 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:31.321+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:31.380 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:37:31.395 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:31.394+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:31.406 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:31.406 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:31.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:31.496 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:31.496+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:31.568 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:31.568 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:31.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:31.598 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:31.596+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:31.699 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:31.698+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:31.722 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:31.722 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:31.733 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:31.799 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:31.799+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:31.900 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:31.900+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:31.920 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:31.920 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:31.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:32.001 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:32.000+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:32.064 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:32.065 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:32.075 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:32.116 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:32.115+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:32.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:32.203 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:32.203+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:32.241 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:32.242 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:32.252 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:32.304 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:32.304+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:32.370 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:32.379 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:32.379 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:32.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:32.393 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:32.393 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:32.394 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:32.397 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:32.397 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:32.434 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:32.434+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:32.505 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:32.505+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:32.542 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:32.542 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:32.542 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:32.542 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:32.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:32.638 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:32.638+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:32.707 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:32.706+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:32.739 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:32.739 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:32.739 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:32.739 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:32.739 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:32.751 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:32.835 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:32.835+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:32.909 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:32.909+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:32.939 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:32.939 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.072338239000004, 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:32.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:32.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:32.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.072293445, 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:32.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.072237849999993, 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:32.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:32.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:32.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:32.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:32.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:32.957 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.072197512000002, 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:32.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.963 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.072167519000004, 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:32.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:32.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.072137794, 2024-04-19T03:37:32.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.072097239000001, 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.975 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:32.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:32.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:32.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:32.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.072074618000002, 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:32.985 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.072046224000005, 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.063644604999993, 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:32.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:32.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:32.993 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.063592254, 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:32.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:32.997 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.063493550999993, 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:32.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:32.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:33.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:33.001 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.063440470000003, 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:33.005 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.063393891999993, 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:33.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:33.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:33.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.063074585999999, 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:33.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.062324060999998, 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:33.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.062263576000007, 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.062221596000001, 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:33.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:33.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.026 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.062126672000005, 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:33.030 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.060833600999999, 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:33.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:33.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:33.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:33.034 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:33.036 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:33.035+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:33.036 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:33.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~64s 2024-04-19T03:37:33.136 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:33.136+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:33.171 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:33.171 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:33.171 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:33.171 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:33.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:33.238 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:33.237+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:33.308 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:33.308 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:33.308 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:33.309 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:33.309 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:33.318 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:33.338 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:33.338+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:33.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:37:33.439 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:33.438+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:33.487 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.620271316, 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:33.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:33.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:33.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:33.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.620213294999999, 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.493 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.620167648999995, 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.498 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:33.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:33.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:33.503 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.620114428999997, 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.620078270999997, 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:33.508 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.620011019000003, 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:33.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.518 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.619975933000006, 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:33.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:33.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:33.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.522 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.619935398999999, 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:33.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:33.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.619885753999995, 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:33.530 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.616245167000002, 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.615665770000007, 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.535 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:33.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:33.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.613907857000001, 2024-04-19T03:37:33.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:33.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:33.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.613233816000005, 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:14 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.613024898999996, 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028770800000000002, 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:33.547 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873026+0000", 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873025+0000", 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:33.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873032+0000", 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6869999999999997e-06 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873077+0000", 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4576000000000001e-05 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873089+0000", 2024-04-19T03:37:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2092999999999999e-05 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873130+0000", 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1211000000000002e-05 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873138+0000", 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873314+0000", 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000176064 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e14/13 ondisk, result = 0)", 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.612948165999995, 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000304622, 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873103+0000", 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873102+0000", 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873109+0000", 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873127+0000", 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151e-05 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873132+0000", 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3879999999999999e-06 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873334+0000", 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020129600000000001 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873342+0000", 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0649999999999999e-06 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873408+0000", 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5813000000000002e-05 2024-04-19T03:37:33.554 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.612687836999996, 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:33.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:33.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e15/13 ondisk, result = 0)", 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.609754452999994, 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023342799999999999, 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876297+0000", 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876296+0000", 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876310+0000", 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3515e-05 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876315+0000", 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7530000000000001e-06 2024-04-19T03:37:33.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876320+0000", 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876409+0000", 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9220000000000003e-05 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876417+0000", 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:37:33.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876530+0000", 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113554 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 15/13 rep_tid 8 lcod 15'4)", 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.609506421999995, 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00024692300000000002, 2024-04-19T03:37:33.562 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876545+0000", 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876544+0000", 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876547+0000", 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876554+0000", 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5570000000000001e-06 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876560+0000", 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876723+0000", 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016254099999999999 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876792+0000", 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8968999999999996e-05 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.565 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.609482958000001, 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:33.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 88.965515895999999, 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:33.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:33.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:33.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:33.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.575 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:33.575 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:33.575 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:33.576 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:33.576+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:33.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:33.677 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:33.676+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:33.730 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:33.730 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:33.730 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:33.730 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:33.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:33.782 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:33.782+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:33.844 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 90% (11251/12484) Updating files: 91% (11361/12484) Updating files: 92% (11486/12484) Updating files: 93% (11611/12484) Updating files: 94% (11735/12484) Updating files: 95% (11860/12484) Updating files: 96% (11985/12484) Updating files: 97% (12110/12484) Updating files: 98% (12235/12484) Updating files: 99% (12360/12484) Updating files: 100% (12484/12484) Updating files: 100% (12484/12484), done. 2024-04-19T03:37:33.879 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:33.878+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:33.927 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:33.927 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:33.927 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:33.927 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:33.927 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:33.938 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:33.980 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:33.979+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:34.080 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:34.080+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:34.127 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.259597004, 2024-04-19T03:37:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.259552209999995, 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.259496615000003, 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.259456276999998, 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.259426284, 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.259396558999995, 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.259356003999997, 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.259333382999998, 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.259304989, 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.250903370000003, 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.250851018999995, 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.250752316000003, 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.250699234999999, 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.250652657000003, 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.250333350999995, 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.249582825999994, 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:8 3.10 e15/13 3:0d89b25e:::603.00000000:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.249522341000002, 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010269850000000001, 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875459+0000", 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875458+0000", 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875464+0000", 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875474+0000", 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0105000000000001e-05 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875480+0000", 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5589999999999996e-06 2024-04-19T03:37:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875707+0000", 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000227216 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875727+0000", 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885702+0000", 2024-04-19T03:37:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099748119999999996 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885728+0000", 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6299999999999999e-05 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.249480360999996, 2024-04-19T03:37:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.249385437000001, 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.248092365999995, 2024-04-19T03:37:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:34.227 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:34.229 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:34.229 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:34.228+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:34.329 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:34.329+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:34.359 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:34.359 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:34.360 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:34.360 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:34.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:34.385 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:37:34.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:34.430 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:34.429+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:34.498 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:34.498 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:34.498 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:34.508 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:34.549 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:34.548+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:34.603 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:34.625 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:34.626 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:34.629 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:34.630 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:34.632 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:34.631+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:34.676 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:34.676 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:34.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:34.732 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:34.732+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:34.828 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'. 2024-04-19T03:37:34.828 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:34.828 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-19T03:37:34.829 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:34.830 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at 646b8c7d293 Merge pull request #56968 from zdover23/wip-doc-2024-04-18-backport-56879-to-reef 2024-04-19T03:37:34.834 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:34.833+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:34.835 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-19T03:37:34.839 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:34.839 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:34.852 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:34.859 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-19T03:37:34.862 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-19T03:37:34.862 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-19T03:37:34.935 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:34.934+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:34.994 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:34.994 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:35.005 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:35.049 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:35.049+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:35.136 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:35.135+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:35.147 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:35.147 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:35.159 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:35.238 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:35.238+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:35.290 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:35.290 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:35.300 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:35.344 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:35.342+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:35.358 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-19T03:37:35.422 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-19T03:37:35.427 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:35.427 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:35.437 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:35.441 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:35.440+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:35.465 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-19T03:37:35.467 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-19T03:37:35.467 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-19T03:37:35.508 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-19T03:37:35.513 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:37:35.514 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-19T03:37:35.541 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:35.539+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:35.575 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-04-19T03:37:35.576 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-04-19T03:37:35.576 DEBUG:teuthology.orchestra.run.smithi005:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=646b8c7d293d8ec31a40c69f7b3237b19c1be24d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-04-19T03:37:35.605 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:35.605 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:35.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:35.647 INFO:tasks.workunit.client.0.smithi005.stderr:+ set -e 2024-04-19T03:37:35.648 INFO:tasks.workunit.client.0.smithi005.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-04-19T03:37:35.656 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:35.655+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:35.673 INFO:tasks.workunit.client.0.smithi005.stderr:--2024-04-19 03:37:35-- http://download.ceph.com/qa/fsync-tester.c 2024-04-19T03:37:35.674 INFO:tasks.workunit.client.0.smithi005.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-19T03:37:35.695 INFO:tasks.workunit.client.0.smithi005.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-19T03:37:35.715 INFO:tasks.workunit.client.0.smithi005.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-19T03:37:35.718 INFO:tasks.workunit.client.0.smithi005.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-04-19T03:37:35.718 INFO:tasks.workunit.client.0.smithi005.stderr:Saving to: ‘fsync-tester.c’ 2024-04-19T03:37:35.724 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:35.724 INFO:tasks.workunit.client.0.smithi005.stderr: 0K .. 100% 230M=0s 2024-04-19T03:37:35.724 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:35.724 INFO:tasks.workunit.client.0.smithi005.stderr:2024-04-19 03:37:35 (230 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-04-19T03:37:35.725 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-19T03:37:35.725 INFO:tasks.workunit.client.0.smithi005.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-04-19T03:37:35.744 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:35.742+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:35.770 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:35.770 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:35.781 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:35.795 INFO:tasks.workunit.client.0.smithi005.stderr:+ ./fsync-tester 2024-04-19T03:37:35.844 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:35.844+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:35.925 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:35.925 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:35.937 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:35.946 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:35.945+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.047 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:36.047+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:36.124 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:36.125 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:36.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:36.180 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:36.178+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.249 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:36.247+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.267 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:36.267 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:36.279 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:36.363 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:36.362+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:37:36.448 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:36.448 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:36.451 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:36.449+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.458 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:36.552 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:36.550+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.626 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:36.626 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:36.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:36.637 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:36.678 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:36.677+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.754 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:36.753+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.790 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:36.791 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:36.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:36.842 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:36.854 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:36.852+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.865 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:36.870 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:36.870 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:36.949 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:36.950 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:36.950 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:36.950 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:36.950 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:36.955 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:36.954+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:36.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:37.056 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:37.055+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:37.106 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.239040255999996, 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:37.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:37.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:37.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:37.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:37.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.238995462000005, 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:37.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:37.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:37.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:37.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:37.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.238939866999999, 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:37.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.238899528999994, 2024-04-19T03:37:37.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:37.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:37.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.134 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.238869535999996, 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.141 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.238839811000005, 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:37.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:37.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:37.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:37.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:37.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:37.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:37.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:37.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:37.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.238799255999993, 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:37.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:37.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:37.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:37.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:37.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:37.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:37.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:37.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:37.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:37.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:37.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.238776634999994, 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:37.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:37.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.164 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.165 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.165 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.165 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:37.165 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.238748240999996, 2024-04-19T03:37:37.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:37.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:37.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:37.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:37.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:37.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:37.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:37.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:37.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:37.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:37.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:37.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:37.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:37.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:37.172 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.173 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.173 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.173 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:37.173 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:37.173 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.230346621999999, 2024-04-19T03:37:37.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:37.174 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.174 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.174 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:37.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:37.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:37.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:37.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.179 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.179 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:37.180 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:37.180 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.230294271000005, 2024-04-19T03:37:37.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:37.180 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.180 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.180 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:37.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:37.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:37.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:37.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.185 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.186 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:11 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:37.186 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:37.186 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.230195567999999, 2024-04-19T03:37:37.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010418142, 2024-04-19T03:37:37.186 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874229+0000", 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874228+0000", 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874241+0000", 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2931999999999999e-05 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874251+0000", 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0387999999999999e-05 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874260+0000", 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3820000000000004e-06 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874661+0000", 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040105499999999999 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874683+0000", 2024-04-19T03:37:37.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2432000000000001e-05 2024-04-19T03:37:37.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884613+0000", 2024-04-19T03:37:37.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099301930000000004 2024-04-19T03:37:37.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884647+0000", 2024-04-19T03:37:37.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3291999999999999e-05 2024-04-19T03:37:37.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.191 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:6 3.10 e15/13 3:09401a81:::601.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.230142486999995, 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010567633, 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:37.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874282+0000", 2024-04-19T03:37:37.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874281+0000", 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874287+0000", 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1160000000000004e-06 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874296+0000", 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6880000000000005e-06 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874317+0000", 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1107999999999998e-05 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874807+0000", 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049005800000000003 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874832+0000", 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4479999999999999e-05 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884829+0000", 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099972080000000005 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884849+0000", 2024-04-19T03:37:37.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0387e-05 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:33 3.14 e15/13 3:2f55791f:::606.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.230095908999999, 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010353733, 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.197 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874328+0000", 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874341+0000", 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2778e-05 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874349+0000", 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874363+0000", 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3597999999999999e-05 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874977+0000", 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061435199999999998 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874991+0000", 2024-04-19T03:37:37.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3831e-05 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884652+0000", 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0096604480000000003 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884682+0000", 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0266000000000001e-05 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.201 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.202 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.202 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:37.202 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:37.202 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.229776603000005, 2024-04-19T03:37:37.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:7 3.10 e15/13 3:0bd6d154:::602.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.229026078000004, 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010301133000000001, 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.207 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875398+0000", 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875397+0000", 2024-04-19T03:37:37.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875422+0000", 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4853000000000001e-05 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875434+0000", 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2013e-05 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875445+0000", 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0378e-05 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875481+0000", 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6205999999999999e-05 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875493+0000", 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885670+0000", 2024-04-19T03:37:37.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010176315 2024-04-19T03:37:37.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885699+0000", 2024-04-19T03:37:37.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9433000000000001e-05 2024-04-19T03:37:37.211 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.211 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.228923613000006, 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:37.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:37.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.216 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.228828688999997, 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:37.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:37.221 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 97.227535618000005, 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:37.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.225 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.226 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:15 4.2f e46/14 4:f59f865b:::100000001f8.00000007:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:37.226 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:36.851648+0000", 2024-04-19T03:37:37.226 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.25277614500000001, 2024-04-19T03:37:37.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012531601999999999, 2024-04-19T03:37:37.226 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:37.227 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.227 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:37.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:37.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.851648+0000", 2024-04-19T03:37:37.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.851648+0000", 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.851647+0000", 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:37.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856505+0000", 2024-04-19T03:37:37.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004858111 2024-04-19T03:37:37.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856529+0000", 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3770000000000001e-05 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856539+0000", 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0353999999999999e-05 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:37.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856601+0000", 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1988000000000003e-05 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856631+0000", 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9998e-05 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.864119+0000", 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074875610000000002 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:37.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.864180+0000", 2024-04-19T03:37:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0883e-05 2024-04-19T03:37:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:37.233 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:37.234 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:37.235 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:37.233+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:37.334 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:37.332+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:37.363 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:37.363 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:37.363 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:37.363 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:37.374 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:37.392 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:37:37.458 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:37.457+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:37.537 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:37.536+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:37.540 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:37.540 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:37.540 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:37.540 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:37.540 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:37.550 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:37.638 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:37.637+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.854249026999994, 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:37.722 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:37.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:37.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.854191005999994, 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.728 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:37.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.854145360000004, 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:37.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.738 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.739 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.739 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.739 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:37.739 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.854092140000006, 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:37.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:37.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:37.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:37.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:37.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:37.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:37.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:37.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.746 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.854055982000006, 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:37.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:37.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:37.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:37.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:37.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.853988729999998, 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:37.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.759 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.853953644000001, 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:37.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.763 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.853913109999993, 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:37.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.853863465000003, 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:37.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:12 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.850222877999997, 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053722320000000002, 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869806+0000", 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869805+0000", 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869814+0000", 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9060000000000008e-06 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869824+0000", 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0156000000000001e-05 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.869839+0000", 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4705999999999999e-05 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870166+0000", 2024-04-19T03:37:37.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032726599999999999 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870190+0000", 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4215000000000001e-05 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875145+0000", 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049540770000000003 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875178+0000", 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3694e-05 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:34 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.849643481000001, 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048289029999999998, 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870385+0000", 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870393+0000", 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3270000000000001e-06 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870404+0000", 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0678e-05 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870412+0000", 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1249999999999993e-06 2024-04-19T03:37:37.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870450+0000", 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8189000000000003e-05 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.870468+0000", 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7949999999999999e-05 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875182+0000", 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047144589999999998 2024-04-19T03:37:37.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875214+0000", 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1942e-05 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.847885567999995, 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033651969999999999, 2024-04-19T03:37:37.780 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872143+0000", 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872160+0000", 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872167+0000", 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0820000000000001e-06 2024-04-19T03:37:37.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872176+0000", 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8219999999999996e-06 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872217+0000", 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1139e-05 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872233+0000", 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5528000000000001e-05 2024-04-19T03:37:37.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875475+0000", 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032416400000000001 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875508+0000", 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3853999999999998e-05 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.784 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 15/13 rep_tid 3 lcod 15'1)", 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.847211526999999, 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054783800000000004, 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872817+0000", 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872822+0000", 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872832+0000", 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0189999999999995e-06 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872840+0000", 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4530000000000002e-06 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873274+0000", 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000434521 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873365+0000", 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0669999999999998e-05 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 0 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:28 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.846665548000004, 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022851640000000001, 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.788 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873363+0000", 2024-04-19T03:37:37.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8355999999999998e-05 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873397+0000", 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5988e-05 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873413+0000", 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5968999999999999e-05 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873449+0000", 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5994000000000001e-05 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.875648+0000", 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002199627 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.791 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(mds.0.3:16 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 97.843460668999995, 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047864470000000001, 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876568+0000", 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876573+0000", 2024-04-19T03:37:37.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4369999999999998e-06 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876581+0000", 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876690+0000", 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105426 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876709+0000", 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-05 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881326+0000", 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046168659999999999 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.881355+0000", 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8764000000000001e-05 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 93.199493606999994, 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019725139999999999, 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520535+0000", 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520533+0000", 2024-04-19T03:37:37.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520548+0000", 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520579+0000", 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1423000000000001e-05 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520597+0000", 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8549000000000001e-05 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520715+0000", 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011711599999999999 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520829+0000", 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114005 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.520940+0000", 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111566 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.521582+0000", 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064220300000000004 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522437+0000", 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085467900000000001 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522473+0000", 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6198000000000001e-05 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:36:04.522508+0000", 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:16 4.2c 4:36128e15:::100000001f8.00000008:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:36.959618+0000", 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.76041075800000002, 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099145729999999994, 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 16 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.959618+0000", 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.959618+0000", 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.959616+0000", 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963246+0000", 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036296480000000001 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963259+0000", 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2962999999999999e-05 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963266+0000", 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4100000000000002e-06 2024-04-19T03:37:37.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963337+0000", 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0568000000000006e-05 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963477+0000", 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000140638 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.969427+0000", 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059499490000000004 2024-04-19T03:37:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.969466+0000", 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8624999999999997e-05 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.969533+0000", 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6882000000000001e-05 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18 4.33 e46/14 4:cf6d7a6c:::100000001f8.0000000a:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.51737643, 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012782457000000001, 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202650+0000", 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206458+0000", 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003808016 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206470+0000", 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2455e-05 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206495+0000", 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4888e-05 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206545+0000", 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9314000000000003e-05 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206562+0000", 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723e-05 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215395+0000", 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088321920000000009 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215435+0000", 2024-04-19T03:37:37.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0315999999999998e-05 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.40438304000000003, 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:37.811 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:37:37.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:37.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:21 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.555031+0000", 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.16499760999999999, 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010351491000000001, 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 21 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.555031+0000", 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.555031+0000", 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.555028+0000", 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559019+0000", 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039910859999999996 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559042+0000", 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3053000000000001e-05 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559054+0000", 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1408e-05 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559105+0000", 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1505000000000002e-05 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559221+0000", 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115813 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.565298+0000", 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006077341 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.565334+0000", 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6108000000000001e-05 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.565383+0000", 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8260000000000002e-05 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:37.821 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:37.823 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:37.822+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:37.824 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:37.924 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:37.923+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:37.978 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:37.978 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:37.978 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:37.979 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:37.989 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:38.031 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:38.030+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:38.126 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:38.125+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:38.177 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:38.177 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:38.177 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:38.177 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:38.177 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:38.189 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:38.233 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:38.233+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:38.328 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:38.327+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:38.333 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.466357658999996, 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:38.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:38.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:38.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:38.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.466312865000006, 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:38.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:38.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.346 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.46625727, 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:38.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:38.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:38.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.466216931999995, 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:38.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:38.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.466186938999996, 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.359 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:38.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.466157214000006, 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.365 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:38.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:38.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:38.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:38.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:38.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:38.373 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.373 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.373 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.373 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.373 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.466116658999994, 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:38.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:38.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.379 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.466094037999994, 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:38.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:38.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:38.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.466065643999997, 2024-04-19T03:37:38.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:38.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:38.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:38.388 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:5 3.10 e15/13 3:0d82a743:::600.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.457664025, 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010748723, 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874078+0000", 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874077+0000", 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874090+0000", 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2616000000000001e-05 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874101+0000", 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0835e-05 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874110+0000", 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874247+0000", 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136933 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874269+0000", 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1759e-05 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884779+0000", 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010509724999999999 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884826+0000", 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7379000000000002e-05 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.457611674000006, 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.393 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:38.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:38.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:38.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.457094006000005, 2024-04-19T03:37:38.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:38.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.401 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.456241016000007, 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.456146091999997, 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:38.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:38.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:38.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.454853021000005, 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:38.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.413 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:15 4.2f e46/14 4:f59f865b:::100000001f8.00000007:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:36.851648+0000", 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.4800935479999999, 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012531601999999999, 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.851648+0000", 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.851648+0000", 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.851647+0000", 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856505+0000", 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004858111 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856529+0000", 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3770000000000001e-05 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856539+0000", 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0353999999999999e-05 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856601+0000", 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1988000000000003e-05 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856631+0000", 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9998e-05 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.864119+0000", 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074875610000000002 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.864180+0000", 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0883e-05 2024-04-19T03:37:38.417 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.133982458, 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:38.418 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:20 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:38.423 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.434071+0000", 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.89767046500000003, 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011093917, 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 20 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.434071+0000", 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.434071+0000", 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.434069+0000", 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.437982+0000", 2024-04-19T03:37:38.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039130429999999997 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.438002+0000", 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0644000000000001e-05 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.438013+0000", 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0701e-05 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.438159+0000", 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014539300000000001 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.438308+0000", 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149326 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.445054+0000", 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067460009999999997 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.445100+0000", 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5831999999999998e-05 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.445165+0000", 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5307000000000003e-05 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.53194103800000003, 2024-04-19T03:37:38.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016272293, 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 23 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799798+0000", 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804034+0000", 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042360970000000003 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804056+0000", 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1730999999999999e-05 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804067+0000", 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0727000000000001e-05 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804162+0000", 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5371999999999994e-05 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804308+0000", 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146205 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815916+0000", 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011607255 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815992+0000", 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6304999999999995e-05 2024-04-19T03:37:38.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.816073+0000", 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0945000000000005e-05 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.41558405700000001, 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:38.433 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:38.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:38.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:38.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.439 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:38.439 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:38.439 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:38.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:38.441 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:38.440+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:38.541 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:38.541+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:38.571 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:38.571 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:38.571 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:38.571 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:38.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:38.666 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:38.665+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:38.743 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:38.742+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:38.750 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:38.750 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:38.750 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:38.750 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:38.750 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:38.760 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:38.845 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:38.844+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:38.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:38.929 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.061828656000003, 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.930 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:38.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.935 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.061770635000002, 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074580489999999996, 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:38.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865838+0000", 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865837+0000", 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865842+0000", 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2630000000000003e-06 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865850+0000", 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5499999999999997e-06 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865862+0000", 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2448e-05 2024-04-19T03:37:38.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866170+0000", 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030760899999999997 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866305+0000", 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013498699999999999 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017203699999999999 2024-04-19T03:37:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872795+0000", 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063176300000000003 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873144+0000", 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034953799999999999 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873255+0000", 2024-04-19T03:37:38.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011096500000000001 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873296+0000", 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0652000000000003e-05 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.061724988999998, 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:38.941 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:38.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:38.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.061671769, 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074657070000000002, 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865937+0000", 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865936+0000", 2024-04-19T03:37:38.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865951+0000", 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4831000000000001e-05 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865959+0000", 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3319999999999992e-06 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865967+0000", 2024-04-19T03:37:38.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866857+0000", 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00089075600000000003 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866964+0000", 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010686700000000001 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867108+0000", 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000144024 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057823550000000003 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873348+0000", 2024-04-19T03:37:38.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000457021 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873381+0000", 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3627000000000002e-05 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873402+0000", 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1069000000000001e-05 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.061635611, 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:38.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:38.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:38.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:38.958 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.061568359000006, 2024-04-19T03:37:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:38.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:38.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.061533272999995, 2024-04-19T03:37:38.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.061492739000002, 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:38.972 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 99.061443093999998, 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071942940000000004, 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:38.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866165+0000", 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866172+0000", 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6730000000000003e-06 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866176+0000", 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4909999999999999e-06 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866190+0000", 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3506000000000001e-05 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866268+0000", 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8831000000000005e-05 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866444+0000", 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017581399999999999 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873360+0000", 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069154890000000004 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.976 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:16 4.2c 4:36128e15:::100000001f8.00000008:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:36.959618+0000", 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.967990387, 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099145729999999994, 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 16 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.959618+0000", 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.959618+0000", 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.959616+0000", 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963246+0000", 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036296480000000001 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963259+0000", 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2962999999999999e-05 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963266+0000", 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4100000000000002e-06 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963337+0000", 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0568000000000006e-05 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.963477+0000", 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000140638 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.969427+0000", 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059499490000000004 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.969466+0000", 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8624999999999997e-05 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:36.969533+0000", 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6882000000000001e-05 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.981 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18 4.33 e46/14 4:cf6d7a6c:::100000001f8.0000000a:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.7249560590000002, 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012782457000000001, 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202650+0000", 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206458+0000", 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003808016 2024-04-19T03:37:38.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206470+0000", 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2455e-05 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206495+0000", 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4888e-05 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206545+0000", 2024-04-19T03:37:38.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9314000000000003e-05 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206562+0000", 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723e-05 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215395+0000", 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088321920000000009 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215435+0000", 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0315999999999998e-05 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.611962669, 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.986 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:37:38.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:37:38.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:37:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:37:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:37:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:37:38.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:37:38.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.994 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:21 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.555031+0000", 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3725772389999999, 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010351491000000001, 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 21 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.995 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.555031+0000", 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.555031+0000", 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.555028+0000", 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:38.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559019+0000", 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039910859999999996 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559042+0000", 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3053000000000001e-05 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559054+0000", 2024-04-19T03:37:38.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1408e-05 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559105+0000", 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1505000000000002e-05 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559221+0000", 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115813 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:38.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.565298+0000", 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006077341 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.565334+0000", 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6108000000000001e-05 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.565383+0000", 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8260000000000002e-05 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:38.999 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.248147549, 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014462462000000001, 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 22 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:39.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679458+0000", 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683146+0000", 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036878869999999999 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683169+0000", 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2699000000000001e-05 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683183+0000", 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3684e-05 2024-04-19T03:37:39.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683264+0000", 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1086000000000003e-05 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683369+0000", 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105289 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683466+0000", 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7298000000000003e-05 2024-04-19T03:37:39.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.689790+0000", 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063238010000000004 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693826+0000", 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040361140000000004 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693880+0000", 2024-04-19T03:37:39.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3480999999999998e-05 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693923+0000", 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3612000000000002e-05 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:24 4.36 e47/14 4:6c9c34b1:::100000001f8.00000010:head v 47'2, mlcod=0'0)", 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.006930101, 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013771834, 2024-04-19T03:37:39.005 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920677+0000", 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924314+0000", 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036369900000000001 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924329+0000", 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4752e-05 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924356+0000", 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7506000000000001e-05 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924405+0000", 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495000000000002e-05 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924431+0000", 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6678000000000001e-05 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934351+0000", 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.009920023 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934450+0000", 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8826000000000006e-05 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:27 4.36 e47/14 4:6fa85f86:::100000001f8.00000013:head v 47'3, mlcod=46'1)", 2024-04-19T03:37:39.009 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.291936+0000", 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.63567248300000001, 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01057407, 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.291936+0000", 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.291936+0000", 2024-04-19T03:37:39.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.291934+0000", 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295554+0000", 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036199309999999998 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295566+0000", 2024-04-19T03:37:39.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2778e-05 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295591+0000", 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4431e-05 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295636+0000", 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4787000000000003e-05 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:39.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295662+0000", 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5928e-05 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.302474+0000", 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006812238 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.302510+0000", 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6183999999999998e-05 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.013 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:28 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.52121475399999995, 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010584817999999999, 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 28 2024-04-19T03:37:39.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406392+0000", 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410220+0000", 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038274910000000001 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410235+0000", 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5597999999999999e-05 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410247+0000", 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1963e-05 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410324+0000", 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6571999999999998e-05 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410437+0000", 2024-04-19T03:37:39.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112811 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416885+0000", 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064479460000000004 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416922+0000", 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7481000000000002e-05 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416979+0000", 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6548000000000001e-05 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.40051408100000002, 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:37:39.019 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:37:39.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:37:39.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:37:39.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:37:39.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:30 4.14 e47/14 4:2b28d75f:::100000001f8.00000016:head v 47'1, mlcod=0'0)", 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.652355+0000", 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.27525322400000002, 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099066420000000002, 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.652355+0000", 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.652355+0000", 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.652354+0000", 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:39.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.656118+0000", 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037645180000000001 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.656140+0000", 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1475e-05 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.656149+0000", 2024-04-19T03:37:39.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5619999999999993e-06 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.656197+0000", 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7836000000000001e-05 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.656215+0000", 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8063999999999998e-05 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.662209+0000", 2024-04-19T03:37:39.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0059944719999999998 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.662262+0000", 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2429999999999998e-05 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:31 4.30 4:0c89e311:::100000001f8.00000017:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.15752350700000001, 2024-04-19T03:37:39.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011301624999999999, 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 31 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770081+0000", 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999962 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774108+0000", 2024-04-19T03:37:39.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040261660000000003 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774129+0000", 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1739999999999999e-05 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774140+0000", 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.047e-05 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:39.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774186+0000", 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5938e-05 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774291+0000", 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105497 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781291+0000", 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069996030000000001 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781336+0000", 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5241000000000003e-05 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781387+0000", 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0596999999999997e-05 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:39.034 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:39.036 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:39.035+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:39.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:39.060 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:39.081 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:39.081 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:39.082 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:39.085 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:39.085 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:39.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-04-19T03:37:39.136 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:39.136+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:39.192 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:39.192 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:39.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:39.245 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:39.245+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:39.338 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:39.338+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:39.391 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:39.391 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:39.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:39.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:37:39.439 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:39.438+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:39.540 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:39.540+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:39.548 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:39.548 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:39.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:39.641 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:39.640+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:39.690 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:39.691 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:39.701 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:39.745 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:39.744+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:39.829 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:39.829 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:39.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:39.842 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:39.841+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:39.943 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:39.942+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:40.009 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:40.009 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:40.018 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:40.059 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:40.058+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:40.145 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:40.144+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:40.172 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:40.172 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:40.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:40.267 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:40.266+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:40.347 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:40.346+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:40.373 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:40.373 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:40.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:40.406 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:37:40.468 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:40.467+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:40.549 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:40.548+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:40.571 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:40.571 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:40.582 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:40.650 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:40.649+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:40.711 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:40.711 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:40.721 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:40.763 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:40.762+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:40.852 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:40.851+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:40.889 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:40.889 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:40.900 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:40.984 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:40.983+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:41.055 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:41.054+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:41.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:41.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:41.155 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:41.154+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:41.229 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:41.229 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:41.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:41.256 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:41.255+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:41.261 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:41.283 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:41.284 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:41.284 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:41.284 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:41.287 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:41.287 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:41.357 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:41.356+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:41.385 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:41.385 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:41.385 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:41.385 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:41.385 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:41.397 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:41.458 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:41.457+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.674200141, 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.674155347, 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.674099752, 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.674059414, 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.674029421, 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:41.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:41.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.673999696, 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.673959141, 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.578 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:41.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:41.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:41.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.67393652, 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:41.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.588 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.673908126, 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:41.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.665454156, 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:41.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:41.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.664936488, 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:41.597 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:41.601 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.664083498, 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:41.605 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.663988574, 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:41.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:41.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.609 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "pg_update_log_missing(3.14 epoch 15/13 rep_tid 173 entries 15'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:21 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.66269550299999, 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013515374, 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876889+0000", 2024-04-19T03:37:41.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876888+0000", 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876896+0000", 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8199999999999997e-06 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876907+0000", 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876914+0000", 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3760000000000002e-06 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.879236+0000", 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002321516 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890404+0000", 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011168202 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:15 4.2f e46/14 4:f59f865b:::100000001f8.00000007:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:36.851648+0000", 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6879360300000004, 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012531601999999999, 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.851648+0000", 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.851648+0000", 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.851647+0000", 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856505+0000", 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004858111 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856529+0000", 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3770000000000001e-05 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856539+0000", 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0353999999999999e-05 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856601+0000", 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1988000000000003e-05 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.856631+0000", 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9998e-05 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.864119+0000", 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074875610000000002 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:36.864180+0000", 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0883e-05 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.3418249400000004, 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.617 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:37:41.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:37:41.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:37:41.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.73978352, 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016272293, 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 23 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799798+0000", 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804034+0000", 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042360970000000003 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804056+0000", 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1730999999999999e-05 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804067+0000", 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0727000000000001e-05 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804162+0000", 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5371999999999994e-05 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804308+0000", 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146205 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815916+0000", 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011607255 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815992+0000", 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6304999999999995e-05 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.816073+0000", 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0945000000000005e-05 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.623426539, 2024-04-19T03:37:41.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.632 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.2533883829999999, 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016569639000000001, 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.633 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286193+0000", 2024-04-19T03:37:41.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291309+0000", 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051164189999999997 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291329+0000", 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9864000000000002e-05 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291339+0000", 2024-04-19T03:37:41.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0127e-05 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291389+0000", 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9694999999999998e-05 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291519+0000", 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012998400000000001 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:41.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291637+0000", 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118137 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.295752+0000", 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041148570000000004 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302676+0000", 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069241370000000003 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302716+0000", 2024-04-19T03:37:41.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0046999999999998e-05 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302765+0000", 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9057999999999997e-05 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:30 4.14 4:2b28d75f:::100000001f8.00000016:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:38.647719+0000", 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.8918645700000001, 2024-04-19T03:37:41.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015045325, 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 30 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.647719+0000", 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.647719+0000", 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.647716+0000", 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651706+0000", 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003989701 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651729+0000", 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2631999999999999e-05 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651743+0000", 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4640999999999999e-05 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651839+0000", 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5738999999999999e-05 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651977+0000", 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013755500000000001 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.652099+0000", 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012282800000000001 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.657086+0000", 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049861130000000004 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.662639+0000", 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055530950000000001 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.662733+0000", 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4205999999999999e-05 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.662765+0000", 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1958000000000001e-05 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.643 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:41.644 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:41.644 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:41.645 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:41.646 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:41.644+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:41.746 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:41.745+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:41.773 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:41.773 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:41.774 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:41.774 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:41.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:41.847 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:41.847+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:41.910 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:41.910 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:41.910 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:41.910 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:41.910 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:41.923 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:41.948 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:41.947+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:42.049 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:42.048+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:42.094 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.22619111500001, 2024-04-19T03:37:42.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:42.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:42.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.226087448, 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.22599807, 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:42.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:42.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:42.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.22593081799999, 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010430353999999999, 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866040+0000", 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866044+0000", 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866060+0000", 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866066+0000", 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389999999999997e-05 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866307+0000", 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000191416 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866477+0000", 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000169326 2024-04-19T03:37:42.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872826+0000", 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063493259999999998 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876370+0000", 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00354368 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4613999999999997e-05 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876470+0000", 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6190999999999998e-05 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.225895732, 2024-04-19T03:37:42.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 102.225855198, 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:42.119 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:42.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18 4.33 e46/14 4:cf6d7a6c:::100000001f8.0000000a:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.8893185179999996, 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012782457000000001, 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202650+0000", 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:42.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206458+0000", 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003808016 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206470+0000", 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2455e-05 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206495+0000", 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4888e-05 2024-04-19T03:37:42.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206545+0000", 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9314000000000003e-05 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206562+0000", 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723e-05 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215395+0000", 2024-04-19T03:37:42.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088321920000000009 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215435+0000", 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0315999999999998e-05 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.7763251279999999, 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:37:42.127 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:37:42.132 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:21 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.555031+0000", 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5369396980000003, 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010351491000000001, 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.133 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 21 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.555031+0000", 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.555031+0000", 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.555028+0000", 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559019+0000", 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039910859999999996 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559042+0000", 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3053000000000001e-05 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559054+0000", 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1408e-05 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559105+0000", 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1505000000000002e-05 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.559221+0000", 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115813 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.565298+0000", 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006077341 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.565334+0000", 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6108000000000001e-05 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.565383+0000", 2024-04-19T03:37:42.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8260000000000002e-05 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4125100079999999, 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014462462000000001, 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.138 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 22 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679458+0000", 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683146+0000", 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036878869999999999 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683169+0000", 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2699000000000001e-05 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683183+0000", 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3684e-05 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683264+0000", 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1086000000000003e-05 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683369+0000", 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105289 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683466+0000", 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7298000000000003e-05 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.689790+0000", 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063238010000000004 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693826+0000", 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040361140000000004 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693880+0000", 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3480999999999998e-05 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693923+0000", 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3612000000000002e-05 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:24 4.36 e47/14 4:6c9c34b1:::100000001f8.00000010:head v 47'2, mlcod=0'0)", 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:42.143 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.1712925600000004, 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013771834, 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920677+0000", 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924314+0000", 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036369900000000001 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924329+0000", 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4752e-05 2024-04-19T03:37:42.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924356+0000", 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7506000000000001e-05 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924405+0000", 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495000000000002e-05 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924431+0000", 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6678000000000001e-05 2024-04-19T03:37:42.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934351+0000", 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.009920023 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934450+0000", 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8826000000000006e-05 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:27 4.36 e47/14 4:6fa85f86:::100000001f8.00000013:head v 47'3, mlcod=46'1)", 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.291936+0000", 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.8000349419999999, 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01057407, 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.291936+0000", 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.291936+0000", 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.291934+0000", 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295554+0000", 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036199309999999998 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295566+0000", 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2778e-05 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295591+0000", 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4431e-05 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295636+0000", 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4787000000000003e-05 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.295662+0000", 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5928e-05 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.302474+0000", 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006812238 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.302510+0000", 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6183999999999998e-05 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:28 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.6855772130000002, 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010584817999999999, 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 28 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406392+0000", 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410220+0000", 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038274910000000001 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410235+0000", 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5597999999999999e-05 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410247+0000", 2024-04-19T03:37:42.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1963e-05 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410324+0000", 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6571999999999998e-05 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410437+0000", 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112811 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416885+0000", 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064479460000000004 2024-04-19T03:37:42.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416922+0000", 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7481000000000002e-05 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416979+0000", 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6548000000000001e-05 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.156 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.5648765400000002, 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:37:42.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:37:42.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:37:42.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:37:42.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:31 4.30 4:0c89e311:::100000001f8.00000017:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.321885966, 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011301624999999999, 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 31 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770081+0000", 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999962 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774108+0000", 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040261660000000003 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774129+0000", 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1739999999999999e-05 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774140+0000", 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.047e-05 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774186+0000", 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5938e-05 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774291+0000", 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105497 2024-04-19T03:37:42.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781291+0000", 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069996030000000001 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781336+0000", 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5241000000000003e-05 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781387+0000", 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0596999999999997e-05 2024-04-19T03:37:42.166 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.0777285289999998, 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015903805, 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.167 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014241+0000", 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018134+0000", 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038934180000000001 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018152+0000", 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8278e-05 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018163+0000", 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0647e-05 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018235+0000", 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2350999999999999e-05 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018354+0000", 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119178 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018459+0000", 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104245 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.023951+0000", 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054925169999999997 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030090+0000", 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061382679999999997 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030120+0000", 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0269000000000001e-05 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030146+0000", 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6418999999999999e-05 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.172 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.322601+0000", 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.76936994599999997, 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010526224000000001, 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.322601+0000", 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.322601+0000", 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.322598+0000", 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.326360+0000", 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003761711 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.326373+0000", 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2903e-05 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.326384+0000", 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0539e-05 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.326448+0000", 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4694000000000001e-05 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.326551+0000", 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010265899999999999 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.332990+0000", 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064388589999999999 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.333040+0000", 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0642000000000001e-05 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.333127+0000", 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6784000000000001e-05 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.438525+0000", 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.65344554200000005, 2024-04-19T03:37:42.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010450968999999999, 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.438525+0000", 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.438525+0000", 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.438524+0000", 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.442134+0000", 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036095480000000002 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.442147+0000", 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3233e-05 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.442156+0000", 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5680000000000005e-06 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.442225+0000", 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8961999999999995e-05 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.442329+0000", 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010329 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.448779+0000", 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064506449999999996 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.448864+0000", 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4754999999999997e-05 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.448976+0000", 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011225 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:56 4.38 4:1d13bf87:::100000001f8.00000030:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.42453382299999998, 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010642082000000001, 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.182 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 56 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:42.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667435+0000", 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671353+0000", 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039183680000000002 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671381+0000", 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8147999999999999e-05 2024-04-19T03:37:42.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671396+0000", 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5356999999999999e-05 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671447+0000", 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0478e-05 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671559+0000", 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011230099999999999 2024-04-19T03:37:42.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.677987+0000", 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064280470000000001 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.678025+0000", 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7960000000000002e-05 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.678079+0000", 2024-04-19T03:37:42.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3949000000000001e-05 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:58 4.28 e48/14 4:15eeb89b:::100000001f8.00000032:head v 48'1, mlcod=0'0)", 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.18219254700000001, 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010923644999999999, 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909777+0000", 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913712+0000", 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039352700000000003 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913739+0000", 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6806999999999999e-05 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913770+0000", 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0960999999999997e-05 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913820+0000", 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0209e-05 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913838+0000", 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7810000000000001e-05 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.920654+0000", 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068160989999999999 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:42.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.920702+0000", 2024-04-19T03:37:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7926999999999997e-05 2024-04-19T03:37:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:42.191 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:42.193 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:42.191+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:42.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:42.293 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:42.292+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:42.346 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:42.346 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:42.346 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:42.346 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:42.357 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:42.395 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:42.394+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:42.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:37:42.496 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:42.495+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:42.502 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:42.503 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:42.503 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:42.503 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:42.503 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:42.515 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:42.600 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:42.599+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:42.698 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:42.697+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:42.706 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:42.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.837243497, 2024-04-19T03:37:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.707 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:42.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:42.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:42.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:42.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:42.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.837198703, 2024-04-19T03:37:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.719 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.83714310800001, 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:42.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:42.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:42.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:42.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:42.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.83710277, 2024-04-19T03:37:42.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:42.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:42.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.731 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.837072777, 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:42.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:42.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.737 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.837043052, 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:42.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.837002497, 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.744 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:42.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:42.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.836979876, 2024-04-19T03:37:42.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.754 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.836951482, 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:42.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:42.759 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.828497512, 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:42.764 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.827979844, 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:1 3.14 e15/13 3:292cf221:::200.00000000:head v 15'3, mlcod=0'0)", 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.827126854, 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014804456000000001, 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875501+0000", 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875500+0000", 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875521+0000", 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0928999999999999e-05 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875530+0000", 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875537+0000", 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450000000000004e-06 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875593+0000", 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5639e-05 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875613+0000", 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0588999999999999e-05 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890266+0000", 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014652625000000001 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890305+0000", 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9164e-05 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:3 3.14 e15/13 3:287034c4:::1.00000000.inode:head v 15'4, mlcod=0'0)", 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.82703193, 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014743559, 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.773 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875595+0000", 2024-04-19T03:37:42.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875606+0000", 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1248e-05 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875614+0000", 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8169999999999999e-06 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875621+0000", 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3439999999999997e-06 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878793+0000", 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003172111 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.878816+0000", 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2841999999999999e-05 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890318+0000", 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011502581 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890339+0000", 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0939000000000001e-05 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.778 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:42.778 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:42.778 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.5048682959999997, 2024-04-19T03:37:42.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:37:42.778 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.779 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.779 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:42.779 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:42.779 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.779 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:37:42.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.779 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:42.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:42.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:37:42.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:42.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:37:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:37:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:37:42.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:37:42.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:37:42.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.785 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.9028268759999998, 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016272293, 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.786 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 23 2024-04-19T03:37:42.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.787 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:42.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:42.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799798+0000", 2024-04-19T03:37:42.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:42.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804034+0000", 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042360970000000003 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804056+0000", 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1730999999999999e-05 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804067+0000", 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0727000000000001e-05 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804162+0000", 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5371999999999994e-05 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804308+0000", 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146205 2024-04-19T03:37:42.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815916+0000", 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011607255 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815992+0000", 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6304999999999995e-05 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.816073+0000", 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0945000000000005e-05 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.791 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.7864698949999998, 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:37:42.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:42.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.4164317390000001, 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016569639000000001, 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-19T03:37:42.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286193+0000", 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291309+0000", 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051164189999999997 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291329+0000", 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9864000000000002e-05 2024-04-19T03:37:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291339+0000", 2024-04-19T03:37:42.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0127e-05 2024-04-19T03:37:42.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291389+0000", 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9694999999999998e-05 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291519+0000", 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012998400000000001 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291637+0000", 2024-04-19T03:37:42.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118137 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.295752+0000", 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041148570000000004 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302676+0000", 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069241370000000003 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302716+0000", 2024-04-19T03:37:42.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0046999999999998e-05 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302765+0000", 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9057999999999997e-05 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:30 4.14 4:2b28d75f:::100000001f8.00000016:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:38.647719+0000", 2024-04-19T03:37:42.804 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.0549079260000003, 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015045325, 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 30 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.647719+0000", 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.647719+0000", 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.647716+0000", 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651706+0000", 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003989701 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651729+0000", 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2631999999999999e-05 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651743+0000", 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4640999999999999e-05 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651839+0000", 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5738999999999999e-05 2024-04-19T03:37:42.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.651977+0000", 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013755500000000001 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.652099+0000", 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012282800000000001 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.657086+0000", 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049861130000000004 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.662639+0000", 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055530950000000001 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.662733+0000", 2024-04-19T03:37:42.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4205999999999999e-05 2024-04-19T03:37:42.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.662765+0000", 2024-04-19T03:37:42.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1958000000000001e-05 2024-04-19T03:37:42.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.810 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.811 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:58 4.28 4:15eeb89b:::100000001f8.00000032:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:42.811 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:42.811 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.79720052299999999, 2024-04-19T03:37:42.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015633246, 2024-04-19T03:37:42.812 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.812 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.812 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:42.812 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:42.812 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.812 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58 2024-04-19T03:37:42.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.813 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:42.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:42.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905425+0000", 2024-04-19T03:37:42.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:42.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909174+0000", 2024-04-19T03:37:42.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037485740000000002 2024-04-19T03:37:42.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909192+0000", 2024-04-19T03:37:42.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8377999999999999e-05 2024-04-19T03:37:42.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909204+0000", 2024-04-19T03:37:42.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2418999999999999e-05 2024-04-19T03:37:42.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909306+0000", 2024-04-19T03:37:42.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102038 2024-04-19T03:37:42.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909422+0000", 2024-04-19T03:37:42.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011593 2024-04-19T03:37:42.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:42.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909549+0000", 2024-04-19T03:37:42.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000127071 2024-04-19T03:37:42.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.916572+0000", 2024-04-19T03:37:42.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007022538 2024-04-19T03:37:42.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.920988+0000", 2024-04-19T03:37:42.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044155590000000003 2024-04-19T03:37:42.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921030+0000", 2024-04-19T03:37:42.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1956999999999998e-05 2024-04-19T03:37:42.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921060+0000", 2024-04-19T03:37:42.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0589000000000001e-05 2024-04-19T03:37:42.823 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.823 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.823 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.824 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:60 4.6 4:616d4c41:::100000001f8.00000034:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:42.824 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:42.824 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.57332733700000005, 2024-04-19T03:37:42.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015227233999999999, 2024-04-19T03:37:42.824 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:42.825 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:42.825 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:42.825 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:42.825 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:42.825 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 60 2024-04-19T03:37:42.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.825 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:42.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:42.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:42.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:42.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:42.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:42.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:42.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129298+0000", 2024-04-19T03:37:42.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:42.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:42.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133391+0000", 2024-04-19T03:37:42.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040920940000000001 2024-04-19T03:37:42.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:42.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133409+0000", 2024-04-19T03:37:42.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8289000000000001e-05 2024-04-19T03:37:42.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:42.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133421+0000", 2024-04-19T03:37:42.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2386e-05 2024-04-19T03:37:42.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:42.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133491+0000", 2024-04-19T03:37:42.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9621000000000003e-05 2024-04-19T03:37:42.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:42.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133627+0000", 2024-04-19T03:37:42.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013573 2024-04-19T03:37:42.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:42.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133749+0000", 2024-04-19T03:37:42.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012267699999999999 2024-04-19T03:37:42.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:42.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.138798+0000", 2024-04-19T03:37:42.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050491579999999998 2024-04-19T03:37:42.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:42.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144366+0000", 2024-04-19T03:37:42.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055673750000000003 2024-04-19T03:37:42.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:42.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144459+0000", 2024-04-19T03:37:42.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2981999999999998e-05 2024-04-19T03:37:42.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:42.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:42.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:42.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144527+0000", 2024-04-19T03:37:42.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8571999999999993e-05 2024-04-19T03:37:42.836 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.836 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.836 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.836 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:42.836 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:42.837 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:42.839 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:42.837+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:42.839 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:42.939 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:42.938+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:42.969 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:42.969 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:42.969 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:42.969 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:42.979 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:43.039 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:43.038+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:43.109 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:43.109 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:43.109 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:43.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:43.141 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:43.139+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:43.241 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:43.241+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:43.289 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:43.289 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:43.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:43.289 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:43.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.289 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:43.289 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:43.289 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 103.421209147, 2024-04-19T03:37:43.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:43.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:43.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:43.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:43.294 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 103.42110547999999, 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.295 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:43.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:43.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:43.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:43.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:43.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:43.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:43.301 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.301 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.302 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.302 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:43.302 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:43.302 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 103.421016102, 2024-04-19T03:37:43.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:43.303 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.303 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.303 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:43.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:43.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:43.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:43.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:43.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:43.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:43.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:43.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:43.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:43.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:43.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:43.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:43.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:43.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:43.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:43.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:43.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:43.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:43.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:43.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:43.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:43.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:43.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:43.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 103.42091376400001, 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:43.313 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.314 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:43.314 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:43.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:43.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:43.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:43.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:43.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:43.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:43.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:43.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:43.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:43.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:43.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:43.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:43.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.321 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 103.42087323, 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18 4.33 e46/14 4:cf6d7a6c:::100000001f8.0000000a:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.0843365499999997, 2024-04-19T03:37:43.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012782457000000001, 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202650+0000", 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206458+0000", 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003808016 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206470+0000", 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2455e-05 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206495+0000", 2024-04-19T03:37:43.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4888e-05 2024-04-19T03:37:43.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206545+0000", 2024-04-19T03:37:43.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9314000000000003e-05 2024-04-19T03:37:43.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206562+0000", 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723e-05 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215395+0000", 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088321920000000009 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215435+0000", 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0315999999999998e-05 2024-04-19T03:37:43.329 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.97134316, 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:43.330 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:43.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:43.335 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.60752804, 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014462462000000001, 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 22 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:43.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679458+0000", 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683146+0000", 2024-04-19T03:37:43.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036878869999999999 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683169+0000", 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2699000000000001e-05 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683183+0000", 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3684e-05 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683264+0000", 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1086000000000003e-05 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683369+0000", 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105289 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683466+0000", 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7298000000000003e-05 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.689790+0000", 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063238010000000004 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693826+0000", 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040361140000000004 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693880+0000", 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3480999999999998e-05 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693923+0000", 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3612000000000002e-05 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:24 4.36 e47/14 4:6c9c34b1:::100000001f8.00000010:head v 47'2, mlcod=0'0)", 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3663105919999996, 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013771834, 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920677+0000", 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:43.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924314+0000", 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036369900000000001 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924329+0000", 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4752e-05 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924356+0000", 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7506000000000001e-05 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924405+0000", 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495000000000002e-05 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924431+0000", 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6678000000000001e-05 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934351+0000", 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.009920023 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934450+0000", 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8826000000000006e-05 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:28 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:43.345 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.8805952450000003, 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010584817999999999, 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 28 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406392+0000", 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410220+0000", 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038274910000000001 2024-04-19T03:37:43.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410235+0000", 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5597999999999999e-05 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410247+0000", 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1963e-05 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410324+0000", 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6571999999999998e-05 2024-04-19T03:37:43.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410437+0000", 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112811 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416885+0000", 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064479460000000004 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416922+0000", 2024-04-19T03:37:43.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7481000000000002e-05 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416979+0000", 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6548000000000001e-05 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.7598945720000003, 2024-04-19T03:37:43.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:37:43.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:31 4.30 4:0c89e311:::100000001f8.00000017:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5169039980000001, 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011301624999999999, 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:43.356 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 31 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770081+0000", 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999962 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774108+0000", 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040261660000000003 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774129+0000", 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1739999999999999e-05 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774140+0000", 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.047e-05 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774186+0000", 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5938e-05 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774291+0000", 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105497 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781291+0000", 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069996030000000001 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781336+0000", 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5241000000000003e-05 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781387+0000", 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0596999999999997e-05 2024-04-19T03:37:43.360 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.2727465609999999, 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015903805, 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:43.361 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014241+0000", 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018134+0000", 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038934180000000001 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018152+0000", 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8278e-05 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018163+0000", 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0647e-05 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018235+0000", 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2350999999999999e-05 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018354+0000", 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119178 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018459+0000", 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104245 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.023951+0000", 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054925169999999997 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030090+0000", 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061382679999999997 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030120+0000", 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0269000000000001e-05 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030146+0000", 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6418999999999999e-05 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.366 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:56 4.38 4:1d13bf87:::100000001f8.00000030:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.6195518550000001, 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010642082000000001, 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 56 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:43.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667435+0000", 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671353+0000", 2024-04-19T03:37:43.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039183680000000002 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671381+0000", 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8147999999999999e-05 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671396+0000", 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5356999999999999e-05 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671447+0000", 2024-04-19T03:37:43.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0478e-05 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671559+0000", 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011230099999999999 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.677987+0000", 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064280470000000001 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.678025+0000", 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7960000000000002e-05 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.678079+0000", 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3949000000000001e-05 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:58 4.28 e48/14 4:15eeb89b:::100000001f8.00000032:head v 48'1, mlcod=0'0)", 2024-04-19T03:37:43.371 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.377210579, 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010923644999999999, 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909777+0000", 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913712+0000", 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039352700000000003 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913739+0000", 2024-04-19T03:37:43.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6806999999999999e-05 2024-04-19T03:37:43.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913770+0000", 2024-04-19T03:37:43.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0960999999999997e-05 2024-04-19T03:37:43.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913820+0000", 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0209e-05 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913838+0000", 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7810000000000001e-05 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.920654+0000", 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068160989999999999 2024-04-19T03:37:43.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.920702+0000", 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7926999999999997e-05 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63 4.23 4:c6f90462:::100000001f8.00000037:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.80483280300000004, 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014504006, 2024-04-19T03:37:43.376 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:43.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482155+0000", 2024-04-19T03:37:43.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:43.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485920+0000", 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037649519999999998 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485936+0000", 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6002999999999999e-05 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485949+0000", 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3227000000000001e-05 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486029+0000", 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0703000000000003e-05 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486131+0000", 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010152 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486226+0000", 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4858000000000006e-05 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.492383+0000", 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061568109999999999 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496591+0000", 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042080850000000003 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496626+0000", 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5040999999999999e-05 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496660+0000", 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4415999999999997e-05 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.69235063900000005, 2024-04-19T03:37:43.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013334689, 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594637+0000", 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598298+0000", 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036613980000000002 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598311+0000", 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2632999999999999e-05 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598318+0000", 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9619999999999996e-06 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598391+0000", 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3206000000000003e-05 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598549+0000", 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015764899999999999 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598713+0000", 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016429300000000001 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.605057+0000", 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063441469999999996 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607908+0000", 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028502739999999999 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607943+0000", 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4928000000000002e-05 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607973+0000", 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0423e-05 2024-04-19T03:37:43.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:65 4.3f e48/14 4:fde182c5:::100000001f8.00000039:head v 48'1, mlcod=0'0)", 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.583252722, 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011647948999999999, 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:43.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703735+0000", 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707551+0000", 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038161409999999999 2024-04-19T03:37:43.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707565+0000", 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3841e-05 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707571+0000", 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6930000000000001e-06 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707631+0000", 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9861000000000002e-05 2024-04-19T03:37:43.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707655+0000", 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4219e-05 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.715341+0000", 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076858680000000002 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.715384+0000", 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2953e-05 2024-04-19T03:37:43.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:67 4.28 e48/14 4:153ae410:::100000001f8.0000003b:head v 48'2, mlcod=0'0)", 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.916123+0000", 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.37086645299999998, 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010595630999999999, 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.916123+0000", 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.916123+0000", 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.916121+0000", 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:43.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919873+0000", 2024-04-19T03:37:43.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037519319999999999 2024-04-19T03:37:43.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919894+0000", 2024-04-19T03:37:43.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0704999999999999e-05 2024-04-19T03:37:43.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919904+0000", 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0407999999999999e-05 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919964+0000", 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9787000000000002e-05 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919990+0000", 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6341000000000001e-05 2024-04-19T03:37:43.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.926668+0000", 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006678135 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.926718+0000", 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9756999999999998e-05 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.397 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:68 4.6 e48/14 4:635f8cb4:::100000001f8.0000003c:head v 48'4, mlcod=47'2)", 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.25443232700000001, 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010980092, 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:43.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032555+0000", 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036310+0000", 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037547489999999999 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:43.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036332+0000", 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1929999999999998e-05 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036361+0000", 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9104000000000001e-05 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036437+0000", 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5592000000000004e-05 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:43.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036465+0000", 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8231000000000001e-05 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.043487+0000", 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00702178 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.043537+0000", 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0204999999999998e-05 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:43.402 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:43.402 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:43.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:43.404 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:43.404 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:43.402+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:37:43.505 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:43.504+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:43.561 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:101 4.f e49/14 4:f0d983b2:::100000001f8.0000001f:head v 49'6, mlcod=49'4)", 2024-04-19T03:37:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:43.560376+0000", 2024-04-19T03:37:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00050051700000000002, 2024-04-19T03:37:43.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051830099999999998, 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.560376+0000", 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.560376+0000", 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.560375+0000", 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.560388+0000", 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2865e-05 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.560398+0000", 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6660000000000003e-06 2024-04-19T03:37:43.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.560405+0000", 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7389999999999999e-06 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.560431+0000", 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6154000000000001e-05 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.560445+0000", 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3234000000000001e-05 2024-04-19T03:37:43.564 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:37:43.565 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 1 2024-04-19T03:37:43.565 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:43.575 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:43.587 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:43.605 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:43.605+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:43.611 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:43.612 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:43.615 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:43.616 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:43.706 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:43.705+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:43.747 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:43.747 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:43.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:43.807 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:43.806+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:43.908 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:43.907+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:43.934 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:43.935 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:43.949 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:44.009 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:44.008+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:44.100 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:44.100 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:44.110 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:44.111 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:44.110+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:44.212 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:44.210+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:44.269 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:44.269 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:44.283 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:44.314 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:44.313+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:44.415 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:44.415+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:44.443 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:44.443 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:44.457 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:44.518 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:44.517+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:44.619 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:44.618+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:44.648 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:44.648 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:44.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:44.720 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:44.719+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:44.821 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:44.820+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:44.906 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:44.906 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:44.920 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:44.925 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:44.921+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:44.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-04-19T03:37:45.023 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:45.022+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:45.095 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:45.095 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:45.109 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:45.123 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:45.122+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:45.224 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:45.223+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:45.272 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:45.273 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:45.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:45.325 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:45.324+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:45.426 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:45.424+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:45.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:37:45.472 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:45.473 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:45.485 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:45.529 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:45.528+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:45.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:45.627 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:45.626+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:45.641 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:45.641 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:45.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:45.728 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:45.727+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:45.815 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:45.829 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:45.829+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:45.838 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:45.839 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:45.839 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:45.842 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:45.843 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:4634 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 2609152~4096 in=4096b,write 2674688~4096 in=4096b,write 2904064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:45.865802+0000", 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.002021054, 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020430729999999999, 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:45.868 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4634 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.865802+0000", 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:45.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.865802+0000", 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.865801+0000", 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.865813+0000", 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1627000000000001e-05 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.865821+0000", 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2709999999999992e-06 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.865826+0000", 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9690000000000002e-06 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.865871+0000", 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5018999999999997e-05 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.865954+0000", 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.331e-05 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.866106+0000", 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151858 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.867494+0000", 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001387421 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:45.872 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:4635 4.37 e49/14 4:ef395e89:::100000001f8.00000020:head v 49'222, mlcod=49'220)", 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:45.866718+0000", 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00110468, 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011958889999999999, 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.866718+0000", 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:45.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.866718+0000", 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.866718+0000", 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.866734+0000", 2024-04-19T03:37:45.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6444999999999999e-05 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.866741+0000", 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.866746+0000", 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.724e-06 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.866796+0000", 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9941999999999997e-05 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.866818+0000", 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2025e-05 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:4636 4.27 4:e68799fb:::100000001f8.00000018:head [write 212992~4096 in=4096b,write 286720~4096 in=4096b,write 356352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:45.867483+0000", 2024-04-19T03:37:45.876 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00034017800000000001, 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00047322, 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 4636 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.867483+0000", 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.867483+0000", 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.867482+0000", 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.867497+0000", 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4989e-05 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.867509+0000", 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2142e-05 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.867518+0000", 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4030000000000007e-06 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.867565+0000", 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7086000000000003e-05 2024-04-19T03:37:45.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:45.867664+0000", 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9252000000000004e-05 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 3 2024-04-19T03:37:45.880 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:45.882 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:45.930 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:45.929+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:46.031 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:46.029+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:46.070 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:46.070 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:46.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:46.171 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:46.170+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:46.232 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:46.231+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.453475063, 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.45343026899999, 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.453374674, 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.453334336, 2024-04-19T03:37:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.453304343, 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.45327461799999, 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.453234063, 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.453211442, 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.453183048, 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.44472907799999, 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.44421140999999, 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.1210998619999994, 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:37:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.5190584420000004, 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016272293, 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 23 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799798+0000", 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804034+0000", 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042360970000000003 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804056+0000", 2024-04-19T03:37:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1730999999999999e-05 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804067+0000", 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0727000000000001e-05 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804162+0000", 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5371999999999994e-05 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804308+0000", 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146205 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815916+0000", 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011607255 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815992+0000", 2024-04-19T03:37:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6304999999999995e-05 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.816073+0000", 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0945000000000005e-05 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.4027014609999995, 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:37:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.0326633049999998, 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016569639000000001, 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286193+0000", 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291309+0000", 2024-04-19T03:37:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051164189999999997 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291329+0000", 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9864000000000002e-05 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291339+0000", 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0127e-05 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291389+0000", 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9694999999999998e-05 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291519+0000", 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012998400000000001 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291637+0000", 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118137 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.295752+0000", 2024-04-19T03:37:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041148570000000004 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302676+0000", 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069241370000000003 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302716+0000", 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0046999999999998e-05 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302765+0000", 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9057999999999997e-05 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:58 4.28 4:15eeb89b:::100000001f8.00000032:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.4134320889999996, 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015633246, 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905425+0000", 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909174+0000", 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037485740000000002 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909192+0000", 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8377999999999999e-05 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909204+0000", 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2418999999999999e-05 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909306+0000", 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102038 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909422+0000", 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011593 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909549+0000", 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000127071 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.916572+0000", 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007022538 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.920988+0000", 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044155590000000003 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921030+0000", 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1956999999999998e-05 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921060+0000", 2024-04-19T03:37:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0589000000000001e-05 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:60 4.6 4:616d4c41:::100000001f8.00000034:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.189558903, 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015227233999999999, 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 60 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129298+0000", 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133391+0000", 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040920940000000001 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133409+0000", 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8289000000000001e-05 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133421+0000", 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2386e-05 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133491+0000", 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9621000000000003e-05 2024-04-19T03:37:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133627+0000", 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013573 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133749+0000", 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012267699999999999 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.138798+0000", 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050491579999999998 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144366+0000", 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055673750000000003 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144459+0000", 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2981999999999998e-05 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144527+0000", 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8571999999999993e-05 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65 4.3f 4:fde182c5:::100000001f8.00000039:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.6197872929999999, 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016635464999999999, 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699069+0000", 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702973+0000", 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039033840000000002 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702996+0000", 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3983999999999999e-05 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703010+0000", 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3644e-05 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703077+0000", 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6527999999999997e-05 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703256+0000", 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000178846 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703438+0000", 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182573 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.709201+0000", 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005762868 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715583+0000", 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063823990000000004 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715652+0000", 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9148999999999998e-05 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715707+0000", 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4639000000000003e-05 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:67 4.28 4:153ae410:::100000001f8.0000003b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.407615748, 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017367636999999998, 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 67 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911240+0000", 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915361+0000", 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041201110000000001 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915383+0000", 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2308000000000001e-05 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915393+0000", 2024-04-19T03:37:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0404000000000001e-05 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915469+0000", 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5374e-05 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915680+0000", 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00021142200000000001 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915885+0000", 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020515600000000001 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.926916+0000", 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011031085 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928443+0000", 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001526693 2024-04-19T03:37:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928536+0000", 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3424999999999994e-05 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928611+0000", 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4408999999999999e-05 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:68 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.2906777979999999, 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015772376000000001, 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 68 2024-04-19T03:37:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028179+0000", 2024-04-19T03:37:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031945+0000", 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037660240000000002 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031964+0000", 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.844e-05 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031972+0000", 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8540000000000003e-06 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032064+0000", 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1699000000000004e-05 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032205+0000", 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014062699999999999 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032341+0000", 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136086 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.037248+0000", 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049069630000000003 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043853+0000", 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066051469999999996 2024-04-19T03:37:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043895+0000", 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2385999999999997e-05 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043954+0000", 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8162000000000003e-05 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:46.437 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:46.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:46.439 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:46.437+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:46.539 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:46.537+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:46.595 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:6098 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 876544~4096 in=4096b,write 909312~4096 in=4096b,write 962560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:46.590453+0000", 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0049814600000000001, 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049997779999999999, 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:46.596 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 6098 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.590453+0000", 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.590453+0000", 2024-04-19T03:37:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.590453+0000", 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.590464+0000", 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1817999999999999e-05 2024-04-19T03:37:46.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.590473+0000", 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5920000000000001e-06 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.590480+0000", 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6229999999999999e-06 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.590513+0000", 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3053999999999999e-05 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.590562+0000", 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9218999999999998e-05 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.590647+0000", 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4802000000000006e-05 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.591824+0000", 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011772740000000001 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:6104 4.23 4:c6f90462:::100000001f8.00000037:head [write 2170880~4096 in=4096b,write 2220032~4096 in=4096b,write 2752512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:46.592718+0000", 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0027164379999999998, 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0027879549999999999, 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:46.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 6104 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592718+0000", 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:46.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592718+0000", 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592718+0000", 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592730+0000", 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2587e-05 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592744+0000", 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4389000000000001e-05 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592754+0000", 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6630000000000005e-06 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592796+0000", 2024-04-19T03:37:46.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1860999999999998e-05 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592843+0000", 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6885000000000003e-05 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592928+0000", 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5111000000000006e-05 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.594218+0000", 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001289793 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:6103 4.33 e49/14 4:cf6d7a6c:::100000001f8.0000000a:head v 49'92, mlcod=49'90)", 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:46.592731+0000", 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0027036170000000002, 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002817146, 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592731+0000", 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592731+0000", 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592731+0000", 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592745+0000", 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3769e-05 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592750+0000", 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5960000000000003e-06 2024-04-19T03:37:46.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592755+0000", 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0540000000000002e-06 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592780+0000", 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4530000000000001e-05 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:46.592791+0000", 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0869e-05 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 3 2024-04-19T03:37:46.610 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:46.611 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:46.640 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:46.638+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:46.740 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:46.739+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:46.769 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:46.769 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:46.770 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:46.770 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:46.780 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:46.841 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:46.840+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:46.854 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:37:46.942 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:46.941+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:46.994 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:46.994 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 107.125887474, 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:46.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:46.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:46.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.000 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 107.125783807, 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:47.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:47.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 107.12569442900001, 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:47.006 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:47.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 107.125592091, 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:47.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 107.12555155699999, 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:47.016 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18 4.33 e46/14 4:cf6d7a6c:::100000001f8.0000000a:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.7890148769999996, 2024-04-19T03:37:47.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012782457000000001, 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202650+0000", 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206458+0000", 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003808016 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206470+0000", 2024-04-19T03:37:47.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2455e-05 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206495+0000", 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4888e-05 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206545+0000", 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9314000000000003e-05 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206562+0000", 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723e-05 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215395+0000", 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088321920000000009 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215435+0000", 2024-04-19T03:37:47.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0315999999999998e-05 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.6760214869999999, 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.025 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:37:47.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:37:47.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.3122063669999999, 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014462462000000001, 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.031 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 22 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679458+0000", 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683146+0000", 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036878869999999999 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683169+0000", 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2699000000000001e-05 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683183+0000", 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3684e-05 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683264+0000", 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1086000000000003e-05 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683369+0000", 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105289 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683466+0000", 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7298000000000003e-05 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.689790+0000", 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063238010000000004 2024-04-19T03:37:47.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693826+0000", 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040361140000000004 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693880+0000", 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3480999999999998e-05 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693923+0000", 2024-04-19T03:37:47.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3612000000000002e-05 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:24 4.36 e47/14 4:6c9c34b1:::100000001f8.00000010:head v 47'2, mlcod=0'0)", 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.0709889189999995, 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013771834, 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.037 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920677+0000", 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924314+0000", 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036369900000000001 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924329+0000", 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4752e-05 2024-04-19T03:37:47.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924356+0000", 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7506000000000001e-05 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924405+0000", 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495000000000002e-05 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924431+0000", 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6678000000000001e-05 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934351+0000", 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.009920023 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934450+0000", 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8826000000000006e-05 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.041 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:28 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.5852735720000002, 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010584817999999999, 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:47.042 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 28 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406394+0000", 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.406392+0000", 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410220+0000", 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038274910000000001 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410235+0000", 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5597999999999999e-05 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410247+0000", 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1963e-05 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410324+0000", 2024-04-19T03:37:47.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6571999999999998e-05 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.410437+0000", 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000112811 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416885+0000", 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064479460000000004 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416922+0000", 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7481000000000002e-05 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.416979+0000", 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6548000000000001e-05 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:47.047 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.4645728990000002, 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:47.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:31 4.30 4:0c89e311:::100000001f8.00000017:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.221582325, 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011301624999999999, 2024-04-19T03:37:47.053 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 31 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770081+0000", 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999962 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774108+0000", 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040261660000000003 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774129+0000", 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1739999999999999e-05 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774140+0000", 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.047e-05 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774186+0000", 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5938e-05 2024-04-19T03:37:47.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774291+0000", 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105497 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781291+0000", 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069996030000000001 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781336+0000", 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5241000000000003e-05 2024-04-19T03:37:47.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781387+0000", 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0596999999999997e-05 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.9774248879999998, 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015903805, 2024-04-19T03:37:47.058 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014241+0000", 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018134+0000", 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038934180000000001 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018152+0000", 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8278e-05 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018163+0000", 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0647e-05 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018235+0000", 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2350999999999999e-05 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018354+0000", 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119178 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018459+0000", 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104245 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.023951+0000", 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054925169999999997 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030090+0000", 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061382679999999997 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030120+0000", 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0269000000000001e-05 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030146+0000", 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6418999999999999e-05 2024-04-19T03:37:47.063 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:56 4.38 4:1d13bf87:::100000001f8.00000030:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.324230182, 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010642082000000001, 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.064 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 56 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667435+0000", 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671353+0000", 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039183680000000002 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671381+0000", 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8147999999999999e-05 2024-04-19T03:37:47.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671396+0000", 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5356999999999999e-05 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671447+0000", 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0478e-05 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671559+0000", 2024-04-19T03:37:47.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011230099999999999 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.677987+0000", 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064280470000000001 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.678025+0000", 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7960000000000002e-05 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.678079+0000", 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3949000000000001e-05 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:58 4.28 e48/14 4:15eeb89b:::100000001f8.00000032:head v 48'1, mlcod=0'0)", 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.0818889059999997, 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010923644999999999, 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909777+0000", 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913712+0000", 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039352700000000003 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913739+0000", 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6806999999999999e-05 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913770+0000", 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0960999999999997e-05 2024-04-19T03:37:47.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913820+0000", 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0209e-05 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913838+0000", 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7810000000000001e-05 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.920654+0000", 2024-04-19T03:37:47.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068160989999999999 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.920702+0000", 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7926999999999997e-05 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63 4.23 4:c6f90462:::100000001f8.00000037:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5095111299999999, 2024-04-19T03:37:47.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014504006, 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482155+0000", 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485920+0000", 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037649519999999998 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485936+0000", 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6002999999999999e-05 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485949+0000", 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3227000000000001e-05 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486029+0000", 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0703000000000003e-05 2024-04-19T03:37:47.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486131+0000", 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010152 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486226+0000", 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4858000000000006e-05 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.492383+0000", 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061568109999999999 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496591+0000", 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042080850000000003 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496626+0000", 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5040999999999999e-05 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496660+0000", 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4415999999999997e-05 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:47.079 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3970289659999997, 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013334689, 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594637+0000", 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598298+0000", 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036613980000000002 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598311+0000", 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2632999999999999e-05 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598318+0000", 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9619999999999996e-06 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598391+0000", 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3206000000000003e-05 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598549+0000", 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015764899999999999 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:47.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598713+0000", 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016429300000000001 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.605057+0000", 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063441469999999996 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607908+0000", 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028502739999999999 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607943+0000", 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4928000000000002e-05 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607973+0000", 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0423e-05 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:65 4.3f e48/14 4:fde182c5:::100000001f8.00000039:head v 48'1, mlcod=0'0)", 2024-04-19T03:37:47.085 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.287931049, 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011647948999999999, 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703735+0000", 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707551+0000", 2024-04-19T03:37:47.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038161409999999999 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707565+0000", 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3841e-05 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707571+0000", 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6930000000000001e-06 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707631+0000", 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9861000000000002e-05 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707655+0000", 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4219e-05 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.715341+0000", 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076858680000000002 2024-04-19T03:37:47.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.715384+0000", 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2953e-05 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:67 4.28 e48/14 4:153ae410:::100000001f8.0000003b:head v 48'2, mlcod=0'0)", 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.916123+0000", 2024-04-19T03:37:47.090 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.0755447800000004, 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010595630999999999, 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.916123+0000", 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.916123+0000", 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.916121+0000", 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919873+0000", 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037519319999999999 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919894+0000", 2024-04-19T03:37:47.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0704999999999999e-05 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919904+0000", 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0407999999999999e-05 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919964+0000", 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9787000000000002e-05 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919990+0000", 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6341000000000001e-05 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.926668+0000", 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006678135 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.926718+0000", 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9756999999999998e-05 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.094 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:68 4.6 e48/14 4:635f8cb4:::100000001f8.0000003c:head v 48'4, mlcod=47'2)", 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.9591106539999998, 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010980092, 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032555+0000", 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036310+0000", 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037547489999999999 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036332+0000", 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1929999999999998e-05 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036361+0000", 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9104000000000001e-05 2024-04-19T03:37:47.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036437+0000", 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5592000000000004e-05 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036465+0000", 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8231000000000001e-05 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.043487+0000", 2024-04-19T03:37:47.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00702178 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.043537+0000", 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0204999999999998e-05 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:47.099 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:47.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:47.102 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:47.099+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:47.202 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:47.200+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:47.293 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:47.293 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:47.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.293 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:7636 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 2527232~4096 in=4096b,write 2617344~4096 in=4096b,write 2965504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:37:47.293 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:47.289982+0000", 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.002752347, 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002773583, 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7636 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.289982+0000", 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.289982+0000", 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.289981+0000", 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.289991+0000", 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4460000000000007e-06 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.289999+0000", 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9129999999999992e-06 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.290005+0000", 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5319999999999997e-06 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.290039+0000", 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3556999999999997e-05 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.290092+0000", 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3921000000000001e-05 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.290183+0000", 2024-04-19T03:37:47.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0129000000000004e-05 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291110+0000", 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092713099999999998 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:7639 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 536576~4096 in=4096b,write 557056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:47.291294+0000", 2024-04-19T03:37:47.298 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0014399790000000001, 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001542201, 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7639 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291294+0000", 2024-04-19T03:37:47.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291294+0000", 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291294+0000", 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291303+0000", 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8919999999999995e-06 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291312+0000", 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291318+0000", 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6529999999999999e-06 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291354+0000", 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6448000000000001e-05 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291408+0000", 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3773999999999997e-05 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291500+0000", 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2404000000000005e-05 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292811+0000", 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013104169999999999 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:7640 4.3 4:c222b65c:::100000001f8.00000021:head [write 2383872~4096 in=4096b,write 2600960~4096 in=4096b,write 2662400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:47.291518+0000", 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001215846, 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013912200000000001, 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.303 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 7640 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291518+0000", 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291518+0000", 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291518+0000", 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291550+0000", 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2636999999999999e-05 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291558+0000", 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.272e-06 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291562+0000", 2024-04-19T03:37:47.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5009999999999998e-06 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291605+0000", 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2981000000000001e-05 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.291684+0000", 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8759999999999998e-05 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.306 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:7641 4.12 e50/14 4:4be51a30:::100000001f8.0000000b:head v 50'253, mlcod=50'251)", 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:47.292312+0000", 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00042256200000000002, 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064245000000000003, 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292312+0000", 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292312+0000", 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292311+0000", 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292333+0000", 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1923e-05 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292343+0000", 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7240000000000004e-06 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292350+0000", 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8109999999999997e-06 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292386+0000", 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6730999999999998e-05 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292399+0000", 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2366e-05 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:7642 4.f e50/14 4:f2a80dfe:::100000001f8.00000019:head v 50'360, mlcod=50'358)", 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:47.292812+0000", 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9999223, 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000178534, 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292812+0000", 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292812+0000", 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292811+0000", 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292825+0000", 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.432e-05 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292837+0000", 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1151999999999999e-05 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292844+0000", 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4449999999999999e-06 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292888+0000", 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4422000000000003e-05 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:47.292914+0000", 2024-04-19T03:37:47.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5531e-05 2024-04-19T03:37:47.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.313 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.313 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:37:47.313 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 5 2024-04-19T03:37:47.313 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:47.314 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:47.313+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:47.315 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:47.415 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:47.414+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:47.516 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:47.514+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:47.535 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:47.535 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:47.535 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:47.535 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:47.535 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:47.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:47.633 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:47.632+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:47.718 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:47.717+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:47.781 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:47.781 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:47.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:47.781 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:47.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.781 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.91257165499999, 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:47.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.787 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.912526861, 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:47.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:47.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.793 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.912471266, 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:47.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:47.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:47.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:47.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:47.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:47.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:47.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:47.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.91243092800001, 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:47.801 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.91240093499999, 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:47.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:47.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.91237121, 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:47.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:47.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:47.818 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.91233065500001, 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:47.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:47.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:47.824 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.91230803400001, 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.829 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.91227963999999, 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:47.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.90382567, 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:47.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 107.903308002, 2024-04-19T03:37:47.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:47.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:47.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.580196453999999, 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.9781550340000003, 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016272293, 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.848 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 23 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799798+0000", 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804034+0000", 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042360970000000003 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804056+0000", 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1730999999999999e-05 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804067+0000", 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0727000000000001e-05 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804162+0000", 2024-04-19T03:37:47.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5371999999999994e-05 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804308+0000", 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146205 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815916+0000", 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011607255 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815992+0000", 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6304999999999995e-05 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.816073+0000", 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0945000000000005e-05 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8617980529999993, 2024-04-19T03:37:47.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:37:47.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.4917598969999997, 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016569639000000001, 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.859 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:47.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286193+0000", 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291309+0000", 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051164189999999997 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291329+0000", 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9864000000000002e-05 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291339+0000", 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0127e-05 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291389+0000", 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9694999999999998e-05 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291519+0000", 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012998400000000001 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291637+0000", 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118137 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.295752+0000", 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041148570000000004 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302676+0000", 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069241370000000003 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302716+0000", 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0046999999999998e-05 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302765+0000", 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9057999999999997e-05 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.864 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:58 4.28 4:15eeb89b:::100000001f8.00000032:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.8725286810000004, 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015633246, 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58 2024-04-19T03:37:47.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905425+0000", 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909174+0000", 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037485740000000002 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909192+0000", 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8377999999999999e-05 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909204+0000", 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2418999999999999e-05 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909306+0000", 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102038 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909422+0000", 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011593 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909549+0000", 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000127071 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.916572+0000", 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007022538 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.920988+0000", 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044155590000000003 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921030+0000", 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1956999999999998e-05 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921060+0000", 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0589000000000001e-05 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:60 4.6 4:616d4c41:::100000001f8.00000034:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:47.870 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.6486554949999999, 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015227233999999999, 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 60 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129298+0000", 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133391+0000", 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040920940000000001 2024-04-19T03:37:47.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133409+0000", 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8289000000000001e-05 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133421+0000", 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2386e-05 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133491+0000", 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9621000000000003e-05 2024-04-19T03:37:47.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133627+0000", 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013573 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133749+0000", 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012267699999999999 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.138798+0000", 2024-04-19T03:37:47.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050491579999999998 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144366+0000", 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055673750000000003 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144459+0000", 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2981999999999998e-05 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144527+0000", 2024-04-19T03:37:47.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8571999999999993e-05 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65 4.3f 4:fde182c5:::100000001f8.00000039:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.0788838849999998, 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016635464999999999, 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699069+0000", 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702973+0000", 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039033840000000002 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702996+0000", 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3983999999999999e-05 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703010+0000", 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3644e-05 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703077+0000", 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6527999999999997e-05 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703256+0000", 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000178846 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703438+0000", 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182573 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.709201+0000", 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005762868 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715583+0000", 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063823990000000004 2024-04-19T03:37:47.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715652+0000", 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9148999999999998e-05 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715707+0000", 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4639000000000003e-05 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.881 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:67 4.28 4:153ae410:::100000001f8.0000003b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.8667123400000003, 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017367636999999998, 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 67 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911240+0000", 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915361+0000", 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041201110000000001 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915383+0000", 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2308000000000001e-05 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915393+0000", 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0404000000000001e-05 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915469+0000", 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5374e-05 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915680+0000", 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00021142200000000001 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915885+0000", 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020515600000000001 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.926916+0000", 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011031085 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928443+0000", 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001526693 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928536+0000", 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3424999999999994e-05 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928611+0000", 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4408999999999999e-05 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:68 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.7497743899999998, 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015772376000000001, 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:47.887 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 68 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:47.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028179+0000", 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031945+0000", 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037660240000000002 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031964+0000", 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.844e-05 2024-04-19T03:37:47.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031972+0000", 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8540000000000003e-06 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032064+0000", 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1699000000000004e-05 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032205+0000", 2024-04-19T03:37:47.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014062699999999999 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032341+0000", 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136086 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.037248+0000", 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049069630000000003 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043853+0000", 2024-04-19T03:37:47.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066051469999999996 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043895+0000", 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2385999999999997e-05 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043954+0000", 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8162000000000003e-05 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.892 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:47.893 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:47.893 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:47.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:47.895 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:47.895 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:47.892+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:47.996 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:47.995+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:48.061 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:48.062 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:48.062 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:37:48.062 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:48.075 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:48.089 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:48.114 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:48.115 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:48.118 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:48.117+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:48.118 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:48.119 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:48.196 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:48.195+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:48.232 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:48.232 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:48.244 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:48.297 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:48.296+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:48.398 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:48.397+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:48.437 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:48.438 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:48.451 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:48.498 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:48.497+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:48.599 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:48.598+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:48.643 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:48.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:48.700 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:48.699+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:48.801 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:48.800+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:48.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:37:48.897 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:48.897 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:48.901 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:48.901+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:48.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:49.003 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:49.001+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:49.103 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:49.102+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:49.144 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:49.144 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:49.161 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:49.205 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:49.204+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:49.305 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:49.304+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:49.331 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:49.332 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:49.344 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:49.429 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:49.427+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:49.507 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:49.506+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:49.546 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:49.547 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:49.560 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:49.645 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:49.644+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:49.709 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:49.708+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:49.749 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:49.749 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:49.761 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:49.810 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:49.809+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:49.866 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:37:49.912 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:49.911+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:49.940 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:49.941 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:49.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:50.013 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:50.012+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:50.114 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:50.113+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:50.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:50.191 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:50.192 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:50.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:50.251 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:50.250+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:50.316 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:50.315+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:50.322 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:50.348 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:50.351 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:50.352 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:50.396 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.52859012, 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.528545326, 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.52848973099999, 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.528449393, 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:50.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:50.420 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.5284194, 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.528389675, 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:50.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:50.432 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.52834912, 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:50.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:50.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:50.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:50.438 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.528326499, 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:50.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:50.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:50.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.528298105, 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:50.447 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.519844135, 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:50.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:50.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:50.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:50.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:50.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.519326467, 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.196214918999999, 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:37:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 12.594173499, 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016272293, 2024-04-19T03:37:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 23 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799798+0000", 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804034+0000", 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042360970000000003 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804056+0000", 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1730999999999999e-05 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804067+0000", 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0727000000000001e-05 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804162+0000", 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5371999999999994e-05 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804308+0000", 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146205 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815916+0000", 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011607255 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815992+0000", 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6304999999999995e-05 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.816073+0000", 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0945000000000005e-05 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 12.477816518000001, 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:37:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 12.107778361999999, 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016569639000000001, 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-19T03:37:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286193+0000", 2024-04-19T03:37:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291309+0000", 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051164189999999997 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291329+0000", 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9864000000000002e-05 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291339+0000", 2024-04-19T03:37:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0127e-05 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291389+0000", 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9694999999999998e-05 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291519+0000", 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012998400000000001 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291637+0000", 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118137 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.295752+0000", 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041148570000000004 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302676+0000", 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069241370000000003 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302716+0000", 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0046999999999998e-05 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302765+0000", 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9057999999999997e-05 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:58 4.28 4:15eeb89b:::100000001f8.00000032:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.4885471460000002, 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015633246, 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905425+0000", 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909174+0000", 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037485740000000002 2024-04-19T03:37:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909192+0000", 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8377999999999999e-05 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909204+0000", 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2418999999999999e-05 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909306+0000", 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102038 2024-04-19T03:37:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909422+0000", 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011593 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909549+0000", 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000127071 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.916572+0000", 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007022538 2024-04-19T03:37:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.920988+0000", 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044155590000000003 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921030+0000", 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1956999999999998e-05 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921060+0000", 2024-04-19T03:37:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0589000000000001e-05 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:60 4.6 4:616d4c41:::100000001f8.00000034:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.2646739599999997, 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015227233999999999, 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 60 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129298+0000", 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133391+0000", 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040920940000000001 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133409+0000", 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8289000000000001e-05 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133421+0000", 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2386e-05 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133491+0000", 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9621000000000003e-05 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133627+0000", 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013573 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133749+0000", 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012267699999999999 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.138798+0000", 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050491579999999998 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144366+0000", 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055673750000000003 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144459+0000", 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2981999999999998e-05 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144527+0000", 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8571999999999993e-05 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65 4.3f 4:fde182c5:::100000001f8.00000039:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.6949023499999996, 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016635464999999999, 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699069+0000", 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702973+0000", 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039033840000000002 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702996+0000", 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3983999999999999e-05 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703010+0000", 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3644e-05 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703077+0000", 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6527999999999997e-05 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703256+0000", 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000178846 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703438+0000", 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182573 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.709201+0000", 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005762868 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715583+0000", 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063823990000000004 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715652+0000", 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9148999999999998e-05 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715707+0000", 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4639000000000003e-05 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:67 4.28 4:153ae410:::100000001f8.0000003b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.4827308050000001, 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017367636999999998, 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 67 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911240+0000", 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915361+0000", 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041201110000000001 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915383+0000", 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2308000000000001e-05 2024-04-19T03:37:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915393+0000", 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0404000000000001e-05 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915469+0000", 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5374e-05 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915680+0000", 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00021142200000000001 2024-04-19T03:37:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915885+0000", 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020515600000000001 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.926916+0000", 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011031085 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928443+0000", 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001526693 2024-04-19T03:37:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928536+0000", 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3424999999999994e-05 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928611+0000", 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4408999999999999e-05 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:68 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.3657928549999996, 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015772376000000001, 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 68 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028179+0000", 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031945+0000", 2024-04-19T03:37:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037660240000000002 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031964+0000", 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.844e-05 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031972+0000", 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8540000000000003e-06 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032064+0000", 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1699000000000004e-05 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032205+0000", 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014062699999999999 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032341+0000", 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136086 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.037248+0000", 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049069630000000003 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043853+0000", 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066051469999999996 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043895+0000", 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2385999999999997e-05 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043954+0000", 2024-04-19T03:37:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8162000000000003e-05 2024-04-19T03:37:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:50.509 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:50.510 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:50.509+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:50.511 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:50.611 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:50.610+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:14639 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1110016~4096 in=4096b,write 1171456~4096 in=4096b,write 1191936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:50.675850+0000", 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00083495100000000001, 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00085360099999999995, 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:50.677 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 14639 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.675850+0000", 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.675850+0000", 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:50.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.675849+0000", 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.675871+0000", 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2277e-05 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.675877+0000", 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5010000000000004e-06 2024-04-19T03:37:50.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.675881+0000", 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1030000000000004e-06 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.675903+0000", 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2147999999999999e-05 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.675987+0000", 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3281000000000004e-05 2024-04-19T03:37:50.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676124+0000", 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013729599999999999 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:14640 4.23 4:c6f90462:::100000001f8.00000037:head [write 1343488~4096 in=4096b,write 1404928~4096 in=4096b,write 1605632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:50.676330+0000", 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00035489000000000001, 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042610499999999997, 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:50.681 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 14640 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676330+0000", 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:50.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676330+0000", 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676329+0000", 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676345+0000", 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6132000000000001e-05 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:50.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676353+0000", 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.289e-06 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676357+0000", 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6009999999999997e-06 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676383+0000", 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6098999999999999e-05 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676429+0000", 2024-04-19T03:37:50.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5682000000000001e-05 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.676512+0000", 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3171999999999996e-05 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 2 2024-04-19T03:37:50.685 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:50.690 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:50.712 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:50.711+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:50.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-04-19T03:37:50.814 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:50.813+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:50.903 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:50.903 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:50.903 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:50.903 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:50.903 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:50.914 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:50.913+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:50.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:51.015 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:51.014+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:51.116 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:51.115+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:51.128 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:51.128 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:51.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:51.128 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 111.260578525, 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010592981, 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865780+0000", 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865772+0000", 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999919 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865788+0000", 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5909e-05 2024-04-19T03:37:51.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865799+0000", 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1398e-05 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865822+0000", 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2487999999999999e-05 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866108+0000", 2024-04-19T03:37:51.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00028679200000000001 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866304+0000", 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000195933 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866512+0000", 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020803 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872804+0000", 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062918569999999997 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876281+0000", 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034764650000000002 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876329+0000", 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8086e-05 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876373+0000", 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3977999999999998e-05 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 111.26047485799999, 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010636567, 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865883+0000", 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865882+0000", 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865897+0000", 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5471000000000001e-05 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865911+0000", 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3540000000000001e-05 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865922+0000", 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0981e-05 2024-04-19T03:37:51.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866869+0000", 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00094752400000000004 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866966+0000", 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6942999999999997e-05 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867081+0000", 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115133 2024-04-19T03:37:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.872861+0000", 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057796560000000002 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876422+0000", 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035613770000000001 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876472+0000", 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9317000000000002e-05 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876520+0000", 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8275000000000001e-05 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 111.26038548, 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010714357000000001, 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865973+0000", 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865972+0000", 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865977+0000", 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3200000000000001e-06 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.865988+0000", 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:37:51.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866014+0000", 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5904000000000001e-05 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867326+0000", 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001312127 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867462+0000", 2024-04-19T03:37:51.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013596699999999999 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867552+0000", 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9955000000000002e-05 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.873323+0000", 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057715029999999999 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876585+0000", 2024-04-19T03:37:51.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032614020000000001 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876638+0000", 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3219e-05 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876687+0000", 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 111.26028314200001, 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:51.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:51.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 111.260242608, 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010669649, 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866116+0000", 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866115+0000", 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866117+0000", 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8649999999999999e-06 2024-04-19T03:37:51.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866134+0000", 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6297e-05 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866140+0000", 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.867927+0000", 2024-04-19T03:37:51.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017867650000000001 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.868017+0000", 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9559000000000001e-05 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.876785+0000", 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087686280000000005 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18 4.33 e46/14 4:cf6d7a6c:::100000001f8.0000000a:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.923705928, 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012782457000000001, 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202650+0000", 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206458+0000", 2024-04-19T03:37:51.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003808016 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206470+0000", 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2455e-05 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206495+0000", 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4888e-05 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206545+0000", 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9314000000000003e-05 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206562+0000", 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723e-05 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215395+0000", 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088321920000000009 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215435+0000", 2024-04-19T03:37:51.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0315999999999998e-05 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.810712538000001, 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.157 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:37:51.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:51.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:37:51.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:37:51.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.446897418000001, 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014462462000000001, 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.163 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 22 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679458+0000", 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683146+0000", 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036878869999999999 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683169+0000", 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2699000000000001e-05 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683183+0000", 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3684e-05 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683264+0000", 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1086000000000003e-05 2024-04-19T03:37:51.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683369+0000", 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105289 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683466+0000", 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7298000000000003e-05 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.689790+0000", 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063238010000000004 2024-04-19T03:37:51.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693826+0000", 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040361140000000004 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693880+0000", 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3480999999999998e-05 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693923+0000", 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3612000000000002e-05 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.168 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:24 4.36 e47/14 4:6c9c34b1:::100000001f8.00000010:head v 47'2, mlcod=0'0)", 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.20567997, 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013771834, 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:51.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920677+0000", 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924314+0000", 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036369900000000001 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924329+0000", 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4752e-05 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924356+0000", 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7506000000000001e-05 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924405+0000", 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495000000000002e-05 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924431+0000", 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6678000000000001e-05 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934351+0000", 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.009920023 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934450+0000", 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8826000000000006e-05 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.599263949999999, 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:51.173 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:37:51.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.178 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:31 4.30 4:0c89e311:::100000001f8.00000017:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.356273376000001, 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011301624999999999, 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 31 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:51.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770081+0000", 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999962 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774108+0000", 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040261660000000003 2024-04-19T03:37:51.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774129+0000", 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1739999999999999e-05 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774140+0000", 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.047e-05 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774186+0000", 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5938e-05 2024-04-19T03:37:51.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774291+0000", 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105497 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781291+0000", 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069996030000000001 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781336+0000", 2024-04-19T03:37:51.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5241000000000003e-05 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781387+0000", 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0596999999999997e-05 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.112115939000001, 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015903805, 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014241+0000", 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018134+0000", 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038934180000000001 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018152+0000", 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8278e-05 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018163+0000", 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0647e-05 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018235+0000", 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2350999999999999e-05 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018354+0000", 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119178 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018459+0000", 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104245 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.023951+0000", 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054925169999999997 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030090+0000", 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061382679999999997 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030120+0000", 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0269000000000001e-05 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030146+0000", 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6418999999999999e-05 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:56 4.38 4:1d13bf87:::100000001f8.00000030:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.4589212329999999, 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010642082000000001, 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 56 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667437+0000", 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.667435+0000", 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671353+0000", 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039183680000000002 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671381+0000", 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8147999999999999e-05 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671396+0000", 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5356999999999999e-05 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671447+0000", 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0478e-05 2024-04-19T03:37:51.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.671559+0000", 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011230099999999999 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.677987+0000", 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0064280470000000001 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.678025+0000", 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7960000000000002e-05 2024-04-19T03:37:51.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.678079+0000", 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3949000000000001e-05 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:58 4.28 e48/14 4:15eeb89b:::100000001f8.00000032:head v 48'1, mlcod=0'0)", 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.2165799570000004, 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010923644999999999, 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909778+0000", 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.909777+0000", 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:51.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913712+0000", 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039352700000000003 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913739+0000", 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6806999999999999e-05 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913770+0000", 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0960999999999997e-05 2024-04-19T03:37:51.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913820+0000", 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0209e-05 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.913838+0000", 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7810000000000001e-05 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.920654+0000", 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068160989999999999 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:41.920702+0000", 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7926999999999997e-05 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63 4.23 4:c6f90462:::100000001f8.00000037:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.6442021810000007, 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014504006, 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.197 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482155+0000", 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485920+0000", 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037649519999999998 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485936+0000", 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6002999999999999e-05 2024-04-19T03:37:51.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485949+0000", 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3227000000000001e-05 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486029+0000", 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0703000000000003e-05 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486131+0000", 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010152 2024-04-19T03:37:51.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486226+0000", 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4858000000000006e-05 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.492383+0000", 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061568109999999999 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496591+0000", 2024-04-19T03:37:51.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042080850000000003 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496626+0000", 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5040999999999999e-05 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496660+0000", 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4415999999999997e-05 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.5317200169999996, 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013334689, 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594637+0000", 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598298+0000", 2024-04-19T03:37:51.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036613980000000002 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598311+0000", 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2632999999999999e-05 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598318+0000", 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9619999999999996e-06 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598391+0000", 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3206000000000003e-05 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598549+0000", 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015764899999999999 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598713+0000", 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016429300000000001 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.605057+0000", 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063441469999999996 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607908+0000", 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028502739999999999 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607943+0000", 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4928000000000002e-05 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607973+0000", 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0423e-05 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.207 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:65 4.3f e48/14 4:fde182c5:::100000001f8.00000039:head v 48'1, mlcod=0'0)", 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.4226220999999999, 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011647948999999999, 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703735+0000", 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707551+0000", 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038161409999999999 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707565+0000", 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3841e-05 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707571+0000", 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6930000000000001e-06 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707631+0000", 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9861000000000002e-05 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707655+0000", 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4219e-05 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.715341+0000", 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076858680000000002 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.715384+0000", 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2953e-05 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.211 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:67 4.28 e48/14 4:153ae410:::100000001f8.0000003b:head v 48'2, mlcod=0'0)", 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.916123+0000", 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2102358310000003, 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010595630999999999, 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.916123+0000", 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.916123+0000", 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.916121+0000", 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919873+0000", 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037519319999999999 2024-04-19T03:37:51.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919894+0000", 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0704999999999999e-05 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919904+0000", 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0407999999999999e-05 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919964+0000", 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9787000000000002e-05 2024-04-19T03:37:51.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.919990+0000", 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6341000000000001e-05 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.926668+0000", 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006678135 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.926718+0000", 2024-04-19T03:37:51.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9756999999999998e-05 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:68 4.6 e48/14 4:635f8cb4:::100000001f8.0000003c:head v 48'4, mlcod=47'2)", 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.0938017050000006, 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010980092, 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032555+0000", 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036310+0000", 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037547489999999999 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036332+0000", 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1929999999999998e-05 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036361+0000", 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9104000000000001e-05 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036437+0000", 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5592000000000004e-05 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036465+0000", 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8231000000000001e-05 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.043487+0000", 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00702178 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.043537+0000", 2024-04-19T03:37:51.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0204999999999998e-05 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:14088 4.2f 4:f59f865b:::100000001f8.00000007:head [write 98304~4096,write 184320~4096,write 237568~4096,write 512000~4096,write 540672~4096,write 569344~8192,write 602112~4096,write 733184~4096,write 847872~4096,write 856064~4096,write 884736~4096,write 1032192~4096,write 1257472~4096,write 1626112~4096,write 1777664~4096,write 1835008~4096,write 2224128~4096,write 2306048~4096,write 2371584~8192,write 2584576~4096,write 2674688~4096,write 2699264~4096,write 2711552~4096,write 2723840~4096,write 2740224~4096,write 2756608~8192,write 3436544~4096,write 3461120~4096,write 3731456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:50.370736+0000", 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.75562195099999996, 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010969338, 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:51.220 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 14088 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.370736+0000", 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.370736+0000", 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.370736+0000", 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.370873+0000", 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013720299999999999 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.370884+0000", 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0876999999999999e-05 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.370891+0000", 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2699999999999999e-06 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.373525+0000", 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0026344340000000002 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.373630+0000", 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104811 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.374196+0000", 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00056615400000000003 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.379331+0000", 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051351590000000003 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.381638+0000", 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00230685 2024-04-19T03:37:51.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.381683+0000", 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4480000000000001e-05 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:50.381706+0000", 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2921999999999998e-05 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:51.225 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:51.227 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:51.225+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:51.227 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:51.328 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:51.327+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:51.407 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:51.408 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:51.408 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:51.408 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:51.419 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:51.429 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:51.428+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:51.530 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:51.529+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:51.631 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:51.631+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:51.646 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:51.647 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:51.647 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:51.647 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:51.647 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:51.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:51.733 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:51.732+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:51.833 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:51.832+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:51.858 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:51.858 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:51.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:51.858 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:51.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.858 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.858 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.990174322, 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:51.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:51.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:51.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.864 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.990129528, 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:51.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:51.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:51.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:51.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.99007393300001, 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:51.870 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:51.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:51.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:51.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:51.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.990033595, 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:51.877 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:51.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:51.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.883 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.990003602, 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:51.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:51.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:51.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.890 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.989973877, 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:51.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:51.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.896 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.989933322, 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:51.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:51.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:51.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.989910701, 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:51.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.907 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.989882307, 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:51.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:51.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.912 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.981428337, 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:51.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.980910669, 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:51.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:51.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.657799121, 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:51.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:37:51.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:37:51.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:37:51.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:37:51.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.055757700999999, 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016272293, 2024-04-19T03:37:51.928 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 23 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799798+0000", 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804034+0000", 2024-04-19T03:37:51.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042360970000000003 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804056+0000", 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1730999999999999e-05 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804067+0000", 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0727000000000001e-05 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804162+0000", 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5371999999999994e-05 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804308+0000", 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146205 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815916+0000", 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011607255 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815992+0000", 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6304999999999995e-05 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.816073+0000", 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0945000000000005e-05 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:51.933 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.93940072, 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:37:51.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:37:51.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:37:51.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:51.939 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.569362564, 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016569639000000001, 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286193+0000", 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291309+0000", 2024-04-19T03:37:51.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051164189999999997 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291329+0000", 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9864000000000002e-05 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291339+0000", 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0127e-05 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291389+0000", 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9694999999999998e-05 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291519+0000", 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012998400000000001 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291637+0000", 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118137 2024-04-19T03:37:51.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.295752+0000", 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041148570000000004 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302676+0000", 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069241370000000003 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302716+0000", 2024-04-19T03:37:51.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0046999999999998e-05 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302765+0000", 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9057999999999997e-05 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:58 4.28 4:15eeb89b:::100000001f8.00000032:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.9501313479999993, 2024-04-19T03:37:51.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015633246, 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905425+0000", 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909174+0000", 2024-04-19T03:37:51.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037485740000000002 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909192+0000", 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8377999999999999e-05 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909204+0000", 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2418999999999999e-05 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909306+0000", 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102038 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909422+0000", 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011593 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909549+0000", 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000127071 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.916572+0000", 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007022538 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.920988+0000", 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044155590000000003 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921030+0000", 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1956999999999998e-05 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921060+0000", 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0589000000000001e-05 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:60 4.6 4:616d4c41:::100000001f8.00000034:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:51.951 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.7262581620000006, 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015227233999999999, 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 60 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129300+0000", 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.129298+0000", 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133391+0000", 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040920940000000001 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133409+0000", 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8289000000000001e-05 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133421+0000", 2024-04-19T03:37:51.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2386e-05 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133491+0000", 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9621000000000003e-05 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133627+0000", 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013573 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.133749+0000", 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012267699999999999 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.138798+0000", 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050491579999999998 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144366+0000", 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055673750000000003 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144459+0000", 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2981999999999998e-05 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.144527+0000", 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8571999999999993e-05 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65 4.3f 4:fde182c5:::100000001f8.00000039:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.1564865520000005, 2024-04-19T03:37:51.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016635464999999999, 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699069+0000", 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702973+0000", 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039033840000000002 2024-04-19T03:37:51.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702996+0000", 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3983999999999999e-05 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703010+0000", 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3644e-05 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703077+0000", 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6527999999999997e-05 2024-04-19T03:37:51.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703256+0000", 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000178846 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703438+0000", 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182573 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.709201+0000", 2024-04-19T03:37:51.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005762868 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715583+0000", 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063823990000000004 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715652+0000", 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9148999999999998e-05 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715707+0000", 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4639000000000003e-05 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:67 4.28 4:153ae410:::100000001f8.0000003b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9443150070000002, 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017367636999999998, 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:51.963 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 67 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911240+0000", 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915361+0000", 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041201110000000001 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915383+0000", 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2308000000000001e-05 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915393+0000", 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0404000000000001e-05 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915469+0000", 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5374e-05 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915680+0000", 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00021142200000000001 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915885+0000", 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020515600000000001 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.926916+0000", 2024-04-19T03:37:51.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011031085 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928443+0000", 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001526693 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928536+0000", 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3424999999999994e-05 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928611+0000", 2024-04-19T03:37:51.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4408999999999999e-05 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:68 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.8273770569999996, 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015772376000000001, 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 68 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028179+0000", 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031945+0000", 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037660240000000002 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031964+0000", 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.844e-05 2024-04-19T03:37:51.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031972+0000", 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8540000000000003e-06 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032064+0000", 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1699000000000004e-05 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032205+0000", 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014062699999999999 2024-04-19T03:37:51.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032341+0000", 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136086 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.037248+0000", 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049069630000000003 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043853+0000", 2024-04-19T03:37:51.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066051469999999996 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043895+0000", 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2385999999999997e-05 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043954+0000", 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8162000000000003e-05 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:51.974 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:51.975 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:51.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:37:51.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:51.977 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:51.975+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:52.077 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:52.076+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:52.148 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:52.148 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:52.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.148 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:17657 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1204224~4096 in=4096b,write 1232896~4096 in=4096b,write 1302528~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:52.148 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.145062+0000", 2024-04-19T03:37:52.148 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0021451399999999998, 2024-04-19T03:37:52.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002164816, 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 17657 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145062+0000", 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145062+0000", 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145061+0000", 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145073+0000", 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1661000000000001e-05 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145084+0000", 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1068e-05 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145091+0000", 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1729999999999998e-06 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145118+0000", 2024-04-19T03:37:52.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6381999999999999e-05 2024-04-19T03:37:52.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145164+0000", 2024-04-19T03:37:52.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6244e-05 2024-04-19T03:37:52.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:17658 4.36 e51/14 4:6da220e6:::100000001f8.0000003f:head v 51'820, mlcod=51'818)", 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.145987+0000", 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.001220519, 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012836620000000001, 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145987+0000", 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145987+0000", 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145986+0000", 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:52.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145998+0000", 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2091e-05 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146005+0000", 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5069999999999997e-06 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146009+0000", 2024-04-19T03:37:52.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3760000000000001e-06 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146037+0000", 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7379e-05 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146050+0000", 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2907e-05 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:17659 4.3f e51/14 4:fde182c5:::100000001f8.00000039:head v 51'265, mlcod=51'263)", 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.146475+0000", 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00073264000000000001, 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00082906899999999999, 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146475+0000", 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146475+0000", 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146474+0000", 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146494+0000", 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9244000000000001e-05 2024-04-19T03:37:52.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146501+0000", 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3769999999999998e-06 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146505+0000", 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.963e-06 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146528+0000", 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3484000000000001e-05 2024-04-19T03:37:52.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.146540+0000", 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1661000000000001e-05 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:17650 4.a 4:50194ce5:::100000001f8.00000027:head [write 3624960~4096 in=4096b,write 3645440~4096 in=4096b,write 3776512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.142381+0000", 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0048265319999999997, 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049587390000000002, 2024-04-19T03:37:52.160 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 17650 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142381+0000", 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142381+0000", 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142380+0000", 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142389+0000", 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7190000000000007e-06 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142396+0000", 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5719999999999999e-06 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142400+0000", 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4569999999999998e-06 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142427+0000", 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7002999999999999e-05 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142483+0000", 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6388999999999998e-05 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.164 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:17651 4.2f 4:f59f865b:::100000001f8.00000007:head [write 245760~4096 in=4096b,write 528384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.142963+0000", 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0042444809999999996, 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044163550000000003, 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:52.165 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 17651 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142963+0000", 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142963+0000", 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142962+0000", 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142973+0000", 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0679999999999999e-05 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142981+0000", 2024-04-19T03:37:52.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9889999999999992e-06 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.142989+0000", 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1820000000000006e-06 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143030+0000", 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0629e-05 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143103+0000", 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3097999999999997e-05 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143234+0000", 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013118799999999999 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145041+0000", 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001807124 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.169 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:17652 4.19 e51/14 4:997b7129:::100000001f8.00000000:head v 51'560, mlcod=51'557)", 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.143594+0000", 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0036136300000000001, 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003827492, 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143594+0000", 2024-04-19T03:37:52.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143594+0000", 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143593+0000", 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143602+0000", 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6659999999999997e-06 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143611+0000", 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1689999999999998e-06 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143616+0000", 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6609999999999999e-06 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143654+0000", 2024-04-19T03:37:52.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8228000000000001e-05 2024-04-19T03:37:52.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143666+0000", 2024-04-19T03:37:52.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1646e-05 2024-04-19T03:37:52.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:17653 4.15 e51/14 4:aada5e43:::100000001f8.00000028:head v 51'299, mlcod=51'297)", 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.143834+0000", 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0033730790000000002, 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036187979999999999, 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143834+0000", 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143834+0000", 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143834+0000", 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143849+0000", 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4844000000000001e-05 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143858+0000", 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2350000000000005e-06 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143864+0000", 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9229999999999999e-06 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143892+0000", 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8322000000000001e-05 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143904+0000", 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1623999999999999e-05 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:17654 4.12 4:4be51a30:::100000001f8.0000000b:head [write 1327104~4096 in=4096b,write 1441792~4096 in=4096b,write 1507328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.143922+0000", 2024-04-19T03:37:52.177 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0032857250000000002, 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035673100000000002, 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 17654 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143922+0000", 2024-04-19T03:37:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143922+0000", 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143921+0000", 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143932+0000", 2024-04-19T03:37:52.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1445e-05 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143941+0000", 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8750000000000006e-06 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143953+0000", 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1569999999999999e-05 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.143987+0000", 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3717999999999998e-05 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144033+0000", 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6241e-05 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144115+0000", 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2627999999999996e-05 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.145363+0000", 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001247281 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:17655 4.a 4:50194ce5:::100000001f8.00000027:head [write 3485696~4096 in=4096b,write 4034560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.144252+0000", 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00295518, 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032802719999999999, 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 17655 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144252+0000", 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144252+0000", 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144251+0000", 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144261+0000", 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7049999999999994e-06 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144271+0000", 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0056e-05 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144278+0000", 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0589999999999997e-06 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144310+0000", 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1945e-05 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144355+0000", 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5308000000000001e-05 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:17656 4.38 4:1d13bf87:::100000001f8.00000030:head [write 2338816~4096 in=4096b,write 2363392~4096 in=4096b,write 2555904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.144617+0000", 2024-04-19T03:37:52.186 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0025900279999999999, 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029661100000000001, 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 17656 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144617+0000", 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144617+0000", 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144617+0000", 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144656+0000", 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9709999999999998e-05 2024-04-19T03:37:52.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144667+0000", 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0084999999999999e-05 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144671+0000", 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.656e-06 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144699+0000", 2024-04-19T03:37:52.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7667000000000001e-05 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.144745+0000", 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6563000000000001e-05 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 10 2024-04-19T03:37:52.190 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:52.192 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:52.192 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:52.190+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:52.292 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:52.291+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:52.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:52.394 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:52.392+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:52.395 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:52.395 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:52.395 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:52.395 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:52.395 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:52.409 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:52.495 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:52.493+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:52.546 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:52.570 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:52.571 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:52.571 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:52.571 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:52.574 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:52.574 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:52.594 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:52.593+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:52.612 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:52.613 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:52.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:52.695 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:52.694+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:52.796 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:52.794+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:52.816 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:52.816 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:52.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:52.915 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:52.914+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:52.998 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:52.997+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:53.068 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:53.069 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:53.084 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:53.126 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:53.124+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:53.200 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:53.199+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:53.301 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:53.300+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:53.318 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:53.318 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:53.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:37:53.401 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:53.400+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:53.491 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:53.491 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:53.502 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:53.500+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:53.505 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:53.602 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:53.601+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:53.667 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:53.667 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:53.680 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:53.724 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:53.723+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:53.804 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:53.803+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:53.846 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:53.846 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:53.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:53.906 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:53.905+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:54.007 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:54.005+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:54.054 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:54.054 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:54.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:54.111 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:54.110+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:54.208 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:54.207+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:54.308 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:54.309 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:54.309 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:54.307+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:54.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:54.410 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:54.409+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:54.509 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:54.509+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:54.546 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:54.546 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:54.560 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:54.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:54.610 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:54.609+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:54.711 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:54.710+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:54.721 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:54.721 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:54.735 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:54.770 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:54.797 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:54.800 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:54.801 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:54.812 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:54.811+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:54.913 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:54.912+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:54.949 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:54.950 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:54.961 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:55.045 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:55.044+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:55.114 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:55.113+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:55.172 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:55.172 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 115.304346424, 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:55.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18 4.33 e46/14 4:cf6d7a6c:::100000001f8.0000000a:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.96776921, 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012782457000000001, 2024-04-19T03:37:55.177 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202650+0000", 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206458+0000", 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003808016 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206470+0000", 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2455e-05 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206495+0000", 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4888e-05 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206545+0000", 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9314000000000003e-05 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206562+0000", 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723e-05 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215395+0000", 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088321920000000009 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215435+0000", 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0315999999999998e-05 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.85477582, 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.182 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:55.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:37:55.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.490960699999999, 2024-04-19T03:37:55.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014462462000000001, 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 22 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679458+0000", 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683146+0000", 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036878869999999999 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683169+0000", 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2699000000000001e-05 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683183+0000", 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3684e-05 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683264+0000", 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1086000000000003e-05 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683369+0000", 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105289 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683466+0000", 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7298000000000003e-05 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.689790+0000", 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063238010000000004 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693826+0000", 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040361140000000004 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693880+0000", 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3480999999999998e-05 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693923+0000", 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3612000000000002e-05 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:24 4.36 e47/14 4:6c9c34b1:::100000001f8.00000010:head v 47'2, mlcod=0'0)", 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.249743251999998, 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013771834, 2024-04-19T03:37:55.194 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920677+0000", 2024-04-19T03:37:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924314+0000", 2024-04-19T03:37:55.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036369900000000001 2024-04-19T03:37:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924329+0000", 2024-04-19T03:37:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4752e-05 2024-04-19T03:37:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924356+0000", 2024-04-19T03:37:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7506000000000001e-05 2024-04-19T03:37:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924405+0000", 2024-04-19T03:37:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495000000000002e-05 2024-04-19T03:37:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924431+0000", 2024-04-19T03:37:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6678000000000001e-05 2024-04-19T03:37:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934351+0000", 2024-04-19T03:37:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.009920023 2024-04-19T03:37:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934450+0000", 2024-04-19T03:37:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8826000000000006e-05 2024-04-19T03:37:55.201 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.643327232000001, 2024-04-19T03:37:55.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:37:55.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:37:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:37:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:37:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:37:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:37:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:37:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:37:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:37:55.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:31 4.30 4:0c89e311:::100000001f8.00000017:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:55.209 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.400336658000001, 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011301624999999999, 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 31 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770085+0000", 2024-04-19T03:37:55.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.770081+0000", 2024-04-19T03:37:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999962 2024-04-19T03:37:55.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774108+0000", 2024-04-19T03:37:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040261660000000003 2024-04-19T03:37:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774129+0000", 2024-04-19T03:37:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1739999999999999e-05 2024-04-19T03:37:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774140+0000", 2024-04-19T03:37:55.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.047e-05 2024-04-19T03:37:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774186+0000", 2024-04-19T03:37:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5938e-05 2024-04-19T03:37:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.774291+0000", 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105497 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781291+0000", 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069996030000000001 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781336+0000", 2024-04-19T03:37:55.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5241000000000003e-05 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.781387+0000", 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0596999999999997e-05 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.156179220999999, 2024-04-19T03:37:55.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015903805, 2024-04-19T03:37:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.218 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014241+0000", 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018134+0000", 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038934180000000001 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018152+0000", 2024-04-19T03:37:55.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8278e-05 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018163+0000", 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0647e-05 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018235+0000", 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2350999999999999e-05 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018354+0000", 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119178 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018459+0000", 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104245 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.023951+0000", 2024-04-19T03:37:55.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054925169999999997 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030090+0000", 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061382679999999997 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030120+0000", 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0269000000000001e-05 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030146+0000", 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6418999999999999e-05 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63 4.23 4:c6f90462:::100000001f8.00000037:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.688265463, 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014504006, 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.224 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482155+0000", 2024-04-19T03:37:55.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:55.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485920+0000", 2024-04-19T03:37:55.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037649519999999998 2024-04-19T03:37:55.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485936+0000", 2024-04-19T03:37:55.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6002999999999999e-05 2024-04-19T03:37:55.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485949+0000", 2024-04-19T03:37:55.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3227000000000001e-05 2024-04-19T03:37:55.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486029+0000", 2024-04-19T03:37:55.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0703000000000003e-05 2024-04-19T03:37:55.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486131+0000", 2024-04-19T03:37:55.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010152 2024-04-19T03:37:55.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:55.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486226+0000", 2024-04-19T03:37:55.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4858000000000006e-05 2024-04-19T03:37:55.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.492383+0000", 2024-04-19T03:37:55.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061568109999999999 2024-04-19T03:37:55.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:55.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496591+0000", 2024-04-19T03:37:55.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042080850000000003 2024-04-19T03:37:55.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496626+0000", 2024-04-19T03:37:55.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5040999999999999e-05 2024-04-19T03:37:55.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496660+0000", 2024-04-19T03:37:55.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4415999999999997e-05 2024-04-19T03:37:55.235 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.236 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.236 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.236 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:55.236 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:55.236 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.575783298999999, 2024-04-19T03:37:55.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013334689, 2024-04-19T03:37:55.236 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.237 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.237 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.237 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.237 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.237 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64 2024-04-19T03:37:55.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.237 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594637+0000", 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598298+0000", 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036613980000000002 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598311+0000", 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2632999999999999e-05 2024-04-19T03:37:55.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598318+0000", 2024-04-19T03:37:55.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9619999999999996e-06 2024-04-19T03:37:55.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598391+0000", 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3206000000000003e-05 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598549+0000", 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015764899999999999 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598713+0000", 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016429300000000001 2024-04-19T03:37:55.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.605057+0000", 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063441469999999996 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607908+0000", 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028502739999999999 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607943+0000", 2024-04-19T03:37:55.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4928000000000002e-05 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607973+0000", 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0423e-05 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:65 4.3f e48/14 4:fde182c5:::100000001f8.00000039:head v 48'1, mlcod=0'0)", 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.466685382, 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011647948999999999, 2024-04-19T03:37:55.244 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703736+0000", 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.703735+0000", 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707551+0000", 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038161409999999999 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707565+0000", 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3841e-05 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707571+0000", 2024-04-19T03:37:55.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6930000000000001e-06 2024-04-19T03:37:55.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707631+0000", 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9861000000000002e-05 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.707655+0000", 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4219e-05 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.715341+0000", 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076858680000000002 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.715384+0000", 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2953e-05 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:68 4.6 e48/14 4:635f8cb4:::100000001f8.0000003c:head v 48'4, mlcod=47'2)", 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.137864987, 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010980092, 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032557+0000", 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.032555+0000", 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036310+0000", 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037547489999999999 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036332+0000", 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1929999999999998e-05 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036361+0000", 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9104000000000001e-05 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036437+0000", 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5592000000000004e-05 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.036465+0000", 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8231000000000001e-05 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.043487+0000", 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00702178 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:43.043537+0000", 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0204999999999998e-05 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18239 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1728512~4096,write 1757184~4096,write 1802240~4096,write 1986560~4096,write 2007040~4096,write 2068480~4096,write 2097152~4096,write 2224128~4096,write 2367488~4096,write 2449408~4096,write 2498560~4096,write 2564096~4096,write 2744320~4096,write 2760704~4096,write 3362816~4096,write 3407872~4096,write 3424256~4096,write 3469312~4096,write 3493888~4096,write 3518464~4096,write 3612672~4096,write 3817472~4096,write 3874816~4096,write 3915776~4096,write 3973120~4096,write 3989504~4096,write 4046848~4096,write 4083712~4096,write 4104192~4096,write 4136960~4096,write 4169728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398134+0000", 2024-04-19T03:37:55.253 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.7722873469999998, 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011826674000000001, 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18239 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398134+0000", 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398134+0000", 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398133+0000", 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398248+0000", 2024-04-19T03:37:55.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114899 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398258+0000", 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6320000000000003e-06 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398265+0000", 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2180000000000002e-06 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398295+0000", 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0337000000000001e-05 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398361+0000", 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5103000000000003e-05 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.409774+0000", 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011413184 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.409864+0000", 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0234000000000004e-05 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.409961+0000", 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6961999999999998e-05 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18241 4.37 4:eff9002a:::100000001f8.00000003:head [write 389120~4096,write 700416~4096,write 708608~4096,write 737280~4096,write 815104~4096,write 1024000~4096,write 1208320~4096,write 1228800~4096,write 1400832~4096,write 1671168~4096,write 1843200~4096,write 1929216~4096,write 2519040~4096,write 2654208~8192,write 2699264~4096,write 2752512~4096,write 2793472~4096,write 2859008~4096,write 3059712~4096,write 3313664~4096,write 3411968~4096,write 3493888~4096,write 3567616~4096,write 3710976~4096,write 3739648~4096,write 3813376~8192,write 3825664~4096,write 4026368~4096,write 4141056~4096,write 4161536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:55.258 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.7719421469999999, 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014068550000000001, 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18241 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:55.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398578+0000", 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398587+0000", 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3880000000000006e-06 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398593+0000", 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5289999999999997e-06 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398644+0000", 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0773999999999999e-05 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398751+0000", 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000107086 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399281+0000", 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052965 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.410466+0000", 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011184967000000001 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412447+0000", 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019815000000000002 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412523+0000", 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5368000000000001e-05 2024-04-19T03:37:55.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412548+0000", 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5239999999999999e-05 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18247 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 221184~4096,write 946176~4096,write 970752~4096,write 1142784~4096,write 1310720~4096,write 1839104~4096,write 2060288~4096,write 2093056~4096,write 2162688~4096,write 2179072~4096,write 2195456~4096,write 2240512~4096,write 2289664~4096,write 2334720~4096,write 2457600~4096,write 2510848~8192,write 2592768~4096,write 2621440~4096,write 2723840~4096,write 2912256~4096,write 2924544~4096,write 2977792~8192,write 3039232~4096,write 3088384~4096,write 3514368~4096,write 3563520~4096,write 3809280~4096,write 4022272~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.771423317, 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01346782, 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.264 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18247 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:55.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399176+0000", 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017803799999999999 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399185+0000", 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399192+0000", 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4099999999999996e-06 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399340+0000", 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014863699999999999 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399455+0000", 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114925 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412354+0000", 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012898817 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412406+0000", 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2114999999999998e-05 2024-04-19T03:37:55.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412466+0000", 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0098e-05 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18238 4.14 e51/14 4:2b28d75f:::100000001f8.00000016:head v 51'291, mlcod=51'289)", 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.77098434, 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012607798999999999, 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.269 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:55.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399491+0000", 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4777000000000001e-05 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399501+0000", 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2969999999999992e-06 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399509+0000", 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8539999999999997e-06 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400010+0000", 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00050124399999999997 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400028+0000", 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7745999999999999e-05 2024-04-19T03:37:55.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412014+0000", 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011986254999999999 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412045+0000", 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1299e-05 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18242 4.6 e51/14 4:62d56fc8:::100000001f8.0000001c:head v 51'1114, mlcod=51'1112)", 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.7708322399999998, 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012663195, 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399738+0000", 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014895899999999999 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399745+0000", 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4290000000000004e-06 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399751+0000", 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1e-06 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399790+0000", 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8863999999999999e-05 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399812+0000", 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1461e-05 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412239+0000", 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012427291 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412253+0000", 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3569e-05 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18245 4.36 e51/14 4:6fa85f86:::100000001f8.00000013:head v 51'853, mlcod=51'851)", 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.399764+0000", 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.7706579869999999, 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012342689, 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399764+0000", 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399764+0000", 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399763+0000", 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399860+0000", 2024-04-19T03:37:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7181000000000003e-05 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399869+0000", 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2810000000000008e-06 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399875+0000", 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5969999999999997e-06 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400144+0000", 2024-04-19T03:37:55.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000268984 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400163+0000", 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8839999999999999e-05 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412089+0000", 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011925382 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412106+0000", 2024-04-19T03:37:55.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7742999999999999e-05 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:23560 4.36 e52/14 4:6fa85f86:::100000001f8.00000013:head v 52'1113, mlcod=52'1110)", 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.24670033899999999, 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014400698, 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923737+0000", 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6252999999999998e-05 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923745+0000", 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6750000000000002e-06 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923751+0000", 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8300000000000001e-06 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923782+0000", 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1479999999999997e-05 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923800+0000", 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7887e-05 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.938093+0000", 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014293538 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.938122+0000", 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8493999999999999e-05 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:23728 4.38 4:1dcf718c:::100000001f8.00000022:head [write 749568~4096,write 757760~4096,write 839680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:54.992983+0000", 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.177438285, 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012264565999999999, 2024-04-19T03:37:55.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 23728 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992983+0000", 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:55.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992983+0000", 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992982+0000", 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992995+0000", 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2716e-05 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993008+0000", 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2490999999999999e-05 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993015+0000", 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3590000000000002e-06 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993060+0000", 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4703000000000002e-05 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993113+0000", 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3032999999999999e-05 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:55.005122+0000", 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012009410999999999 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:55.005172+0000", 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0222000000000001e-05 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:55.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:55.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:55.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:55.005248+0000", 2024-04-19T03:37:55.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5536000000000003e-05 2024-04-19T03:37:55.291 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.291 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.291 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.291 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:55.291 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:55.291 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:55.293 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:55.293 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:55.291+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:55.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:37:55.394 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:55.392+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:55.482 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:55.482 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:55.482 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:37:55.482 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:55.495 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:55.624 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:55.493+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:55.625 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:55.624+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:55.726 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:55.724+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:55.827 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:55.826+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:55.839 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:55.839 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:37:55.839 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:37:55.839 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:37:55.839 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:55.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:55.941 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:55.940+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:56.029 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:56.028+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:56.097 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.229157215, 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:37:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.229112421, 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:37:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.229056826, 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:37:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:37:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:37:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.229016488, 2024-04-19T03:37:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:37:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:37:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.228986495, 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:37:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.22895677, 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.228916215, 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:37:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:37:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.228893594, 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.2288652, 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:2 3.f e15/13 3:f1f69726:::400.00000000:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.22041123, 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016114193999999998, 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874130+0000", 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874129+0000", 2024-04-19T03:37:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874136+0000", 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874144+0000", 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0309999999999998e-06 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874150+0000", 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0379999999999996e-06 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874482+0000", 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000332369 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874507+0000", 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5088000000000001e-05 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890198+0000", 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015690424000000001 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890244+0000", 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6490999999999999e-05 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(mds.0.3:19 3.d e15/13 3:b50e409b:::mds_snaptable:head v 15'1, mlcod=0'0)", 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 116.219893562, 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015620685, 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874648+0000", 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874647+0000", 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874655+0000", 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874679+0000", 2024-04-19T03:37:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4292999999999999e-05 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874695+0000", 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875893+0000", 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001198071 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875907+0000", 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4292e-05 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890225+0000", 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014317673 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890268+0000", 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3618999999999997e-05 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.896782013999999, 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:37:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.294740594, 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016272293, 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 23 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799801+0000", 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.799798+0000", 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804034+0000", 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042360970000000003 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804056+0000", 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1730999999999999e-05 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804067+0000", 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0727000000000001e-05 2024-04-19T03:37:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804162+0000", 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5371999999999994e-05 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.804308+0000", 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146205 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815916+0000", 2024-04-19T03:37:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011607255 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.815992+0000", 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6304999999999995e-05 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.816073+0000", 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0945000000000005e-05 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.178383613000001, 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:37:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:37:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:37:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 17.808345457000001, 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016569639000000001, 2024-04-19T03:37:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 27 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286196+0000", 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.286193+0000", 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291309+0000", 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051164189999999997 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291329+0000", 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9864000000000002e-05 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291339+0000", 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0127e-05 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291389+0000", 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9694999999999998e-05 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291519+0000", 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012998400000000001 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.291637+0000", 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000118137 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.295752+0000", 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041148570000000004 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302676+0000", 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069241370000000003 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302716+0000", 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0046999999999998e-05 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:38.302765+0000", 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9057999999999997e-05 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:58 4.28 4:15eeb89b:::100000001f8.00000032:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.189114241, 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015633246, 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58 2024-04-19T03:37:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905427+0000", 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.905425+0000", 2024-04-19T03:37:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909174+0000", 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037485740000000002 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909192+0000", 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8377999999999999e-05 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909204+0000", 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2418999999999999e-05 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909306+0000", 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102038 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909422+0000", 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011593 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.909549+0000", 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000127071 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.916572+0000", 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007022538 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.920988+0000", 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044155590000000003 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921030+0000", 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1956999999999998e-05 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:41.921060+0000", 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0589000000000001e-05 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65 4.3f 4:fde182c5:::100000001f8.00000039:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.395469445, 2024-04-19T03:37:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016635464999999999, 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699072+0000", 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.699069+0000", 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702973+0000", 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039033840000000002 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.702996+0000", 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3983999999999999e-05 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703010+0000", 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3644e-05 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703077+0000", 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6527999999999997e-05 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703256+0000", 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000178846 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.703438+0000", 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000182573 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.709201+0000", 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005762868 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715583+0000", 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063823990000000004 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715652+0000", 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9148999999999998e-05 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.715707+0000", 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4639000000000003e-05 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:67 4.28 4:153ae410:::100000001f8.0000003b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.183297899999999, 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017367636999999998, 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 67 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911243+0000", 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.911240+0000", 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:37:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915361+0000", 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041201110000000001 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915383+0000", 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2308000000000001e-05 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915393+0000", 2024-04-19T03:37:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0404000000000001e-05 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915469+0000", 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5374e-05 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915680+0000", 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00021142200000000001 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.915885+0000", 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020515600000000001 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.926916+0000", 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011031085 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928443+0000", 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001526693 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928536+0000", 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3424999999999994e-05 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:42.928611+0000", 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4408999999999999e-05 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:68 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.066359950000001, 2024-04-19T03:37:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015772376000000001, 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 68 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028181+0000", 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.028179+0000", 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031945+0000", 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037660240000000002 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031964+0000", 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.844e-05 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.031972+0000", 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8540000000000003e-06 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032064+0000", 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1699000000000004e-05 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032205+0000", 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014062699999999999 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.032341+0000", 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136086 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.037248+0000", 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049069630000000003 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043853+0000", 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066051469999999996 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043895+0000", 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2385999999999997e-05 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:43.043954+0000", 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8162000000000003e-05 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:23560 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3469312~4096,write 3522560~4096,write 3739648~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:54.922481+0000", 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.172059996, 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015820803000000001, 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 23560 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.922481+0000", 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.922481+0000", 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.922480+0000", 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.922494+0000", 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3917000000000001e-05 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.922506+0000", 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1853e-05 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.922515+0000", 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7530000000000007e-06 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.923328+0000", 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00081268099999999999 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.923421+0000", 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3292000000000001e-05 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.923580+0000", 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000159049 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.925225+0000", 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016449870000000001 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.938208+0000", 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012983175 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.938248+0000", 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0117999999999998e-05 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:37:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:54.938302+0000", 2024-04-19T03:37:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3780999999999999e-05 2024-04-19T03:37:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:56.207 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:56.209 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:56.209 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:56.207+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:56.309 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:56.308+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:37:56.374 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:56.374 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:26767 4.c 4:33b8095f:::100000001f8.0000003a:head [write 270336~4096 in=4096b,write 380928~4096 in=4096b,write 618496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:56.372601+0000", 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0013571989999999999, 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013810070000000001, 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 26767 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.372601+0000", 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.372601+0000", 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.372600+0000", 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.372613+0000", 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3093e-05 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.372622+0000", 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2970000000000004e-06 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.372627+0000", 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5130000000000004e-06 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.372675+0000", 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8118000000000002e-05 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.372784+0000", 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000108824 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.381 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:26768 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 3592192~4096 in=4096b,write 3862528~4096 in=4096b,write 3883008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:56.373462+0000", 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00049676099999999997, 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00058011900000000003, 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:56.382 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 26768 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.373462+0000", 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.373462+0000", 2024-04-19T03:37:56.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.373461+0000", 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.373480+0000", 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9347e-05 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.373489+0000", 2024-04-19T03:37:56.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8019999999999998e-06 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.373496+0000", 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0339999999999999e-06 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.373528+0000", 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1483999999999999e-05 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.373593+0000", 2024-04-19T03:37:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5653000000000003e-05 2024-04-19T03:37:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:37:56.386 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 2 2024-04-19T03:37:56.386 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:56.387 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:56.410 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:56.409+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:56.511 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:56.509+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:56.586 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:56.586 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:37:56.586 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:37:56.586 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:37:56.586 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:56.599 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:56.642 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:56.641+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:56.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-04-19T03:37:56.712 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:56.711+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:56.758 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:26 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 116.89036934400001, 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011806433999999999, 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866075+0000", 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866077+0000", 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.351e-06 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866083+0000", 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2770000000000002e-06 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866096+0000", 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2994e-05 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866871+0000", 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077422400000000001 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.866983+0000", 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111896 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:35:59.877882+0000", 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010899099000000001 2024-04-19T03:37:56.762 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18 4.33 e46/14 4:cf6d7a6c:::100000001f8.0000000a:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.553792130000001, 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012782457000000001, 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:56.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202650+0000", 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206458+0000", 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003808016 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206470+0000", 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2455e-05 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206495+0000", 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4888e-05 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206545+0000", 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9314000000000003e-05 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206562+0000", 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723e-05 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215395+0000", 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088321920000000009 2024-04-19T03:37:56.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215435+0000", 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0315999999999998e-05 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.440798740000002, 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:37:56.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:37:56.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 19.07698362, 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014462462000000001, 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 22 2024-04-19T03:37:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679458+0000", 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683146+0000", 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036878869999999999 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683169+0000", 2024-04-19T03:37:56.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2699000000000001e-05 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683183+0000", 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3684e-05 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683264+0000", 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1086000000000003e-05 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683369+0000", 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105289 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683466+0000", 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7298000000000003e-05 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.689790+0000", 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063238010000000004 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693826+0000", 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040361140000000004 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693880+0000", 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3480999999999998e-05 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693923+0000", 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3612000000000002e-05 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.778 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:24 4.36 e47/14 4:6c9c34b1:::100000001f8.00000010:head v 47'2, mlcod=0'0)", 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.835766172, 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013771834, 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920677+0000", 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924314+0000", 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036369900000000001 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924329+0000", 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4752e-05 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924356+0000", 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7506000000000001e-05 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924405+0000", 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495000000000002e-05 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924431+0000", 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6678000000000001e-05 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934351+0000", 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.009920023 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934450+0000", 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8826000000000006e-05 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.229350151999999, 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:56.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:37:56.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:37:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:37:56.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:37:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:37:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.789 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.742202141, 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015903805, 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:56.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014241+0000", 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018134+0000", 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038934180000000001 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018152+0000", 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8278e-05 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018163+0000", 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0647e-05 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018235+0000", 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2350999999999999e-05 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018354+0000", 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119178 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018459+0000", 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104245 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.023951+0000", 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054925169999999997 2024-04-19T03:37:56.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030090+0000", 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061382679999999997 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030120+0000", 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0269000000000001e-05 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030146+0000", 2024-04-19T03:37:56.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6418999999999999e-05 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63 4.23 4:c6f90462:::100000001f8.00000037:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.274288383, 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014504006, 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.796 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482155+0000", 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485920+0000", 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037649519999999998 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485936+0000", 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6002999999999999e-05 2024-04-19T03:37:56.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485949+0000", 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3227000000000001e-05 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486029+0000", 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0703000000000003e-05 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486131+0000", 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010152 2024-04-19T03:37:56.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486226+0000", 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4858000000000006e-05 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.492383+0000", 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061568109999999999 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496591+0000", 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042080850000000003 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496626+0000", 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5040999999999999e-05 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496660+0000", 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4415999999999997e-05 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.161806219000001, 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013334689, 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594637+0000", 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598298+0000", 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036613980000000002 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598311+0000", 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2632999999999999e-05 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598318+0000", 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9619999999999996e-06 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598391+0000", 2024-04-19T03:37:56.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3206000000000003e-05 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598549+0000", 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015764899999999999 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598713+0000", 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016429300000000001 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.605057+0000", 2024-04-19T03:37:56.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063441469999999996 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607908+0000", 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028502739999999999 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607943+0000", 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4928000000000002e-05 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607973+0000", 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0423e-05 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18239 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1728512~4096,write 1757184~4096,write 1802240~4096,write 1986560~4096,write 2007040~4096,write 2068480~4096,write 2097152~4096,write 2224128~4096,write 2367488~4096,write 2449408~4096,write 2498560~4096,write 2564096~4096,write 2744320~4096,write 2760704~4096,write 3362816~4096,write 3407872~4096,write 3424256~4096,write 3469312~4096,write 3493888~4096,write 3518464~4096,write 3612672~4096,write 3817472~4096,write 3874816~4096,write 3915776~4096,write 3973120~4096,write 3989504~4096,write 4046848~4096,write 4083712~4096,write 4104192~4096,write 4136960~4096,write 4169728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398134+0000", 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3583102670000002, 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011826674000000001, 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.807 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18239 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398134+0000", 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398134+0000", 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398133+0000", 2024-04-19T03:37:56.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398248+0000", 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114899 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398258+0000", 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6320000000000003e-06 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398265+0000", 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2180000000000002e-06 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398295+0000", 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0337000000000001e-05 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398361+0000", 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5103000000000003e-05 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.409774+0000", 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011413184 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.409864+0000", 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0234000000000004e-05 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.409961+0000", 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6961999999999998e-05 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18241 4.37 4:eff9002a:::100000001f8.00000003:head [write 389120~4096,write 700416~4096,write 708608~4096,write 737280~4096,write 815104~4096,write 1024000~4096,write 1208320~4096,write 1228800~4096,write 1400832~4096,write 1671168~4096,write 1843200~4096,write 1929216~4096,write 2519040~4096,write 2654208~8192,write 2699264~4096,write 2752512~4096,write 2793472~4096,write 2859008~4096,write 3059712~4096,write 3313664~4096,write 3411968~4096,write 3493888~4096,write 3567616~4096,write 3710976~4096,write 3739648~4096,write 3813376~8192,write 3825664~4096,write 4026368~4096,write 4141056~4096,write 4161536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:56.811 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3579650670000003, 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014068550000000001, 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18241 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398578+0000", 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:56.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398587+0000", 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3880000000000006e-06 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398593+0000", 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5289999999999997e-06 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398644+0000", 2024-04-19T03:37:56.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0773999999999999e-05 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398751+0000", 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000107086 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399281+0000", 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052965 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.410466+0000", 2024-04-19T03:37:56.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011184967000000001 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412447+0000", 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019815000000000002 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412523+0000", 2024-04-19T03:37:56.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5368000000000001e-05 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412548+0000", 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5239999999999999e-05 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18247 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 221184~4096,write 946176~4096,write 970752~4096,write 1142784~4096,write 1310720~4096,write 1839104~4096,write 2060288~4096,write 2093056~4096,write 2162688~4096,write 2179072~4096,write 2195456~4096,write 2240512~4096,write 2289664~4096,write 2334720~4096,write 2457600~4096,write 2510848~8192,write 2592768~4096,write 2621440~4096,write 2723840~4096,write 2912256~4096,write 2924544~4096,write 2977792~8192,write 3039232~4096,write 3088384~4096,write 3514368~4096,write 3563520~4096,write 3809280~4096,write 4022272~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3574462369999996, 2024-04-19T03:37:56.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01346782, 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18247 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399176+0000", 2024-04-19T03:37:56.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017803799999999999 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399185+0000", 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399192+0000", 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4099999999999996e-06 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399340+0000", 2024-04-19T03:37:56.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014863699999999999 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399455+0000", 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114925 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412354+0000", 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012898817 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412406+0000", 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2114999999999998e-05 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412466+0000", 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0098e-05 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18238 4.14 e51/14 4:2b28d75f:::100000001f8.00000016:head v 51'291, mlcod=51'289)", 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3570072599999996, 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012607798999999999, 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399491+0000", 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4777000000000001e-05 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399501+0000", 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2969999999999992e-06 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399509+0000", 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8539999999999997e-06 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400010+0000", 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00050124399999999997 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400028+0000", 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7745999999999999e-05 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412014+0000", 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011986254999999999 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412045+0000", 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1299e-05 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18242 4.6 e51/14 4:62d56fc8:::100000001f8.0000001c:head v 51'1114, mlcod=51'1112)", 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3568551600000003, 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012663195, 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399738+0000", 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014895899999999999 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399745+0000", 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4290000000000004e-06 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399751+0000", 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1e-06 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399790+0000", 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8863999999999999e-05 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399812+0000", 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1461e-05 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412239+0000", 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012427291 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412253+0000", 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3569e-05 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18245 4.36 e51/14 4:6fa85f86:::100000001f8.00000013:head v 51'853, mlcod=51'851)", 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.399764+0000", 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.3566809070000003, 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012342689, 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399764+0000", 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399764+0000", 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399763+0000", 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399860+0000", 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7181000000000003e-05 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399869+0000", 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2810000000000008e-06 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399875+0000", 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5969999999999997e-06 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400144+0000", 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000268984 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400163+0000", 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8839999999999999e-05 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412089+0000", 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011925382 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412106+0000", 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7742999999999999e-05 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:23560 4.36 e52/14 4:6fa85f86:::100000001f8.00000013:head v 52'1113, mlcod=52'1110)", 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.832723259, 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014400698, 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923737+0000", 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6252999999999998e-05 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923745+0000", 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6750000000000002e-06 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923751+0000", 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8300000000000001e-06 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923782+0000", 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1479999999999997e-05 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923800+0000", 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7887e-05 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.938093+0000", 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014293538 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.938122+0000", 2024-04-19T03:37:56.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8493999999999999e-05 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:23728 4.38 4:1dcf718c:::100000001f8.00000022:head [write 749568~4096,write 757760~4096,write 839680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:54.992983+0000", 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.763461205, 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012264565999999999, 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.839 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 23728 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992983+0000", 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992983+0000", 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992982+0000", 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992995+0000", 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2716e-05 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993008+0000", 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2490999999999999e-05 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993015+0000", 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3590000000000002e-06 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993060+0000", 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4703000000000002e-05 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993113+0000", 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3032999999999999e-05 2024-04-19T03:37:56.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:55.005122+0000", 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012009410999999999 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:55.005172+0000", 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0222000000000001e-05 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:55.005248+0000", 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5536000000000003e-05 2024-04-19T03:37:56.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:26992 4.37 4:eff9002a:::100000001f8.00000003:head [write 1896448~4096,write 1929216~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:56.470536+0000", 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.28590902299999998, 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012277968, 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.844 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 26992 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470536+0000", 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470536+0000", 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470535+0000", 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470546+0000", 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1422e-05 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470556+0000", 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3130000000000004e-06 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470561+0000", 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7389999999999996e-06 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470602+0000", 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0669e-05 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470681+0000", 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8478000000000003e-05 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470815+0000", 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013403300000000001 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.480745+0000", 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099306780000000001 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.482712+0000", 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019663889999999998 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.482768+0000", 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6200999999999999e-05 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.482813+0000", 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5666e-05 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:27047 4.28 e53/14 4:153ae410:::100000001f8.0000003b:head v 53'873, mlcod=53'870)", 2024-04-19T03:37:56.849 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:56.527388+0000", 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.22905658200000001, 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011849095, 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527388+0000", 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527388+0000", 2024-04-19T03:37:56.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527387+0000", 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527400+0000", 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2771e-05 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527409+0000", 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8999999999999995e-06 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527415+0000", 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2519999999999996e-06 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527617+0000", 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020220399999999999 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527636+0000", 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8238999999999999e-05 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.539205+0000", 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011569472000000001 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.539237+0000", 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1872000000000002e-05 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:27051 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3928064~4096,write 4001792~4096,write 4124672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:56.529717+0000", 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.22672798499999999, 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013161421, 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 27051 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:56.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529717+0000", 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529717+0000", 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529715+0000", 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529728+0000", 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2839e-05 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529740+0000", 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1634000000000001e-05 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529748+0000", 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6760000000000007e-06 2024-04-19T03:37:56.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529801+0000", 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3436000000000001e-05 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529899+0000", 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7701000000000005e-05 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.542810+0000", 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012911677 2024-04-19T03:37:56.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.542838+0000", 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7631e-05 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.542878+0000", 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9891999999999997e-05 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.858 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:56.859 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:56.859 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:56.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:37:56.861 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:56.859+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:56.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:56.962 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:56.960+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:57.060 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:57.060 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:28197 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3854336~4096 in=4096b,write 3866624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:57.051928+0000", 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0048163340000000002, 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048464570000000002, 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28197 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.051928+0000", 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.051928+0000", 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.051927+0000", 2024-04-19T03:37:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.051939+0000", 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1812e-05 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.051951+0000", 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1293e-05 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.051958+0000", 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4900000000000003e-06 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.052009+0000", 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1371e-05 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.052095+0000", 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5686000000000006e-05 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.052253+0000", 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015764199999999999 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054491+0000", 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002238397 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:28202 4.28 4:153ae410:::100000001f8.0000003b:head [write 2101248~4096 in=4096b,write 2220032~4096 in=4096b,write 2322432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:57.054255+0000", 2024-04-19T03:37:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0024899420000000002, 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00261852, 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28202 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054255+0000", 2024-04-19T03:37:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054255+0000", 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054254+0000", 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054268+0000", 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4012999999999999e-05 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054288+0000", 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0559000000000001e-05 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054304+0000", 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5328999999999998e-05 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054357+0000", 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3244e-05 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054459+0000", 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102042 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.054629+0000", 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000170058 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:37:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056255+0000", 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016259740000000001 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:28207 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1236992~4096 in=4096b,write 1323008~4096 in=4096b,write 1339392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:57.056048+0000", 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00069603700000000004, 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00088179899999999995, 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28207 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056048+0000", 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056048+0000", 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056047+0000", 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056067+0000", 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.916e-05 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056079+0000", 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2696e-05 2024-04-19T03:37:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056090+0000", 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0317e-05 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056128+0000", 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7944000000000001e-05 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056178+0000", 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0763000000000002e-05 2024-04-19T03:37:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056349+0000", 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017032500000000001 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:28206 4.2f e53/14 4:f59f865b:::100000001f8.00000007:head v 53'435, mlcod=53'433)", 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:57.056158+0000", 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00058629299999999999, 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082166800000000001, 2024-04-19T03:37:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056158+0000", 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056158+0000", 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056158+0000", 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056170+0000", 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2087e-05 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056176+0000", 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056180+0000", 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0879999999999997e-06 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056218+0000", 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7215000000000002e-05 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056238+0000", 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0891999999999999e-05 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:28208 4.12 e53/14 4:48ab9bde:::100000001f8.00000015:head v 53'878, mlcod=53'876)", 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:57.056761+0000", 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9999838, 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025558500000000001, 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056761+0000", 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056761+0000", 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056760+0000", 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056802+0000", 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1411e-05 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056814+0000", 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2259000000000001e-05 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056821+0000", 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2099999999999996e-06 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056865+0000", 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3627000000000001e-05 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:57.056881+0000", 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6730000000000001e-05 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 5 2024-04-19T03:37:57.081 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:57.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:57.083 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:57.081+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:57.084 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:57.088 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:57.088 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:57.183 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:57.182+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:57.284 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:57.283+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:57.316 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:57.316 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:57.333 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:57.417 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:57.416+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:57.485 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:57.484+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:57.559 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:57.560 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:57.577 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:57.621 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:57.620+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:57.687 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:57.686+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:57.749 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:57.749 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:57.762 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:57.804 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:57.803+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:57.889 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:57.888+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:57.964 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:57.965 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:57.979 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:58.022 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:58.021+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:58.092 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:58.091+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:58.144 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:58.144 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:58.159 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:58.202 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:58.201+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:58.294 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:58.293+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:58.359 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:58.359 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:58.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:58.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:37:58.414 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:58.413+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:58.495 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:58.494+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:58.596 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:58.595+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:58.605 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:58.605 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:58.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:37:58.696 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:58.695+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:58.797 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:58.796+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:58.859 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:58.859 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:58.876 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:37:58.920 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:58.919+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:58.998 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:58.997+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:59.047 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:59.047 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:59.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:37:59.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:37:59.099 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:59.098+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:59.200 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:59.199+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:59.274 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:37:59.274 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:37:59.280 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:37:59.287 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:37:59.306 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:37:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:37:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:37:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:37:59.310 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:37:59.310 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:37:59.331 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:59.330+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:59.375 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:37:59.403 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:59.401+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:59.463 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:37:59.463 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:37:59.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:37:59.463 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:37:59.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.463 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18 4.33 e46/14 4:cf6d7a6c:::100000001f8.0000000a:head v 46'1, mlcod=0'0)", 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.257787438000001, 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012782457000000001, 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202652+0000", 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.202650+0000", 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206458+0000", 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003808016 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206470+0000", 2024-04-19T03:37:59.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2455e-05 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206495+0000", 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4888e-05 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206545+0000", 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9314000000000003e-05 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.206562+0000", 2024-04-19T03:37:59.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723e-05 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215395+0000", 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088321920000000009 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.215435+0000", 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0315999999999998e-05 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.144794048000001, 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.468 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:37:59.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:37:59.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:37:59.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:37:59.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:37:59.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:37:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 21.780978928, 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014462462000000001, 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 22 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679458+0000", 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683146+0000", 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036878869999999999 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683169+0000", 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2699000000000001e-05 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683183+0000", 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3684e-05 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683264+0000", 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1086000000000003e-05 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683369+0000", 2024-04-19T03:37:59.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105289 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683466+0000", 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7298000000000003e-05 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.689790+0000", 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063238010000000004 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:59.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693826+0000", 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040361140000000004 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693880+0000", 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3480999999999998e-05 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693923+0000", 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3612000000000002e-05 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:24 4.36 e47/14 4:6c9c34b1:::100000001f8.00000010:head v 47'2, mlcod=0'0)", 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 21.539761479999999, 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013771834, 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920678+0000", 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.920677+0000", 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924314+0000", 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036369900000000001 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924329+0000", 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4752e-05 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924356+0000", 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7506000000000001e-05 2024-04-19T03:37:59.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924405+0000", 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8495000000000002e-05 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.924431+0000", 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6678000000000001e-05 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934351+0000", 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.009920023 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.934450+0000", 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8826000000000006e-05 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.933345459999998, 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.484 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:37:59.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:37:59.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:37:59.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 20.446197449, 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015903805, 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014241+0000", 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018134+0000", 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038934180000000001 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018152+0000", 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8278e-05 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018163+0000", 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0647e-05 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018235+0000", 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2350999999999999e-05 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018354+0000", 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119178 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018459+0000", 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104245 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.023951+0000", 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054925169999999997 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030090+0000", 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061382679999999997 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030120+0000", 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0269000000000001e-05 2024-04-19T03:37:59.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030146+0000", 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6418999999999999e-05 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63 4.23 4:c6f90462:::100000001f8.00000037:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.978283691000001, 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014504006, 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.495 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482155+0000", 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485920+0000", 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037649519999999998 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485936+0000", 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6002999999999999e-05 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485949+0000", 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3227000000000001e-05 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486029+0000", 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0703000000000003e-05 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486131+0000", 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010152 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486226+0000", 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4858000000000006e-05 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.492383+0000", 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061568109999999999 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496591+0000", 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042080850000000003 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496626+0000", 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5040999999999999e-05 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496660+0000", 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4415999999999997e-05 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 16.865801526999999, 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013334689, 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.501 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594638+0000", 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.594637+0000", 2024-04-19T03:37:59.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598298+0000", 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036613980000000002 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598311+0000", 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2632999999999999e-05 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598318+0000", 2024-04-19T03:37:59.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9619999999999996e-06 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598391+0000", 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3206000000000003e-05 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598549+0000", 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015764899999999999 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:59.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.598713+0000", 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016429300000000001 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.605057+0000", 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063441469999999996 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607908+0000", 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028502739999999999 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607943+0000", 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4928000000000002e-05 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.607973+0000", 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0423e-05 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18239 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1728512~4096,write 1757184~4096,write 1802240~4096,write 1986560~4096,write 2007040~4096,write 2068480~4096,write 2097152~4096,write 2224128~4096,write 2367488~4096,write 2449408~4096,write 2498560~4096,write 2564096~4096,write 2744320~4096,write 2760704~4096,write 3362816~4096,write 3407872~4096,write 3424256~4096,write 3469312~4096,write 3493888~4096,write 3518464~4096,write 3612672~4096,write 3817472~4096,write 3874816~4096,write 3915776~4096,write 3973120~4096,write 3989504~4096,write 4046848~4096,write 4083712~4096,write 4104192~4096,write 4136960~4096,write 4169728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398134+0000", 2024-04-19T03:37:59.506 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.0623055749999999, 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011826674000000001, 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18239 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398134+0000", 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398134+0000", 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398133+0000", 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398248+0000", 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114899 2024-04-19T03:37:59.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398258+0000", 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6320000000000003e-06 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398265+0000", 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2180000000000002e-06 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398295+0000", 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0337000000000001e-05 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398361+0000", 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5103000000000003e-05 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.409774+0000", 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011413184 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.409864+0000", 2024-04-19T03:37:59.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0234000000000004e-05 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.409961+0000", 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6961999999999998e-05 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18241 4.37 4:eff9002a:::100000001f8.00000003:head [write 389120~4096,write 700416~4096,write 708608~4096,write 737280~4096,write 815104~4096,write 1024000~4096,write 1208320~4096,write 1228800~4096,write 1400832~4096,write 1671168~4096,write 1843200~4096,write 1929216~4096,write 2519040~4096,write 2654208~8192,write 2699264~4096,write 2752512~4096,write 2793472~4096,write 2859008~4096,write 3059712~4096,write 3313664~4096,write 3411968~4096,write 3493888~4096,write 3567616~4096,write 3710976~4096,write 3739648~4096,write 3813376~8192,write 3825664~4096,write 4026368~4096,write 4141056~4096,write 4161536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.061960375, 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014068550000000001, 2024-04-19T03:37:59.511 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18241 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:59.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398578+0000", 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398587+0000", 2024-04-19T03:37:59.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3880000000000006e-06 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398593+0000", 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5289999999999997e-06 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398644+0000", 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0773999999999999e-05 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398751+0000", 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000107086 2024-04-19T03:37:59.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399281+0000", 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052965 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.410466+0000", 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011184967000000001 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412447+0000", 2024-04-19T03:37:59.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019815000000000002 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412523+0000", 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5368000000000001e-05 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412548+0000", 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5239999999999999e-05 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.516 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18247 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 221184~4096,write 946176~4096,write 970752~4096,write 1142784~4096,write 1310720~4096,write 1839104~4096,write 2060288~4096,write 2093056~4096,write 2162688~4096,write 2179072~4096,write 2195456~4096,write 2240512~4096,write 2289664~4096,write 2334720~4096,write 2457600~4096,write 2510848~8192,write 2592768~4096,write 2621440~4096,write 2723840~4096,write 2912256~4096,write 2924544~4096,write 2977792~8192,write 3039232~4096,write 3088384~4096,write 3514368~4096,write 3563520~4096,write 3809280~4096,write 4022272~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.0614415450000001, 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01346782, 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18247 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398998+0000", 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399176+0000", 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017803799999999999 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399185+0000", 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399192+0000", 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4099999999999996e-06 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399340+0000", 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014863699999999999 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399455+0000", 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114925 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412354+0000", 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012898817 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412406+0000", 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2114999999999998e-05 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412466+0000", 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0098e-05 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18238 4.14 e51/14 4:2b28d75f:::100000001f8.00000016:head v 51'291, mlcod=51'289)", 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:59.521 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.0610025680000001, 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012607798999999999, 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399437+0000", 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399491+0000", 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4777000000000001e-05 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399501+0000", 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2969999999999992e-06 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399509+0000", 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8539999999999997e-06 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400010+0000", 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00050124399999999997 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400028+0000", 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7745999999999999e-05 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412014+0000", 2024-04-19T03:37:59.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011986254999999999 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412045+0000", 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1299e-05 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18242 4.6 e51/14 4:62d56fc8:::100000001f8.0000001c:head v 51'1114, mlcod=51'1112)", 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.0608504679999999, 2024-04-19T03:37:59.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012663195, 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399589+0000", 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399738+0000", 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014895899999999999 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399745+0000", 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4290000000000004e-06 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399751+0000", 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1e-06 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399790+0000", 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8863999999999999e-05 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399812+0000", 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1461e-05 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412239+0000", 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012427291 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412253+0000", 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3569e-05 2024-04-19T03:37:59.529 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:18245 4.36 e51/14 4:6fa85f86:::100000001f8.00000013:head v 51'853, mlcod=51'851)", 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.399764+0000", 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.060676215, 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012342689, 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399764+0000", 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399764+0000", 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399763+0000", 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399860+0000", 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7181000000000003e-05 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399869+0000", 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2810000000000008e-06 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399875+0000", 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5969999999999997e-06 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400144+0000", 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000268984 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.400163+0000", 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8839999999999999e-05 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412089+0000", 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011925382 2024-04-19T03:37:59.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412106+0000", 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7742999999999999e-05 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:23560 4.36 e52/14 4:6fa85f86:::100000001f8.00000013:head v 52'1113, mlcod=52'1110)", 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5367185670000003, 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014400698, 2024-04-19T03:37:59.534 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923737+0000", 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6252999999999998e-05 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923745+0000", 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6750000000000002e-06 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923751+0000", 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8300000000000001e-06 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923782+0000", 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1479999999999997e-05 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923800+0000", 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7887e-05 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.938093+0000", 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014293538 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.938122+0000", 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8493999999999999e-05 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.538 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:23728 4.38 4:1dcf718c:::100000001f8.00000022:head [write 749568~4096,write 757760~4096,write 839680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:54.992983+0000", 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.4674565130000001, 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012264565999999999, 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 23728 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992983+0000", 2024-04-19T03:37:59.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992983+0000", 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992982+0000", 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.992995+0000", 2024-04-19T03:37:59.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2716e-05 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993008+0000", 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2490999999999999e-05 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993015+0000", 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3590000000000002e-06 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993060+0000", 2024-04-19T03:37:59.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4703000000000002e-05 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.993113+0000", 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3032999999999999e-05 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:55.005122+0000", 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012009410999999999 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:55.005172+0000", 2024-04-19T03:37:59.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0222000000000001e-05 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:55.005248+0000", 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5536000000000003e-05 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:26992 4.37 4:eff9002a:::100000001f8.00000003:head [write 1896448~4096,write 1929216~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:56.470536+0000", 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.989904331, 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012277968, 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.543 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 26992 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470536+0000", 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470536+0000", 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470535+0000", 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470546+0000", 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1422e-05 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470556+0000", 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3130000000000004e-06 2024-04-19T03:37:59.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470561+0000", 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7389999999999996e-06 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470602+0000", 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0669e-05 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470681+0000", 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8478000000000003e-05 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.470815+0000", 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013403300000000001 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.480745+0000", 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099306780000000001 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.482712+0000", 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019663889999999998 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.482768+0000", 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6200999999999999e-05 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.482813+0000", 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5666e-05 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:27047 4.28 e53/14 4:153ae410:::100000001f8.0000003b:head v 53'873, mlcod=53'870)", 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:56.527388+0000", 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.9330518899999998, 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011849095, 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527388+0000", 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527388+0000", 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527387+0000", 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527400+0000", 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2771e-05 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527409+0000", 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8999999999999995e-06 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527415+0000", 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2519999999999996e-06 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527617+0000", 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00020220399999999999 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.527636+0000", 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8238999999999999e-05 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.539205+0000", 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011569472000000001 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.539237+0000", 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1872000000000002e-05 2024-04-19T03:37:59.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:27051 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3928064~4096,write 4001792~4096,write 4124672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:56.529717+0000", 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.9307232929999998, 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013161421, 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 27051 2024-04-19T03:37:59.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529717+0000", 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529717+0000", 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529715+0000", 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529728+0000", 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2839e-05 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529740+0000", 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1634000000000001e-05 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529748+0000", 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6760000000000007e-06 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529801+0000", 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3436000000000001e-05 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.529899+0000", 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7701000000000005e-05 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.542810+0000", 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012911677 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.542838+0000", 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7631e-05 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.542878+0000", 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9891999999999997e-05 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.557 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:27796 4.28 e53/14 4:15eeb89b:::100000001f8.00000032:head v 53'902, mlcod=53'899)", 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:56.872101+0000", 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 2.5883386489999998, 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011963517, 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.872101+0000", 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.872101+0000", 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.872101+0000", 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.872111+0000", 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0215e-05 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.872117+0000", 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1550000000000004e-06 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.872122+0000", 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3909999999999997e-06 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.872183+0000", 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1037000000000005e-05 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:37:59.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.872197+0000", 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3423e-05 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.884030+0000", 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011832957 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:56.884065+0000", 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4848000000000002e-05 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.561 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:37:59.562 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:37:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:37:59.563 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:59.562+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:59.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:37:59.664 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:37:59.663+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:34047 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1224704~4096 in=4096b,write 1380352~4096 in=4096b,write 1396736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.752528+0000", 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001617638, 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016487699999999999, 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:59.755 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34047 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752528+0000", 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752528+0000", 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:59.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752527+0000", 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752551+0000", 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3784000000000001e-05 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752561+0000", 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0584999999999999e-05 2024-04-19T03:37:59.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752566+0000", 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8180000000000003e-06 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752618+0000", 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1739e-05 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:59.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752701+0000", 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3435000000000003e-05 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752824+0000", 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122421 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:34048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 3244032~4096 in=4096b,write 3383296~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.752889+0000", 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0012557040000000001, 2024-04-19T03:37:59.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001390294, 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34048 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752889+0000", 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752889+0000", 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752889+0000", 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752902+0000", 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3314e-05 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:59.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752918+0000", 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5858999999999998e-05 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752927+0000", 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2299999999999997e-06 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.752978+0000", 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0683000000000002e-05 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753084+0000", 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106673 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753247+0000", 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000162268 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:34050 4.19 4:997b7129:::100000001f8.00000000:head [write 2252800~4096 in=4096b,write 2396160~4096 in=4096b,write 2449408~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.753694+0000", 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00045110700000000002, 2024-04-19T03:37:59.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068997700000000004, 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34050 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753694+0000", 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753694+0000", 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753693+0000", 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753709+0000", 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5466000000000001e-05 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753718+0000", 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.183e-06 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753726+0000", 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0160000000000008e-06 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.754250+0000", 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052408700000000001 2024-04-19T03:37:59.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.754328+0000", 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7610999999999999e-05 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:34049 4.12 e54/14 4:48ab9bde:::100000001f8.00000015:head v 54'1079, mlcod=54'1077)", 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.753748+0000", 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00039754800000000001, 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072281799999999996, 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:37:59.767 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753748+0000", 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753748+0000", 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753747+0000", 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753758+0000", 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.048e-05 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753765+0000", 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6869999999999994e-06 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753770+0000", 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0540000000000002e-06 2024-04-19T03:37:59.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753811+0000", 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0414999999999998e-05 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.753824+0000", 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2736e-05 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:37:59.770 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:37:59.771 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 4 2024-04-19T03:37:59.771 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:37:59.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:37:59.772 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:59.770+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:59.873 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:59.871+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:37:59.974 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:37:59.973+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:00.009 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:00.009 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:00.009 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:00.009 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:00.009 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:00.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:00.108 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:00.107+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:00.176 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:00.175+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:00.276 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:00.276 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:00.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:00.276 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.408374635, 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:38:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:38:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.408329841, 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:38:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:38:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.408274246, 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:38:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.408233908, 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:38:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:38:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:38:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.408203915, 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:38:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:38:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:38:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.40817419, 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:38:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.408133635, 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:38:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:38:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:38:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.408111014, 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:38:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.40808262, 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.075999434, 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:38:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:38:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:38:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:38:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.357601033000002, 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:38:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:38:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33745 4.2f e54/14 4:f59f865b:::100000001f8.00000007:head v 54'521, mlcod=54'519)", 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.66078462000000004, 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019385056000000001, 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612973+0000", 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612994+0000", 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1166e-05 2024-04-19T03:38:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613006+0000", 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1664e-05 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613013+0000", 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5460000000000003e-06 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613053+0000", 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9323999999999998e-05 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613086+0000", 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3154999999999997e-05 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632322+0000", 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019235851000000002 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632359+0000", 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7253999999999999e-05 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33772 4.f e54/14 4:f0d983b2:::100000001f8.0000001f:head v 54'1585, mlcod=54'1581)", 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.64923440099999996, 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018422488000000001, 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624550+0000", 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6625999999999999e-05 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624563+0000", 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3021e-05 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624572+0000", 2024-04-19T03:38:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5660000000000007e-06 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.631481+0000", 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069090239999999997 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.631501+0000", 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0021999999999999e-05 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.642910+0000", 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011408882 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.642947+0000", 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6826000000000003e-05 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33778 4.f e54/14 4:f2a80dfe:::100000001f8.00000019:head v 54'1586, mlcod=54'1581)", 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.64581825199999998, 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020237682, 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627956+0000", 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5948e-05 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627965+0000", 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8769999999999999e-06 2024-04-19T03:38:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627972+0000", 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2180000000000002e-06 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632926+0000", 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049541020000000002 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632946+0000", 2024-04-19T03:38:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.018e-05 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648147+0000", 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015201147 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648178+0000", 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0605999999999998e-05 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33783 4.f e54/14 4:f0d983b2:::100000001f8.0000001f:head v 54'1587, mlcod=54'1581)", 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.64489643799999996, 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020230292, 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628861+0000", 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628879+0000", 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7634000000000001e-05 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628895+0000", 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5772000000000001e-05 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628903+0000", 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1349999999999992e-06 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637680+0000", 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087774389999999997 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637702+0000", 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1875e-05 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.649055+0000", 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011352322999999999 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.649092+0000", 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7883000000000003e-05 2024-04-19T03:38:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33786 4.2f e54/14 4:f59f865b:::100000001f8.00000007:head v 54'527, mlcod=54'519)", 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.64388105699999998, 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018336394999999998, 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629891+0000", 2024-04-19T03:38:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4535000000000001e-05 2024-04-19T03:38:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629904+0000", 2024-04-19T03:38:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2635e-05 2024-04-19T03:38:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629911+0000", 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8809999999999998e-06 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637675+0000", 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0077639689999999999 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637700+0000", 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5157e-05 2024-04-19T03:38:00.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648183+0000", 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010482784 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648214+0000", 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1121000000000002e-05 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33911 4.25 4:a76ff001:::100000001f8.0000002b:head [write 2875392~4096,write 2887680~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.58431020700000003, 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018443491999999999, 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33911 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689447+0000", 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689462+0000", 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4154999999999999e-05 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689471+0000", 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7739999999999999e-06 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689476+0000", 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0030000000000002e-06 2024-04-19T03:38:00.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697594+0000", 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081173210000000003 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697685+0000", 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1323999999999995e-05 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707759+0000", 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010073985000000001 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707808+0000", 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8831000000000001e-05 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707892+0000", 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3929000000000002e-05 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33912 4.25 4:a76ff001:::100000001f8.0000002b:head [write 3411968~4096,write 3551232~4096,write 3657728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:00.368 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.58397767499999997, 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018238806, 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33912 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689780+0000", 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689798+0000", 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8419000000000001e-05 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689808+0000", 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0168e-05 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689816+0000", 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.699567+0000", 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0097506740000000008 2024-04-19T03:38:00.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.699662+0000", 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5223999999999995e-05 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707900+0000", 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0082382059999999997 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707945+0000", 2024-04-19T03:38:00.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4422000000000003e-05 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.708020+0000", 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5119999999999999e-05 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33922 4.e 4:73e84e43:::100000001f8.00000004:head [write 315392~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.57929021599999997, 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018561412999999999, 2024-04-19T03:38:00.373 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33922 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694467+0000", 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694479+0000", 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.168e-05 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694490+0000", 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-05 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694496+0000", 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7219999999999996e-06 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694534+0000", 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7960999999999998e-05 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694593+0000", 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9453999999999997e-05 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.712881+0000", 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018287570999999999 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.712937+0000", 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6462999999999998e-05 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713030+0000", 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.268e-05 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33925 4.36 4:6fa85f86:::100000001f8.00000013:head [write 4096000~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.695539+0000", 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.57821906099999998, 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017643058999999999, 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:00.378 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33925 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695539+0000", 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:00.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695539+0000", 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695539+0000", 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695548+0000", 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2499999999999995e-06 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695558+0000", 2024-04-19T03:38:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.73e-06 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695564+0000", 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5980000000000002e-06 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697712+0000", 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002148091 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697827+0000", 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011462 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697989+0000", 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016169200000000001 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707729+0000", 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0097398129999999999 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713095+0000", 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053669820000000002 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713145+0000", 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9026000000000001e-05 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713183+0000", 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8022000000000003e-05 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:00.384 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:00.384 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:00.385 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:00.386 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:00.384+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:00.486 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:00.485+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:00.545 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:00.545 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:00.545 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:38:00.545 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:00.555 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:00.597 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:00.596+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:00.687 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:00.686+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:00.764 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:00.764 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:00.764 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:00.778 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:00.788 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:00.787+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:00.889 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:00.888+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:00.945 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:00.945 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:00.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:00.945 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:00.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.945 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.626826673, 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015370770000000001, 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 19 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315646+0000", 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.315643+0000", 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319446+0000", 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038021690000000002 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319469+0000", 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3008000000000001e-05 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319488+0000", 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712e-05 2024-04-19T03:38:00.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319540+0000", 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1468000000000003e-05 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319657+0000", 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117427 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.319756+0000", 2024-04-19T03:38:00.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.326886+0000", 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071304230000000003 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330932+0000", 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040456329999999999 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.330974+0000", 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2524999999999997e-05 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.331017+0000", 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2224000000000001e-05 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.263011552999998, 2024-04-19T03:38:00.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014462462000000001, 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 22 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679461+0000", 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.679458+0000", 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683146+0000", 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036878869999999999 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683169+0000", 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2699000000000001e-05 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683183+0000", 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3684e-05 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683264+0000", 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1086000000000003e-05 2024-04-19T03:38:00.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683369+0000", 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000105289 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.683466+0000", 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7298000000000003e-05 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.689790+0000", 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063238010000000004 2024-04-19T03:38:00.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693826+0000", 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040361140000000004 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693880+0000", 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3480999999999998e-05 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:37.693923+0000", 2024-04-19T03:38:00.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3612000000000002e-05 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.415378085, 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:00.957 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:38:00.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:38:00.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:38:00.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:00.962 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 21.928230073999998, 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015903805, 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014241+0000", 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018134+0000", 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038934180000000001 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018152+0000", 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8278e-05 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018163+0000", 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0647e-05 2024-04-19T03:38:00.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018235+0000", 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2350999999999999e-05 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018354+0000", 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119178 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018459+0000", 2024-04-19T03:38:00.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104245 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.023951+0000", 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054925169999999997 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030090+0000", 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061382679999999997 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:00.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030120+0000", 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0269000000000001e-05 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030146+0000", 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6418999999999999e-05 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63 4.23 4:c6f90462:::100000001f8.00000037:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:38:00.968 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.460316316, 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014504006, 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482156+0000", 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.482155+0000", 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485920+0000", 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037649519999999998 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485936+0000", 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6002999999999999e-05 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.485949+0000", 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3227000000000001e-05 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486029+0000", 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0703000000000003e-05 2024-04-19T03:38:00.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486131+0000", 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010152 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.486226+0000", 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4858000000000006e-05 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.492383+0000", 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061568109999999999 2024-04-19T03:38:00.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496591+0000", 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042080850000000003 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496626+0000", 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5040999999999999e-05 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:42.496660+0000", 2024-04-19T03:38:00.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4415999999999997e-05 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:18241 4.37 4:eff9002a:::100000001f8.00000003:head [write 389120~4096,write 700416~4096,write 708608~4096,write 737280~4096,write 815104~4096,write 1024000~4096,write 1208320~4096,write 1228800~4096,write 1400832~4096,write 1671168~4096,write 1843200~4096,write 1929216~4096,write 2519040~4096,write 2654208~8192,write 2699264~4096,write 2752512~4096,write 2793472~4096,write 2859008~4096,write 3059712~4096,write 3313664~4096,write 3411968~4096,write 3493888~4096,write 3567616~4096,write 3710976~4096,write 3739648~4096,write 3813376~8192,write 3825664~4096,write 4026368~4096,write 4141056~4096,write 4161536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.5439930000000004, 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014068550000000001, 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:00.974 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 18241 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398479+0000", 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398578+0000", 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8537999999999997e-05 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398587+0000", 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3880000000000006e-06 2024-04-19T03:38:00.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398593+0000", 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5289999999999997e-06 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398644+0000", 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0773999999999999e-05 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.398751+0000", 2024-04-19T03:38:00.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000107086 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.399281+0000", 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00052965 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.410466+0000", 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011184967000000001 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:00.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412447+0000", 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019815000000000002 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412523+0000", 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5368000000000001e-05 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:52.412548+0000", 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5239999999999999e-05 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:23560 4.36 e52/14 4:6fa85f86:::100000001f8.00000013:head v 52'1113, mlcod=52'1110)", 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 6.0187511919999999, 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014400698, 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923721+0000", 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923737+0000", 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6252999999999998e-05 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923745+0000", 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6750000000000002e-06 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923751+0000", 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8300000000000001e-06 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923782+0000", 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1479999999999997e-05 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.923800+0000", 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7887e-05 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.938093+0000", 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014293538 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:54.938122+0000", 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8493999999999999e-05 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33743 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 3035136~4096,write 3145728~4096,write 3153920~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.611827+0000", 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.330645955, 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017796493, 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.984 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33743 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611827+0000", 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611827+0000", 2024-04-19T03:38:00.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611826+0000", 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611840+0000", 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3961000000000001e-05 2024-04-19T03:38:00.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611850+0000", 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0487e-05 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611857+0000", 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9589999999999998e-06 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611890+0000", 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2968e-05 2024-04-19T03:38:00.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611936+0000", 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5837999999999997e-05 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612029+0000", 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3247999999999999e-05 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.614070+0000", 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020405229999999998 2024-04-19T03:38:00.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629573+0000", 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01550375 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629603+0000", 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9816e-05 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629623+0000", 2024-04-19T03:38:00.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712999999999999e-05 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33745 4.2f 4:f59f865b:::100000001f8.00000007:head [write 2875392~4096,write 2953216~4096,write 3006464~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.612639+0000", 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3298339109999999, 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020503627, 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.990 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33745 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612639+0000", 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612639+0000", 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612638+0000", 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612662+0000", 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4391000000000001e-05 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612672+0000", 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7820000000000005e-06 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612679+0000", 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2960000000000001e-06 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612719+0000", 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9684999999999997e-05 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612805+0000", 2024-04-19T03:38:00.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5465999999999998e-05 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612919+0000", 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114447 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.614251+0000", 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001331905 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633059+0000", 2024-04-19T03:38:00.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018807866999999999 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633105+0000", 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6071e-05 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633142+0000", 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7372000000000001e-05 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33753 4.2f 4:f59f865b:::100000001f8.00000007:head [write 901120~4096,write 962560~4096,write 1011712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.616511+0000", 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3259614310000001, 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016906207999999999, 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33753 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616511+0000", 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616511+0000", 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616510+0000", 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616520+0000", 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7780000000000002e-06 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616527+0000", 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1949999999999997e-06 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616532+0000", 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:38:00.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616568+0000", 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5859999999999999e-05 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616644+0000", 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5467000000000001e-05 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:00.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616732+0000", 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8718e-05 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.622933+0000", 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062004720000000003 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633331+0000", 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010397824 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633381+0000", 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0523999999999999e-05 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633417+0000", 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5966000000000001e-05 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33760 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3784704~4096,write 4005888~4096,write 4157440~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.619441+0000", 2024-04-19T03:38:01.001 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3230311750000001, 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014100727, 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33760 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.619441+0000", 2024-04-19T03:38:01.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.619441+0000", 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.619440+0000", 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.619452+0000", 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1596e-05 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.619464+0000", 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2371999999999999e-05 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.619472+0000", 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2960000000000001e-06 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.619512+0000", 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.019e-05 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.619596+0000", 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4002e-05 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.619766+0000", 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016979399999999999 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.627829+0000", 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0080632359999999997 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633463+0000", 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056344430000000003 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633507+0000", 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3572999999999998e-05 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633542+0000", 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5150000000000001e-05 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33763 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3051520~4096,write 3096576~4096,write 3137536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.620664+0000", 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3218083599999999, 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017334680000000002, 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.007 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33763 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620664+0000", 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620664+0000", 2024-04-19T03:38:01.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620663+0000", 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620673+0000", 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7569999999999999e-06 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620683+0000", 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4700000000000008e-06 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620688+0000", 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.699e-06 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621114+0000", 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042590500000000002 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621163+0000", 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8511999999999999e-05 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621248+0000", 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5449000000000001e-05 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629529+0000", 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082813409999999994 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.637929+0000", 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083999160000000003 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.637977+0000", 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7239e-05 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.637999+0000", 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2218e-05 2024-04-19T03:38:01.012 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33765 4.2f 4:f59f865b:::100000001f8.00000007:head [write 2183168~4096,write 2490368~4096,write 2617344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.621676+0000", 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.320796963, 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017542383000000002, 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33765 2024-04-19T03:38:01.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621676+0000", 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621676+0000", 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621675+0000", 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621711+0000", 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5849999999999997e-05 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621720+0000", 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3659999999999998e-06 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621727+0000", 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9129999999999997e-06 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.622211+0000", 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048410100000000002 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.622293+0000", 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2229000000000002e-05 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.622454+0000", 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000160531 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.630626+0000", 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081728089999999996 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.639141+0000", 2024-04-19T03:38:01.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085148859999999993 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.639176+0000", 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4845999999999998e-05 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.639218+0000", 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1712000000000003e-05 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33772 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 184320~4096,write 225280~4096,write 245760~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.624254+0000", 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3182180059999999, 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018875833000000002, 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33772 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624254+0000", 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624254+0000", 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624254+0000", 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624270+0000", 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5874000000000001e-05 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624280+0000", 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0648e-05 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624289+0000", 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624320+0000", 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1717000000000001e-05 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624377+0000", 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6298999999999997e-05 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624466+0000", 2024-04-19T03:38:01.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9155999999999998e-05 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.630848+0000", 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006382258 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.643069+0000", 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012221334 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.643108+0000", 2024-04-19T03:38:01.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8896000000000002e-05 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.643130+0000", 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.211e-05 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33777 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1024000~4096,write 1060864~4096,write 1118208~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.625861+0000", 2024-04-19T03:38:01.024 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3166118760000001, 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018502819, 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33777 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625861+0000", 2024-04-19T03:38:01.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625861+0000", 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625860+0000", 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625879+0000", 2024-04-19T03:38:01.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9562e-05 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625888+0000", 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1440000000000003e-06 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625893+0000", 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625931+0000", 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8748999999999998e-05 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626020+0000", 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8623999999999997e-05 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626171+0000", 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000150867 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.630920+0000", 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047488620000000004 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.644283+0000", 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01336353 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.644327+0000", 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3874e-05 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.644363+0000", 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6223000000000002e-05 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33778 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 1548288~4096,write 1568768~4096,write 1581056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.626171+0000", 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3163017349999999, 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022168922000000001, 2024-04-19T03:38:01.030 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33778 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626171+0000", 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626171+0000", 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626170+0000", 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626185+0000", 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4409e-05 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626190+0000", 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626193+0000", 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5030000000000002e-06 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.627432+0000", 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012388060000000001 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.627516+0000", 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4321999999999997e-05 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.627642+0000", 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012542299999999999 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633685+0000", 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060429439999999997 2024-04-19T03:38:01.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648290+0000", 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01460552 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648319+0000", 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.864e-05 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648340+0000", 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0863999999999999e-05 2024-04-19T03:38:01.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33783 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3923968~4096,write 3932160~4096,write 3993600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.628272+0000", 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3142001800000001, 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021013490999999999, 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.036 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33783 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628272+0000", 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628272+0000", 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628271+0000", 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628284+0000", 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.289e-05 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628296+0000", 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1657999999999999e-05 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628304+0000", 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8909999999999995e-06 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628613+0000", 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030874899999999998 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628711+0000", 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8858999999999997e-05 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628800+0000", 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8972000000000001e-05 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633786+0000", 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004985237 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.649222+0000", 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015436322000000001 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.649250+0000", 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8039e-05 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.649286+0000", 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5728000000000001e-05 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.041 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33786 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1429504~4096,write 1495040~4096,write 1597440~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.629404+0000", 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.3130688909999999, 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019008206999999999, 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33786 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629404+0000", 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629404+0000", 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629403+0000", 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629422+0000", 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9575000000000001e-05 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629431+0000", 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6889999999999993e-06 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629439+0000", 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3459999999999994e-06 2024-04-19T03:38:01.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629561+0000", 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012194200000000001 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629639+0000", 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7365000000000002e-05 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629812+0000", 2024-04-19T03:38:01.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173711 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633864+0000", 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040513260000000001 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648337+0000", 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014473587 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648380+0000", 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2469000000000003e-05 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648412+0000", 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1918999999999997e-05 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33921 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 2244608~4096,write 2273280~4096,write 2330624~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.693830+0000", 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 1.2486420229999999, 2024-04-19T03:38:01.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014404401000000001, 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33921 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.693830+0000", 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.693830+0000", 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.693827+0000", 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.693844+0000", 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7254000000000001e-05 2024-04-19T03:38:01.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.693851+0000", 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.409e-06 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.693855+0000", 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0749999999999999e-06 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.693890+0000", 2024-04-19T03:38:01.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5574999999999997e-05 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.693981+0000", 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0848999999999997e-05 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.694135+0000", 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153261 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.701464+0000", 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007329754 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.708151+0000", 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066869210000000002 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.708199+0000", 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8018e-05 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.708235+0000", 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5583999999999997e-05 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:36447 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 143360~4096,write 241664~4096,write 311296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:00.923302+0000", 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019170693999999999, 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015695082999999999, 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 36447 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.923302+0000", 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.923302+0000", 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.923301+0000", 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.923311+0000", 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7440000000000002e-06 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.923320+0000", 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1239999999999994e-06 2024-04-19T03:38:01.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.923328+0000", 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5700000000000004e-06 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.923361+0000", 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3942999999999997e-05 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.923447+0000", 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5935999999999998e-05 2024-04-19T03:38:01.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.923581+0000", 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013393500000000001 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.925084+0000", 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001502986 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.938911+0000", 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013826468999999999 2024-04-19T03:38:01.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.938960+0000", 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8959999999999999e-05 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:00.938997+0000", 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7135999999999998e-05 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:01.058 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:01.059 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:01.060 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:01.061 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:01.058+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:01.161 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:01.160+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:37169 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 348160~4096 in=4096b,write 532480~4096 in=4096b,write 585728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.251626+0000", 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.007560939, 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075965779999999997, 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:01.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 37169 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.251626+0000", 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.251626+0000", 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.251625+0000", 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.251639+0000", 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4235e-05 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.251649+0000", 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0234999999999999e-05 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.251657+0000", 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8480000000000001e-06 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.252219+0000", 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056191399999999995 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.252305+0000", 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5790000000000004e-05 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.252500+0000", 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019544399999999999 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.253992+0000", 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014915169999999999 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.265 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:37177 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3112960~4096 in=4096b,write 3153920~4096 in=4096b,write 3346432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.254314+0000", 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0048722119999999999, 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050400319999999998, 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 37177 2024-04-19T03:38:01.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.254314+0000", 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.254314+0000", 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.254314+0000", 2024-04-19T03:38:01.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.254383+0000", 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9450999999999996e-05 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.254391+0000", 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2360000000000004e-06 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.254396+0000", 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4220000000000002e-06 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.254443+0000", 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7457000000000003e-05 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.254521+0000", 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8152000000000007e-05 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:01.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.254669+0000", 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014794499999999999 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.256620+0000", 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019511179999999999 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:37181 4.6 4:63e80496:::100000001f8.0000001e:head [write 2846720~4096 in=4096b,write 3018752~4096 in=4096b,write 3043328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.255694+0000", 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0034930550000000001, 2024-04-19T03:38:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037923750000000002, 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 37181 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.255694+0000", 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.255694+0000", 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.255693+0000", 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.255707+0000", 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.403e-05 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.255716+0000", 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6509999999999996e-06 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.255724+0000", 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7840000000000004e-06 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.255777+0000", 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2779999999999999e-05 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.255826+0000", 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9295999999999997e-05 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.255916+0000", 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0137999999999997e-05 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259000+0000", 2024-04-19T03:38:01.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030839690000000002 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:37183 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2412544~4096 in=4096b,write 2650112~4096 in=4096b,write 2703360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.256765+0000", 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0024220560000000001, 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00284856, 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.275 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 37183 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.256765+0000", 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.256765+0000", 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.256764+0000", 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.256776+0000", 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2651e-05 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.256787+0000", 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0701e-05 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.256793+0000", 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8050000000000003e-06 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.256852+0000", 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9250999999999999e-05 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.256935+0000", 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2632000000000004e-05 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257100+0000", 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016555000000000001 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259288+0000", 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00218747 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:37184 4.28 4:153ae410:::100000001f8.0000003b:head [write 167936~4096 in=4096b,write 294912~4096 in=4096b,write 516096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.279 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.257200+0000", 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0019863760000000002, 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025186589999999999, 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 37184 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257200+0000", 2024-04-19T03:38:01.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257200+0000", 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257200+0000", 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257211+0000", 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1654000000000001e-05 2024-04-19T03:38:01.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257219+0000", 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0350000000000001e-06 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257224+0000", 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.967e-06 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257254+0000", 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0275999999999999e-05 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257312+0000", 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7669e-05 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257409+0000", 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6751999999999998e-05 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258817+0000", 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014080200000000001 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:37185 4.6 4:616d4c41:::100000001f8.00000034:head [write 3645440~4096 in=4096b,write 3878912~4096 in=4096b,write 3960832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.257591+0000", 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001596084, 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022290769999999999, 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.284 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 37185 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257591+0000", 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257591+0000", 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257590+0000", 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257604+0000", 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4106e-05 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257614+0000", 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0648e-05 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257622+0000", 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6850000000000001e-06 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257658+0000", 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5957999999999997e-05 2024-04-19T03:38:01.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257712+0000", 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4234999999999998e-05 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.257815+0000", 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010304799999999999 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:37187 4.23 e54/14 4:c6f90462:::100000001f8.00000037:head v 54'590, mlcod=54'588)", 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.258658+0000", 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.000528562, 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012641569999999999, 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258658+0000", 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258658+0000", 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258657+0000", 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258672+0000", 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4978e-05 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258683+0000", 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0890000000000001e-05 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258688+0000", 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1030000000000001e-06 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258731+0000", 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2283999999999997e-05 2024-04-19T03:38:01.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258756+0000", 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5145999999999999e-05 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:37189 4.15 4:aada5e43:::100000001f8.00000028:head [write 2752512~4096 in=4096b,write 2777088~4096 in=4096b,write 2977792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.258886+0000", 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00030021399999999998, 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011161999999999999, 2024-04-19T03:38:01.292 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 37189 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258886+0000", 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258886+0000", 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258886+0000", 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258897+0000", 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1452e-05 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258914+0000", 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7348000000000001e-05 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258921+0000", 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1759999999999998e-06 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.258962+0000", 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1612000000000001e-05 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259054+0000", 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2194000000000005e-05 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259212+0000", 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000157696 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:37188 4.2d e54/14 4:b7099a35:::100000001f8.0000000e:head v 54'1133, mlcod=54'1131)", 2024-04-19T03:38:01.296 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.259001+0000", 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00018595300000000001, 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001094364, 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259001+0000", 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259001+0000", 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259000+0000", 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259030+0000", 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9748999999999999e-05 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259040+0000", 2024-04-19T03:38:01.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0147e-05 2024-04-19T03:38:01.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259046+0000", 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4840000000000001e-06 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259080+0000", 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3393999999999999e-05 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259099+0000", 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9313e-05 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.302 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:37190 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 2129920~4096 in=4096b,write 2256896~4096 in=4096b,write 2367488~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:01.259252+0000", 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9999352, 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092367000000000002, 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 37190 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.303 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259252+0000", 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259252+0000", 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259251+0000", 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:01.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259264+0000", 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.365e-05 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259280+0000", 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5468000000000002e-05 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259287+0000", 2024-04-19T03:38:01.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2099999999999996e-06 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259324+0000", 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6687999999999998e-05 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259411+0000", 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7676000000000006e-05 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:01.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:01.259539+0000", 2024-04-19T03:38:01.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012747400000000001 2024-04-19T03:38:01.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.307 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:01.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:01.307 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:01.307 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 10 2024-04-19T03:38:01.307 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:01.308 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:01.307+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:01.309 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:01.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:01.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:38:01.409 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:01.408+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:01.511 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:01.509+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:01.523 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:01.550 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:01.551 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:01.556 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:01.556 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:01.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:01.611 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:01.610+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:01.712 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:01.712+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:01.807 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:01.807 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:01.813 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:01.812+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:01.825 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:01.914 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:01.913+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:02.001 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:02.002 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:02.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:02.016 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:02.013+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:02.116 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:02.114+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:02.184 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:02.198 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:02.216 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:02.215+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:02.318 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:02.316+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:02.368 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:02.368 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:02.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:02.387 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:38:02.418 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:02.418+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:02.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~93s 2024-04-19T03:38:02.520 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:02.519+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:02.581 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:02.581 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:02.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:02.620 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:02.619+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:02.722 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:02.721+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:02.792 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:02.792 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:02.809 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:02.823 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:02.822+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:02.923 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:02.923+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:03.016 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:03.016 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:03.025 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:03.024+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:03.033 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:03.125 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:03.125+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:03.205 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:03.205 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:03.219 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:03.261 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:03.260+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:03.327 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:03.326+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:03.428 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:03.427+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:03.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:03.530 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:03.529+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:03.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:03.631 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:03.630+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:03.640 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:03.640 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:03.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:03.732 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:03.731+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:03.755 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:03.780 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:03.780 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:03.780 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:03.780 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:03.784 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:03.784 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:03.833 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:03.832+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:03.867 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:42689 4.36 4:6da220e6:::100000001f8.0000003f:head [write 4096~4096 in=4096b,write 69632~4096 in=4096b,write 90112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:03.860297+0000", 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0059691040000000002, 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060086990000000002, 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:03.868 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 42689 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860297+0000", 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860297+0000", 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860296+0000", 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860319+0000", 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3342000000000001e-05 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860331+0000", 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2213e-05 2024-04-19T03:38:03.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860343+0000", 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2119e-05 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.863334+0000", 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002990875 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.863432+0000", 2024-04-19T03:38:03.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7769999999999994e-05 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.863587+0000", 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015547 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:42691 4.e 4:73e84e43:::100000001f8.00000004:head [write 1245184~4096 in=4096b,write 1478656~4096 in=4096b,write 1486848~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:03.860924+0000", 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0053420480000000003, 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00549761, 2024-04-19T03:38:03.872 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 42691 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860924+0000", 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860924+0000", 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860923+0000", 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860933+0000", 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0193999999999999e-05 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860942+0000", 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3170000000000008e-06 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860948+0000", 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7470000000000002e-06 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.863309+0000", 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023610100000000002 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.863412+0000", 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102761 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:42694 4.6 4:63e80496:::100000001f8.0000001e:head [write 1847296~4096 in=4096b,write 1867776~4096 in=4096b,write 1880064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:03.861988+0000", 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0042773489999999997, 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045278669999999997, 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:03.876 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 42694 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.861988+0000", 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.861988+0000", 2024-04-19T03:38:03.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.861987+0000", 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.862002+0000", 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4541e-05 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.862014+0000", 2024-04-19T03:38:03.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.187e-05 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.862025+0000", 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1009000000000001e-05 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864580+0000", 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025554979999999998 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864632+0000", 2024-04-19T03:38:03.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1530000000000003e-05 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864757+0000", 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012554100000000001 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:42700 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1421312~4096 in=4096b,write 1638400~4096 in=4096b,write 1933312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:03.864416+0000", 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0018498709999999999, 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002216876, 2024-04-19T03:38:03.880 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 42700 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864416+0000", 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:03.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864416+0000", 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864415+0000", 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864429+0000", 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3869000000000001e-05 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864440+0000", 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1147e-05 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864449+0000", 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4190000000000008e-06 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865257+0000", 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000807889 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865368+0000", 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011055 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865513+0000", 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014512499999999999 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:42701 4.14 4:2b28d75f:::100000001f8.00000016:head [write 827392~4096 in=4096b,write 1183744~4096 in=4096b,write 1191936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:03.884 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:03.864714+0000", 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0015520530000000001, 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020204720000000002, 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 42701 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864714+0000", 2024-04-19T03:38:03.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864714+0000", 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864713+0000", 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864726+0000", 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3664e-05 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864739+0000", 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3111e-05 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864747+0000", 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6320000000000008e-06 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864785+0000", 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7747999999999998e-05 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.864870+0000", 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5322999999999996e-05 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865029+0000", 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158596 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866459+0000", 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014302200000000001 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:42702 4.6 4:63e80496:::100000001f8.0000001e:head [write 49152~4096 in=4096b,write 253952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:03.865070+0000", 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001195892, 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001767692, 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:03.889 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 42702 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865070+0000", 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:03.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865070+0000", 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865069+0000", 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865085+0000", 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6456e-05 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865097+0000", 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2162e-05 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865106+0000", 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1259999999999998e-06 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866360+0000", 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001254483 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866442+0000", 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2081000000000002e-05 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866559+0000", 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116344 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.893 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:42703 4.12 e55/14 4:4be51a30:::100000001f8.0000000b:head v 55'1346, mlcod=55'1344)", 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:03.865928+0000", 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.000337523, 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010018850000000001, 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865928+0000", 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865928+0000", 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865927+0000", 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865943+0000", 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5639999999999999e-05 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865953+0000", 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9450000000000005e-06 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865960+0000", 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6789999999999999e-06 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.865998+0000", 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8321000000000001e-05 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:03.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866021+0000", 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3091e-05 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:42704 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:03.866115+0000", 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.000151166, 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089347199999999997, 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:03.897 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 42704 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866115+0000", 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866115+0000", 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866113+0000", 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866130+0000", 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6551000000000001e-05 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866143+0000", 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.287e-05 2024-04-19T03:38:03.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.866153+0000", 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6399999999999992e-06 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:42688 4.36 4:6fa85f86:::100000001f8.00000013:head [write 4096~4096 in=4096b,write 634880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:03.860070+0000", 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0061957080000000003, 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070121690000000004, 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 42688 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860070+0000", 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860070+0000", 2024-04-19T03:38:03.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860069+0000", 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860079+0000", 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0266e-05 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860092+0000", 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2033e-05 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.860100+0000", 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0970000000000006e-06 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.861763+0000", 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016635339999999999 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.861878+0000", 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114782 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:03.862105+0000", 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000226639 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 9 2024-04-19T03:38:03.904 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:03.905 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:03.934 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:03.933+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:04.035 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:04.034+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:04.136 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:04.135+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:04.146 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:04.146 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:04.146 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:04.146 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:04.146 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:04.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:04.237 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:04.236+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:04.338 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:04.337+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.495382687, 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:38:04.364 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:38:04.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:38:04.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:04.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:04.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:04.373 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.495337893, 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:04.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:38:04.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.379 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.49528229800001, 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:38:04.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:04.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:04.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:04.385 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.49524196, 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:38:04.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:38:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:38:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:38:04.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:38:04.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.495211967, 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:38:04.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.495182242, 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:38:04.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:38:04.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.495141687, 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:38:04.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.409 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.495119066, 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:38:04.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:38:04.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:38:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.495090672, 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:38:04.414 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.418 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.163007486000001, 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:38:04.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:38:04.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:38:04.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:38:04.424 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.444609085, 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:38:04.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33745 4.2f e54/14 4:f59f865b:::100000001f8.00000007:head v 54'521, mlcod=54'519)", 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.7477926720000001, 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019385056000000001, 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612973+0000", 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612994+0000", 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1166e-05 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613006+0000", 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1664e-05 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613013+0000", 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5460000000000003e-06 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613053+0000", 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9323999999999998e-05 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613086+0000", 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3154999999999997e-05 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632322+0000", 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019235851000000002 2024-04-19T03:38:04.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632359+0000", 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7253999999999999e-05 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33772 4.f e54/14 4:f0d983b2:::100000001f8.0000001f:head v 54'1585, mlcod=54'1581)", 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.736242453, 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018422488000000001, 2024-04-19T03:38:04.434 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624550+0000", 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6625999999999999e-05 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624563+0000", 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3021e-05 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624572+0000", 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5660000000000007e-06 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.631481+0000", 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069090239999999997 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.631501+0000", 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0021999999999999e-05 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.642910+0000", 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011408882 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.642947+0000", 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6826000000000003e-05 2024-04-19T03:38:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33778 4.f e54/14 4:f2a80dfe:::100000001f8.00000019:head v 54'1586, mlcod=54'1581)", 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.7328263039999996, 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020237682, 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:04.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627956+0000", 2024-04-19T03:38:04.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5948e-05 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627965+0000", 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8769999999999999e-06 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627972+0000", 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2180000000000002e-06 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632926+0000", 2024-04-19T03:38:04.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049541020000000002 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632946+0000", 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.018e-05 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648147+0000", 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015201147 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648178+0000", 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0605999999999998e-05 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33783 4.f e54/14 4:f0d983b2:::100000001f8.0000001f:head v 54'1587, mlcod=54'1581)", 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.7319044899999998, 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020230292, 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628861+0000", 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628879+0000", 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7634000000000001e-05 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628895+0000", 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5772000000000001e-05 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628903+0000", 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1349999999999992e-06 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637680+0000", 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087774389999999997 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637702+0000", 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1875e-05 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.649055+0000", 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011352322999999999 2024-04-19T03:38:04.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.649092+0000", 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7883000000000003e-05 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33786 4.2f e54/14 4:f59f865b:::100000001f8.00000007:head v 54'527, mlcod=54'519)", 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.7308891089999996, 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018336394999999998, 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.447 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629891+0000", 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4535000000000001e-05 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629904+0000", 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2635e-05 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629911+0000", 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8809999999999998e-06 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637675+0000", 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0077639689999999999 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637700+0000", 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5157e-05 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648183+0000", 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010482784 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648214+0000", 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1121000000000002e-05 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.451 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33911 4.25 4:a76ff001:::100000001f8.0000002b:head [write 2875392~4096,write 2887680~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6713182589999995, 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018443491999999999, 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33911 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:04.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689447+0000", 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689462+0000", 2024-04-19T03:38:04.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4154999999999999e-05 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689471+0000", 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7739999999999999e-06 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689476+0000", 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0030000000000002e-06 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697594+0000", 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081173210000000003 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697685+0000", 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1323999999999995e-05 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707759+0000", 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010073985000000001 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707808+0000", 2024-04-19T03:38:04.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8831000000000001e-05 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707892+0000", 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3929000000000002e-05 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33912 4.25 4:a76ff001:::100000001f8.0000002b:head [write 3411968~4096,write 3551232~4096,write 3657728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6709857269999997, 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018238806, 2024-04-19T03:38:04.456 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33912 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689780+0000", 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689798+0000", 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8419000000000001e-05 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689808+0000", 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0168e-05 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689816+0000", 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.699567+0000", 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0097506740000000008 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.699662+0000", 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5223999999999995e-05 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707900+0000", 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0082382059999999997 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707945+0000", 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4422000000000003e-05 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.708020+0000", 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5119999999999999e-05 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33922 4.e 4:73e84e43:::100000001f8.00000004:head [write 315392~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6662982680000002, 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018561412999999999, 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33922 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694467+0000", 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694479+0000", 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.168e-05 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694490+0000", 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-05 2024-04-19T03:38:04.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694496+0000", 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7219999999999996e-06 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694534+0000", 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7960999999999998e-05 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694593+0000", 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9453999999999997e-05 2024-04-19T03:38:04.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.712881+0000", 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018287570999999999 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.712937+0000", 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6462999999999998e-05 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713030+0000", 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.268e-05 2024-04-19T03:38:04.465 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33925 4.36 4:6fa85f86:::100000001f8.00000013:head [write 4096000~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.695539+0000", 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6652271130000003, 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017643058999999999, 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:04.466 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33925 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695539+0000", 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695539+0000", 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695539+0000", 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695548+0000", 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2499999999999995e-06 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695558+0000", 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.73e-06 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.695564+0000", 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5980000000000002e-06 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697712+0000", 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002148091 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697827+0000", 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011462 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697989+0000", 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016169200000000001 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707729+0000", 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0097398129999999999 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713095+0000", 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053669820000000002 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713145+0000", 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9026000000000001e-05 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713183+0000", 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8022000000000003e-05 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:04.471 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:04.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:38:04.473 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:04.472+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:04.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:04.575 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:04.573+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:04.638 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:44268 4.6 e55/14 4:616d4c41:::100000001f8.00000034:head v 55'2748, mlcod=55'2746)", 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.637524+0000", 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00071582500000000001, 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00074063500000000001, 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637524+0000", 2024-04-19T03:38:04.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637524+0000", 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637523+0000", 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637539+0000", 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5364999999999999e-05 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637549+0000", 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0570999999999999e-05 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637557+0000", 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.588e-06 2024-04-19T03:38:04.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637595+0000", 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7719000000000003e-05 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637618+0000", 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3495000000000001e-05 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:44269 4.3f e55/14 4:fde182c5:::100000001f8.00000039:head v 55'680, mlcod=55'678)", 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.637994+0000", 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.000245496, 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034521200000000001, 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637994+0000", 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637994+0000", 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.637994+0000", 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638009+0000", 2024-04-19T03:38:04.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5218000000000001e-05 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638016+0000", 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7190000000000004e-06 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638021+0000", 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9910000000000002e-06 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638048+0000", 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7540999999999999e-05 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638071+0000", 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:44271 4.2c 4:36128e15:::100000001f8.00000008:head [write 3842048~4096 in=4096b,write 3850240~4096 in=4096b,write 4026368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:04.646 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.638268+0000", 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9999719, 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011401, 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 44271 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638268+0000", 2024-04-19T03:38:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638268+0000", 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638267+0000", 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638278+0000", 2024-04-19T03:38:04.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1127e-05 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638287+0000", 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9889999999999998e-06 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638293+0000", 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6069999999999998e-06 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638326+0000", 2024-04-19T03:38:04.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2505000000000001e-05 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.638380+0000", 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4027999999999998e-05 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 3 2024-04-19T03:38:04.650 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:04.651 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:04.676 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:04.674+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:04.778 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:04.777+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:04.829 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:04.829 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:04.830 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:04.830 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:04.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:04.880 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:04.879+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:04.981 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:04.979+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:05.028 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.498816013999999, 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015878373000000001, 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.029 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 29 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527094+0000", 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.527092+0000", 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999976 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530848+0000", 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037563599999999998 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530871+0000", 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2867e-05 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530899+0000", 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8204e-05 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.530960+0000", 2024-04-19T03:38:05.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0928999999999999e-05 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531116+0000", 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015621600000000001 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.531270+0000", 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153332 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.537807+0000", 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065368869999999999 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542872+0000", 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005064893 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542922+0000", 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0903999999999999e-05 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:38.542973+0000", 2024-04-19T03:38:05.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0312999999999998e-05 2024-04-19T03:38:05.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.035 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.035 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:38:05.035 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.011668003, 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015903805, 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014242+0000", 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.014241+0000", 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018134+0000", 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038934180000000001 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018152+0000", 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8278e-05 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018163+0000", 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0647e-05 2024-04-19T03:38:05.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018235+0000", 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2350999999999999e-05 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018354+0000", 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119178 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.018459+0000", 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000104245 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.023951+0000", 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054925169999999997 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030090+0000", 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061382679999999997 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030120+0000", 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0269000000000001e-05 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:39.030146+0000", 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6418999999999999e-05 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33743 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 3035136~4096,write 3145728~4096,write 3153920~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.611827+0000", 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.4140838840000001, 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017796493, 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33743 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611827+0000", 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611827+0000", 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611826+0000", 2024-04-19T03:38:05.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611840+0000", 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3961000000000001e-05 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611850+0000", 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0487e-05 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611857+0000", 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9589999999999998e-06 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611890+0000", 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2968e-05 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.611936+0000", 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5837999999999997e-05 2024-04-19T03:38:05.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612029+0000", 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3247999999999999e-05 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.614070+0000", 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020405229999999998 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629573+0000", 2024-04-19T03:38:05.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01550375 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629603+0000", 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9816e-05 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629623+0000", 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9712999999999999e-05 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.047 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33745 4.2f 4:f59f865b:::100000001f8.00000007:head [write 2875392~4096,write 2953216~4096,write 3006464~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.612639+0000", 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.4132718400000002, 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020503627, 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33745 2024-04-19T03:38:05.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612639+0000", 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612639+0000", 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612638+0000", 2024-04-19T03:38:05.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612662+0000", 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4391000000000001e-05 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612672+0000", 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7820000000000005e-06 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612679+0000", 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2960000000000001e-06 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612719+0000", 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9684999999999997e-05 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612805+0000", 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5465999999999998e-05 2024-04-19T03:38:05.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.612919+0000", 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114447 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.614251+0000", 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001331905 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633059+0000", 2024-04-19T03:38:05.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018807866999999999 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633105+0000", 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6071e-05 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633142+0000", 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7372000000000001e-05 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33753 4.2f 4:f59f865b:::100000001f8.00000007:head [write 901120~4096,write 962560~4096,write 1011712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.616511+0000", 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.4093993600000001, 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016906207999999999, 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33753 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.054 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616511+0000", 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616511+0000", 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616510+0000", 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616520+0000", 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7780000000000002e-06 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616527+0000", 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1949999999999997e-06 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616532+0000", 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616568+0000", 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5859999999999999e-05 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616644+0000", 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5467000000000001e-05 2024-04-19T03:38:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.616732+0000", 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8718e-05 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.622933+0000", 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062004720000000003 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633331+0000", 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010397824 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633381+0000", 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0523999999999999e-05 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633417+0000", 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5966000000000001e-05 2024-04-19T03:38:05.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33763 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3051520~4096,write 3096576~4096,write 3137536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.620664+0000", 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.4052462889999999, 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017334680000000002, 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.060 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33763 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620664+0000", 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620664+0000", 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620663+0000", 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620673+0000", 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7569999999999999e-06 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620683+0000", 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4700000000000008e-06 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.620688+0000", 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.699e-06 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621114+0000", 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042590500000000002 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621163+0000", 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8511999999999999e-05 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621248+0000", 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5449000000000001e-05 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629529+0000", 2024-04-19T03:38:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082813409999999994 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.637929+0000", 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0083999160000000003 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.637977+0000", 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7239e-05 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.637999+0000", 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2218e-05 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33765 4.2f 4:f59f865b:::100000001f8.00000007:head [write 2183168~4096,write 2490368~4096,write 2617344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.621676+0000", 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.4042348919999998, 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017542383000000002, 2024-04-19T03:38:05.066 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33765 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621676+0000", 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621676+0000", 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621675+0000", 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621711+0000", 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5849999999999997e-05 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621720+0000", 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3659999999999998e-06 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.621727+0000", 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9129999999999997e-06 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.622211+0000", 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048410100000000002 2024-04-19T03:38:05.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.622293+0000", 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2229000000000002e-05 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.622454+0000", 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000160531 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.630626+0000", 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081728089999999996 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.639141+0000", 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085148859999999993 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.639176+0000", 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4845999999999998e-05 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.639218+0000", 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1712000000000003e-05 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33772 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 184320~4096,write 225280~4096,write 245760~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.624254+0000", 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.401655935, 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018875833000000002, 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.072 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33772 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624254+0000", 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624254+0000", 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624254+0000", 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624270+0000", 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5874000000000001e-05 2024-04-19T03:38:05.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624280+0000", 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0648e-05 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624289+0000", 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3520000000000007e-06 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624320+0000", 2024-04-19T03:38:05.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1717000000000001e-05 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624377+0000", 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6298999999999997e-05 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.624466+0000", 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9155999999999998e-05 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.630848+0000", 2024-04-19T03:38:05.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006382258 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.643069+0000", 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012221334 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.643108+0000", 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8896000000000002e-05 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.643130+0000", 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.211e-05 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33777 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1024000~4096,write 1060864~4096,write 1118208~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.625861+0000", 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.4000498050000001, 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018502819, 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.078 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33777 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625861+0000", 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625861+0000", 2024-04-19T03:38:05.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625860+0000", 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625879+0000", 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9562e-05 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625888+0000", 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1440000000000003e-06 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625893+0000", 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0939999999999998e-06 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.625931+0000", 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8748999999999998e-05 2024-04-19T03:38:05.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626020+0000", 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8623999999999997e-05 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626171+0000", 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000150867 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.630920+0000", 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047488620000000004 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.644283+0000", 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01336353 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.644327+0000", 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3874e-05 2024-04-19T03:38:05.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.644363+0000", 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6223000000000002e-05 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33778 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 1548288~4096,write 1568768~4096,write 1581056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.626171+0000", 2024-04-19T03:38:05.084 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3997396640000002, 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022168922000000001, 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33778 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626171+0000", 2024-04-19T03:38:05.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626171+0000", 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626170+0000", 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626185+0000", 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4409e-05 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626190+0000", 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.626193+0000", 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5030000000000002e-06 2024-04-19T03:38:05.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.627432+0000", 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012388060000000001 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.627516+0000", 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4321999999999997e-05 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.627642+0000", 2024-04-19T03:38:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012542299999999999 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633685+0000", 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060429439999999997 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648290+0000", 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01460552 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648319+0000", 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.864e-05 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648340+0000", 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0863999999999999e-05 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33783 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3923968~4096,write 3932160~4096,write 3993600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.628272+0000", 2024-04-19T03:38:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3976381089999999, 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021013490999999999, 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33783 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628272+0000", 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628272+0000", 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628271+0000", 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628284+0000", 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.289e-05 2024-04-19T03:38:05.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628296+0000", 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1657999999999999e-05 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628304+0000", 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8909999999999995e-06 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628613+0000", 2024-04-19T03:38:05.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00030874899999999998 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628711+0000", 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8858999999999997e-05 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.628800+0000", 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8972000000000001e-05 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633786+0000", 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004985237 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.649222+0000", 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015436322000000001 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.649250+0000", 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8039e-05 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.649286+0000", 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5728000000000001e-05 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:33786 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1429504~4096,write 1495040~4096,write 1597440~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:37:59.629404+0000", 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3965068199999999, 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019008206999999999, 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.096 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 33786 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629404+0000", 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629404+0000", 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629403+0000", 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629422+0000", 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9575000000000001e-05 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629431+0000", 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6889999999999993e-06 2024-04-19T03:38:05.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629439+0000", 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3459999999999994e-06 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629561+0000", 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012194200000000001 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629639+0000", 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7365000000000002e-05 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.629812+0000", 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173711 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.633864+0000", 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040513260000000001 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648337+0000", 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014473587 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648380+0000", 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2469000000000003e-05 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:37:59.648412+0000", 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1918999999999997e-05 2024-04-19T03:38:05.101 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:44314 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 704512~4096,write 733184~4096,write 749568~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.657697+0000", 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.36821305900000001, 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017533475999999999, 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.102 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 44314 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.657697+0000", 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.657697+0000", 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.657697+0000", 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.657714+0000", 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7093000000000001e-05 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.657723+0000", 2024-04-19T03:38:05.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0089999999999996e-06 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.657730+0000", 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9040000000000003e-06 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.657770+0000", 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0101000000000001e-05 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.657851+0000", 2024-04-19T03:38:05.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1225999999999998e-05 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.674013+0000", 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016162056000000001 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.674084+0000", 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1033999999999998e-05 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.675231+0000", 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001146813 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:44318 4.28 e55/14 4:15eeb89b:::100000001f8.00000032:head v 55'1402, mlcod=55'1400)", 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.659350+0000", 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.36656051200000001, 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015919226000000002, 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659350+0000", 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659350+0000", 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659349+0000", 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659365+0000", 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6107999999999999e-05 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659374+0000", 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7350000000000002e-06 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659380+0000", 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1990000000000003e-06 2024-04-19T03:38:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659418+0000", 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7438000000000003e-05 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659435+0000", 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7167999999999999e-05 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.675235+0000", 2024-04-19T03:38:05.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015799779 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.675269+0000", 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4431999999999998e-05 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:44319 4.38 4:1d13bf87:::100000001f8.00000030:head [write 471040~4096,write 528384~4096,write 626688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.659700+0000", 2024-04-19T03:38:05.111 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.36621023899999999, 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016234823999999998, 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 44319 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659700+0000", 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659700+0000", 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659699+0000", 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659712+0000", 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3020000000000001e-05 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659722+0000", 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7850000000000003e-06 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659729+0000", 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8719999999999996e-06 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.659980+0000", 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000251198 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.660061+0000", 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1003999999999999e-05 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.675815+0000", 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015753928 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.675862+0000", 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6804000000000001e-05 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.675935+0000", 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3232000000000006e-05 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.116 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:44694 4.28 e55/14 4:153ae410:::100000001f8.0000003b:head v 55'1413, mlcod=55'1411)", 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.806752+0000", 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.21915875000000001, 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017535245000000001, 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.806752+0000", 2024-04-19T03:38:05.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.806752+0000", 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.806751+0000", 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.806762+0000", 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1146e-05 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.806769+0000", 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7530000000000004e-06 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.806776+0000", 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0119999999999999e-06 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.806811+0000", 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4507e-05 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.806829+0000", 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7940000000000001e-05 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.824260+0000", 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017431760000000001 2024-04-19T03:38:05.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.824287+0000", 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6574999999999999e-05 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:44696 4.38 4:1fc350da:::100000001f8.0000002f:head [write 2166784~4096,write 2207744~4096,write 2371584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.807054+0000", 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.21885591700000001, 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017363751, 2024-04-19T03:38:05.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 44696 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.807054+0000", 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.807054+0000", 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.807053+0000", 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.807066+0000", 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2435e-05 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.807074+0000", 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5750000000000001e-06 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.807080+0000", 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.648e-06 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.813737+0000", 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066570919999999999 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.813798+0000", 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0297999999999998e-05 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.824295+0000", 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010497523999999999 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.824335+0000", 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9842000000000002e-05 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.824418+0000", 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3362999999999995e-05 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:44701 4.30 4:0c89e311:::100000001f8.00000017:head [write 3641344~4096,write 3899392~4096,write 4014080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.808690+0000", 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.21722060800000001, 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015894827, 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.126 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 44701 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.808690+0000", 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.808690+0000", 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.808689+0000", 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.808704+0000", 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4623e-05 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.808710+0000", 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2140000000000001e-06 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.808714+0000", 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1049999999999997e-06 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.818327+0000", 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096126560000000007 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.818396+0000", 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9283999999999996e-05 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.824501+0000", 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061052529999999997 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.824531+0000", 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9601e-05 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.824585+0000", 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3786000000000003e-05 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:44702 4.38 4:1dcf718c:::100000001f8.00000022:head [write 3923968~4096,write 3948544~4096,write 4014080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.809025+0000", 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.216885254, 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018121426999999999, 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.131 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 44702 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.809025+0000", 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.809025+0000", 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.809025+0000", 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.809033+0000", 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3229999999999998e-06 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.809039+0000", 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.93e-06 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.809043+0000", 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4879999999999999e-06 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.819378+0000", 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010335670999999999 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.819459+0000", 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1247000000000003e-05 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.827041+0000", 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075818029999999998 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.827084+0000", 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2701000000000003e-05 2024-04-19T03:38:05.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.827147+0000", 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2619000000000005e-05 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:44706 4.38 4:1dcf718c:::100000001f8.00000022:head [write 4120576~4096,write 4182016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:04.810405+0000", 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.215505532, 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016864486000000001, 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:05.136 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 44706 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.810405+0000", 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.810405+0000", 2024-04-19T03:38:05.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.810404+0000", 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.810415+0000", 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.810426+0000", 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.059e-05 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.810436+0000", 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0332999999999999e-05 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.821415+0000", 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010979136 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.821490+0000", 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4325000000000004e-05 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.827154+0000", 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056638290000000004 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.827201+0000", 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7080999999999999e-05 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:05.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:05.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:05.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:04.827269+0000", 2024-04-19T03:38:05.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8725000000000004e-05 2024-04-19T03:38:05.141 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.141 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.141 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.141 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:05.141 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:05.141 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:05.143 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:05.141+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:05.143 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:05.243 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:05.242+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:05.338 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:05.338 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:05.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.338 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:45917 4.2d e55/14 4:b7099a35:::100000001f8.0000000e:head v 55'1398, mlcod=55'1396)", 2024-04-19T03:38:05.338 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:05.336820+0000", 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00093797599999999998, 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00096372999999999999, 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.336820+0000", 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.336820+0000", 2024-04-19T03:38:05.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.336819+0000", 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.336836+0000", 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6640999999999999e-05 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.336850+0000", 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4469e-05 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.336858+0000", 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9959999999999993e-06 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.336898+0000", 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9728999999999999e-05 2024-04-19T03:38:05.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.336914+0000", 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5931999999999999e-05 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:45918 4.37 e55/14 4:ef395e89:::100000001f8.00000020:head v 55'2143, mlcod=55'2141)", 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:05.337101+0000", 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.000657377, 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076257699999999996, 2024-04-19T03:38:05.342 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.337101+0000", 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.337101+0000", 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.337100+0000", 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.337116+0000", 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5756999999999998e-05 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.337129+0000", 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3052e-05 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.337138+0000", 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5240000000000006e-06 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.337189+0000", 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0980999999999999e-05 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:05.337204+0000", 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4669e-05 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.346 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:05.346 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 2 2024-04-19T03:38:05.346 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:05.347 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:05.346+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:05.353 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:05.394 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:38:05.448 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:05.447+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:05.548 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:05.547+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:05.599 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:05.600 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:05.600 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:05.600 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:05.600 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:05.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:05.658 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:05.657+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:05.750 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:05.749+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:05.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:05.851 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:05.851+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:05.862 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.993969464, 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:38:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.99392467, 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.99386907500001, 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:38:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:38:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.993828737, 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:38:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:38:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.993798744, 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:38:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:38:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:38:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:38:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.993769019, 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.993728464, 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:38:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.993705843, 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.993677449, 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:38:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:38:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:38:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.661594263000001, 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:38:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:38:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.943195862, 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:38:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:38:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:38:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33745 4.2f e54/14 4:f59f865b:::100000001f8.00000007:head v 54'521, mlcod=54'519)", 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.246379449, 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019385056000000001, 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612973+0000", 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612994+0000", 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1166e-05 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613006+0000", 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1664e-05 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613013+0000", 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5460000000000003e-06 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613053+0000", 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9323999999999998e-05 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613086+0000", 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3154999999999997e-05 2024-04-19T03:38:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632322+0000", 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019235851000000002 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632359+0000", 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7253999999999999e-05 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33772 4.f e54/14 4:f0d983b2:::100000001f8.0000001f:head v 54'1585, mlcod=54'1581)", 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.2348292299999999, 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018422488000000001, 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624550+0000", 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6625999999999999e-05 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624563+0000", 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3021e-05 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624572+0000", 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5660000000000007e-06 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.631481+0000", 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069090239999999997 2024-04-19T03:38:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.631501+0000", 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0021999999999999e-05 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.642910+0000", 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011408882 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.642947+0000", 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6826000000000003e-05 2024-04-19T03:38:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33778 4.f e54/14 4:f2a80dfe:::100000001f8.00000019:head v 54'1586, mlcod=54'1581)", 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.2314130810000004, 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020237682, 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627956+0000", 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5948e-05 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627965+0000", 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8769999999999999e-06 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627972+0000", 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2180000000000002e-06 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632926+0000", 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049541020000000002 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632946+0000", 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.018e-05 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648147+0000", 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015201147 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648178+0000", 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0605999999999998e-05 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33783 4.f e54/14 4:f0d983b2:::100000001f8.0000001f:head v 54'1587, mlcod=54'1581)", 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.2304912669999997, 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020230292, 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628861+0000", 2024-04-19T03:38:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628879+0000", 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7634000000000001e-05 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628895+0000", 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5772000000000001e-05 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628903+0000", 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1349999999999992e-06 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637680+0000", 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087774389999999997 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637702+0000", 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1875e-05 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.649055+0000", 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011352322999999999 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.649092+0000", 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7883000000000003e-05 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33786 4.2f e54/14 4:f59f865b:::100000001f8.00000007:head v 54'527, mlcod=54'519)", 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.2294758860000004, 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018336394999999998, 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629891+0000", 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4535000000000001e-05 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629904+0000", 2024-04-19T03:38:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2635e-05 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629911+0000", 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8809999999999998e-06 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637675+0000", 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0077639689999999999 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637700+0000", 2024-04-19T03:38:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5157e-05 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648183+0000", 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010482784 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648214+0000", 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1121000000000002e-05 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33911 4.25 4:a76ff001:::100000001f8.0000002b:head [write 2875392~4096,write 2887680~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.1699050360000003, 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018443491999999999, 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33911 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689447+0000", 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689462+0000", 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4154999999999999e-05 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689471+0000", 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7739999999999999e-06 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689476+0000", 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0030000000000002e-06 2024-04-19T03:38:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697594+0000", 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081173210000000003 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697685+0000", 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1323999999999995e-05 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707759+0000", 2024-04-19T03:38:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010073985000000001 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707808+0000", 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8831000000000001e-05 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707892+0000", 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3929000000000002e-05 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33912 4.25 4:a76ff001:::100000001f8.0000002b:head [write 3411968~4096,write 3551232~4096,write 3657728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.1695725039999996, 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018238806, 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33912 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689780+0000", 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689798+0000", 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8419000000000001e-05 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689808+0000", 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0168e-05 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689816+0000", 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.699567+0000", 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0097506740000000008 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.699662+0000", 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5223999999999995e-05 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707900+0000", 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0082382059999999997 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707945+0000", 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4422000000000003e-05 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.708020+0000", 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5119999999999999e-05 2024-04-19T03:38:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33922 4.e 4:73e84e43:::100000001f8.00000004:head [write 315392~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.1648850450000001, 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018561412999999999, 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33922 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694467+0000", 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694479+0000", 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.168e-05 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694490+0000", 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-05 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694496+0000", 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7219999999999996e-06 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694534+0000", 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7960999999999998e-05 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694593+0000", 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9453999999999997e-05 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.712881+0000", 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018287570999999999 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.712937+0000", 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6462999999999998e-05 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713030+0000", 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.268e-05 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:44694 4.28 4:153ae410:::100000001f8.0000003b:head [write 688128~4096,write 782336~4096,write 950272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:04.806292+0000", 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.0530611539999999, 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018151825, 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 44694 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806292+0000", 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806292+0000", 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806291+0000", 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806312+0000", 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.086e-05 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806324+0000", 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1445e-05 2024-04-19T03:38:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806331+0000", 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806389+0000", 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7902000000000002e-05 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806479+0000", 2024-04-19T03:38:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9826000000000004e-05 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806645+0000", 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016633500000000001 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.809292+0000", 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026462120000000002 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.824357+0000", 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015065686999999999 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.824402+0000", 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4728000000000003e-05 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.824444+0000", 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2111999999999999e-05 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:05.968 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:05.968 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:05.969 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:05.968+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:05.970 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:05.981 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:06.006 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:06.006 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:06.006 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:06.006 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:06.010 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:06.010 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:06.069 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:06.068+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:06.148 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:06.148 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:06.161 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:06.171 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:06.169+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:06.271 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:06.270+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:06.335 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:06.335 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:06.349 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:06.390 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:06.389+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:06.473 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:06.471+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:06.557 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:06.557 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:06.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:06.573 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:06.572+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:06.674 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:06.672+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:06.776 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:06.774+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:06.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:06.876 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:06.875+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:06.978 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:06.977+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:07.025 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:07.025 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:07.042 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:07.086 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:07.085+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:07.180 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:07.179+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:07.243 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:07.243 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:07.260 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:07.301 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:07.300+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:07.382 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:07.381+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:07.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:38:07.435 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:07.436 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:07.449 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:07.483 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:07.482+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:07.584 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:07.583+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:07.664 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:07.664 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:07.674 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:07.718 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:07.717+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:07.786 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:07.785+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:07.850 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:07.850 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:07.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:07.911 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:07.909+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:07.926 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:38:07.987 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:07.986+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:08.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:08.073 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:08.073 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:08.089 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:08.087+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:08.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:08.189 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:08.188+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:08.206 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:08.231 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:08.235 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:08.236 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:08.290 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:08.289+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:08.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2024-04-19T03:38:08.346 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:08.346 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:08.346 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:08.346 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:08.346 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:08.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:08.406 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:08.405+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:08.492 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:08.491+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:08.564 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:08.564 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:08.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:08.564 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:08.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.564 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:08.564 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.696080757, 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:38:08.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:38:08.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.69603596300001, 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019219871999999999, 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865429+0000", 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865428+0000", 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865432+0000", 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1679999999999997e-06 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865451+0000", 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8323999999999999e-05 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865458+0000", 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1860000000000003e-06 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865515+0000", 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7336999999999997e-05 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865522+0000", 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7399999999999998e-06 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873826+0000", 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083038450000000007 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873964+0000", 2024-04-19T03:38:08.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138293 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874115+0000", 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015122000000000001 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881013+0000", 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068972080000000002 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884492+0000", 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034790379999999998 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884578+0000", 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6782999999999999e-05 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884649+0000", 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0226000000000002e-05 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.576 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.69598036799999, 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019163507, 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:08.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865484+0000", 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865496+0000", 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2021000000000001e-05 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865504+0000", 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3909999999999998e-06 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865512+0000", 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865579+0000", 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6933000000000004e-05 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7300000000000005e-06 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873747+0000", 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081609509999999996 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873887+0000", 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139569 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874067+0000", 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018013099999999999 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.880942+0000", 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068745719999999998 2024-04-19T03:38:08.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884549+0000", 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036071419999999998 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884598+0000", 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9196999999999997e-05 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884648+0000", 2024-04-19T03:38:08.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9790999999999998e-05 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.69594003, 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:38:08.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.695910037, 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020075923999999998, 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865555+0000", 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865554+0000", 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865559+0000", 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7249999999999997e-06 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865564+0000", 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6239999999999999e-06 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865570+0000", 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865616+0000", 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6341999999999998e-05 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865621+0000", 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876314+0000", 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010693637000000001 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876414+0000", 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9298999999999999e-05 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876511+0000", 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6836000000000006e-05 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.881909+0000", 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053981200000000002 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885524+0000", 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036155060000000001 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885557+0000", 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2354000000000002e-05 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885631+0000", 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3951999999999999e-05 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.69588031200001, 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019155558999999999, 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.595 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865584+0000", 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865600+0000", 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6566e-05 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865609+0000", 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2979999999999992e-06 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865615+0000", 2024-04-19T03:38:08.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.426e-06 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865657+0000", 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2277000000000002e-05 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865662+0000", 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.51e-06 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874735+0000", 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090731890000000006 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.874867+0000", 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013215500000000001 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.875021+0000", 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015352000000000001 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882110+0000", 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007088731 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884675+0000", 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025657449999999999 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884717+0000", 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1659000000000002e-05 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884740+0000", 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2952999999999999e-05 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.69583975699999, 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:38:08.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:38:08.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:38:08.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:24 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.69581713599999, 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018783848999999998, 2024-04-19T03:38:08.607 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865648+0000", 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865647+0000", 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865650+0000", 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0060000000000001e-06 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865658+0000", 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4739999999999999e-06 2024-04-19T03:38:08.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865666+0000", 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999994e-06 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865705+0000", 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9443999999999997e-05 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865709+0000", 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0439999999999997e-06 2024-04-19T03:38:08.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873107+0000", 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073976160000000001 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873253+0000", 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014593200000000001 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884431+0000", 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011178354999999999 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:28 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.69578874199999, 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018759819, 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865676+0000", 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865677+0000", 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8819999999999999e-06 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865682+0000", 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3749999999999996e-06 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865687+0000", 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:38:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865721+0000", 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4282999999999997e-05 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865725+0000", 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7120000000000002e-06 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.872891+0000", 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071660229999999997 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.873079+0000", 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018807900000000001 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.884436+0000", 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01135687 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.616 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.363705555999999, 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018101446, 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 18 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197759+0000", 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.197756+0000", 2024-04-19T03:38:08.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201957+0000", 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042015230000000004 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201981+0000", 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3411999999999999e-05 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.201992+0000", 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1613999999999999e-05 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202071+0000", 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8579999999999996e-05 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202220+0000", 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149393 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.202342+0000", 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121458 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.207612+0000", 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052706849999999998 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215738+0000", 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081255370000000004 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215830+0000", 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1768000000000006e-05 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.215861+0000", 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1001999999999999e-05 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.645307155000001, 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018534673000000002, 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 24 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916157+0000", 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.916155+0000", 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920003+0000", 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038483789999999999 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920040+0000", 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6869999999999998e-05 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920059+0000", 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8899e-05 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920144+0000", 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5725999999999999e-05 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920271+0000", 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126556 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.920416+0000", 2024-04-19T03:38:08.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145449 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.925618+0000", 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052019650000000002 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934614+0000", 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089950819999999997 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934657+0000", 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3177999999999999e-05 2024-04-19T03:38:08.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:37.934692+0000", 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5476999999999999e-05 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33745 4.2f e54/14 4:f59f865b:::100000001f8.00000007:head v 54'521, mlcod=54'519)", 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9484907420000006, 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019385056000000001, 2024-04-19T03:38:08.628 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612974+0000", 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612973+0000", 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.612994+0000", 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1166e-05 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613006+0000", 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1664e-05 2024-04-19T03:38:08.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613013+0000", 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5460000000000003e-06 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613053+0000", 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9323999999999998e-05 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.613086+0000", 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3154999999999997e-05 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632322+0000", 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019235851000000002 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632359+0000", 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7253999999999999e-05 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33772 4.f e54/14 4:f0d983b2:::100000001f8.0000001f:head v 54'1585, mlcod=54'1581)", 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9369405230000005, 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018422488000000001, 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624524+0000", 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624550+0000", 2024-04-19T03:38:08.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6625999999999999e-05 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624563+0000", 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3021e-05 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.624572+0000", 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5660000000000007e-06 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.631481+0000", 2024-04-19T03:38:08.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069090239999999997 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.631501+0000", 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0021999999999999e-05 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.642910+0000", 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011408882 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.642947+0000", 2024-04-19T03:38:08.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6826000000000003e-05 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33778 4.f e54/14 4:f2a80dfe:::100000001f8.00000019:head v 54'1586, mlcod=54'1581)", 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9335243739999992, 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020237682, 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627956+0000", 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5948e-05 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627965+0000", 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8769999999999999e-06 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627972+0000", 2024-04-19T03:38:08.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2180000000000002e-06 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632926+0000", 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049541020000000002 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632946+0000", 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.018e-05 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648147+0000", 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015201147 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648178+0000", 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0605999999999998e-05 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33783 4.f e54/14 4:f0d983b2:::100000001f8.0000001f:head v 54'1587, mlcod=54'1581)", 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:08.641 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9326025599999994, 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020230292, 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628862+0000", 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628861+0000", 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628879+0000", 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7634000000000001e-05 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628895+0000", 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5772000000000001e-05 2024-04-19T03:38:08.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.628903+0000", 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1349999999999992e-06 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637680+0000", 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087774389999999997 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637702+0000", 2024-04-19T03:38:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1875e-05 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.649055+0000", 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011352322999999999 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.649092+0000", 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7883000000000003e-05 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33786 4.2f e54/14 4:f59f865b:::100000001f8.00000007:head v 54'527, mlcod=54'519)", 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.9315871789999992, 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018336394999999998, 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629877+0000", 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629891+0000", 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4535000000000001e-05 2024-04-19T03:38:08.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629904+0000", 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2635e-05 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.629911+0000", 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8809999999999998e-06 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637675+0000", 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0077639689999999999 2024-04-19T03:38:08.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.637700+0000", 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5157e-05 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648183+0000", 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010482784 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648214+0000", 2024-04-19T03:38:08.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1121000000000002e-05 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33911 4.25 4:a76ff001:::100000001f8.0000002b:head [write 2875392~4096,write 2887680~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.8720163290000009, 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018443491999999999, 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:08.650 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33911 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689448+0000", 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689447+0000", 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689462+0000", 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4154999999999999e-05 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689471+0000", 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7739999999999999e-06 2024-04-19T03:38:08.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689476+0000", 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0030000000000002e-06 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697594+0000", 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081173210000000003 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.697685+0000", 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1323999999999995e-05 2024-04-19T03:38:08.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707759+0000", 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010073985000000001 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707808+0000", 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8831000000000001e-05 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707892+0000", 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3929000000000002e-05 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33912 4.25 4:a76ff001:::100000001f8.0000002b:head [write 3411968~4096,write 3551232~4096,write 3657728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.8716837969999993, 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018238806, 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:08.655 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33912 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689781+0000", 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689780+0000", 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689798+0000", 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8419000000000001e-05 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689808+0000", 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0168e-05 2024-04-19T03:38:08.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.689816+0000", 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.699567+0000", 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0097506740000000008 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.699662+0000", 2024-04-19T03:38:08.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5223999999999995e-05 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707900+0000", 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0082382059999999997 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.707945+0000", 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4422000000000003e-05 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.708020+0000", 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5119999999999999e-05 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:33922 4.e 4:73e84e43:::100000001f8.00000004:head [write 315392~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.8669963379999999, 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018561412999999999, 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:08.660 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33922 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694468+0000", 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694467+0000", 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694479+0000", 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.168e-05 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694490+0000", 2024-04-19T03:38:08.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.077e-05 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694496+0000", 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7219999999999996e-06 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694534+0000", 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7960999999999998e-05 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.694593+0000", 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9453999999999997e-05 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.712881+0000", 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018287570999999999 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.712937+0000", 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6462999999999998e-05 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.713030+0000", 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.268e-05 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:44694 4.28 4:153ae410:::100000001f8.0000003b:head [write 688128~4096,write 782336~4096,write 950272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:04.806292+0000", 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.7551724470000001, 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018151825, 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.665 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 44694 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806292+0000", 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806292+0000", 2024-04-19T03:38:08.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806291+0000", 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806312+0000", 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.086e-05 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:08.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806324+0000", 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1445e-05 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806331+0000", 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6599999999999995e-06 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806389+0000", 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7902000000000002e-05 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:08.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806479+0000", 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9826000000000004e-05 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.806645+0000", 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016633500000000001 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.809292+0000", 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026462120000000002 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.824357+0000", 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015065686999999999 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.824402+0000", 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4728000000000003e-05 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:04.824444+0000", 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2111999999999999e-05 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.670 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:08.671 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:08.671 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:08.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:08.673 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:08.671+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:08.773 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:08.772+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:08.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:53394 4.36 e57/14 4:6fa85f86:::100000001f8.00000013:head v 57'2488, mlcod=57'2485)", 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.824209+0000", 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.012426684, 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012449513000000001, 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824209+0000", 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824209+0000", 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824209+0000", 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824220+0000", 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0729e-05 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824225+0000", 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3619999999999997e-06 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824229+0000", 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5260000000000004e-06 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824259+0000", 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9522999999999998e-05 2024-04-19T03:38:08.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824271+0000", 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2228e-05 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53395 4.12 4:4be51a30:::100000001f8.0000000b:head [write 585728~4096 in=4096b,write 872448~4096 in=4096b,write 921600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.824309+0000", 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.012326543000000001, 2024-04-19T03:38:08.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01242068, 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53395 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824309+0000", 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824309+0000", 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824309+0000", 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824320+0000", 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1073999999999999e-05 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824328+0000", 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4970000000000001e-06 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824333+0000", 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825767+0000", 2024-04-19T03:38:08.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0014336209999999999 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825838+0000", 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0944000000000004e-05 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826008+0000", 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000170364 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834181+0000", 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081729200000000002 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53397 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2883584~4096 in=4096b,write 2965504~4096 in=4096b,write 3022848~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.824923+0000", 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011713258000000001, 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011895378, 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.848 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53397 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824923+0000", 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824923+0000", 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824922+0000", 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824930+0000", 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7500000000000003e-06 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824935+0000", 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5940000000000001e-06 2024-04-19T03:38:08.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824939+0000", 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7239999999999998e-06 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824978+0000", 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9023000000000002e-05 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825051+0000", 2024-04-19T03:38:08.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3255000000000003e-05 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:53425 4.3f e57/14 4:fde182c5:::100000001f8.00000039:head v 57'831, mlcod=57'829)", 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.836453+0000", 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.000183315, 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042882, 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836453+0000", 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836453+0000", 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836452+0000", 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836508+0000", 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5622999999999999e-05 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836516+0000", 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.089e-06 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836524+0000", 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7819999999999994e-06 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836564+0000", 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0107000000000001e-05 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836582+0000", 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7706e-05 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:53396 4.6 e57/14 4:63e80496:::100000001f8.0000001e:head v 57'3300, mlcod=57'3297)", 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.825028+0000", 2024-04-19T03:38:08.855 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011608181, 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012264560000000001, 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825028+0000", 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825028+0000", 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825027+0000", 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825054+0000", 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6710999999999999e-05 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825062+0000", 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4649999999999994e-06 2024-04-19T03:38:08.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825068+0000", 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6110000000000001e-06 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825392+0000", 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00032374699999999999 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.825412+0000", 2024-04-19T03:38:08.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0356e-05 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:53426 4.2e e57/14 4:75be0f36:::100000001f8.0000003d:head v 57'859, mlcod=57'857)", 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.836824+0000", 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9998121, 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00054957900000000002, 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836824+0000", 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836824+0000", 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836823+0000", 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836838+0000", 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4533e-05 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836846+0000", 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3459999999999994e-06 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836854+0000", 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3240000000000003e-06 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836891+0000", 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6189999999999997e-05 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836910+0000", 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9091999999999999e-05 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53427 4.37 4:eff9002a:::100000001f8.00000003:head [write 81920~4096 in=4096b,write 151552~4096 in=4096b,write 176128~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.836929+0000", 2024-04-19T03:38:08.862 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9997067, 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00056046199999999996, 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53427 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836929+0000", 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836929+0000", 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836928+0000", 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836940+0000", 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.164e-05 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836956+0000", 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5874000000000001e-05 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836963+0000", 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1289999999999998e-06 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.837028+0000", 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5310999999999999e-05 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.837146+0000", 2024-04-19T03:38:08.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000117706 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.837300+0000", 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015368599999999999 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:53399 4.28 e57/14 4:15eeb89b:::100000001f8.00000032:head v 57'1694, mlcod=57'1692)", 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.826125+0000", 2024-04-19T03:38:08.866 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010510553000000001, 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011422978, 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826125+0000", 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826125+0000", 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826125+0000", 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826154+0000", 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.959e-05 2024-04-19T03:38:08.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826164+0000", 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0056e-05 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826173+0000", 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8799999999999997e-06 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831154+0000", 2024-04-19T03:38:08.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049808040000000001 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831173+0000", 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8672e-05 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53401 4.12 4:4be51a30:::100000001f8.0000000b:head [write 929792~4096 in=4096b,write 950272~4096 in=4096b,write 1359872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.826752+0000", 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0098837460000000005, 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010836026, 2024-04-19T03:38:08.871 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53401 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826752+0000", 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826752+0000", 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826751+0000", 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826781+0000", 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9567e-05 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826792+0000", 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0978000000000001e-05 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.826800+0000", 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1829999999999994e-06 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830545+0000", 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037446739999999999 2024-04-19T03:38:08.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830626+0000", 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1330999999999998e-05 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830809+0000", 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018311099999999999 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834427+0000", 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036181770000000002 2024-04-19T03:38:08.875 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:53400 4.36 e57/14 4:6fa85f86:::100000001f8.00000013:head v 57'2489, mlcod=57'2485)", 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.827348+0000", 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0092878879999999994, 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010324994000000001, 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.827348+0000", 2024-04-19T03:38:08.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.827348+0000", 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.827347+0000", 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.827362+0000", 2024-04-19T03:38:08.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.505e-05 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.827373+0000", 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0686000000000001e-05 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.827380+0000", 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7020000000000004e-06 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830951+0000", 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035708879999999999 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830968+0000", 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7723999999999998e-05 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:53404 4.6 e57/14 4:62d56fc8:::100000001f8.0000001c:head v 57'3301, mlcod=57'3297)", 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.829105+0000", 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0075308370000000003, 2024-04-19T03:38:08.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086341539999999998, 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829105+0000", 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829105+0000", 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829104+0000", 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829119+0000", 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4994000000000001e-05 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829137+0000", 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7265000000000002e-05 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829144+0000", 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6179999999999997e-06 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.833028+0000", 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038838319999999998 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.833068+0000", 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0363e-05 2024-04-19T03:38:08.882 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:53403 4.36 e57/14 4:6c9c34b1:::100000001f8.00000010:head v 57'2490, mlcod=57'2485)", 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.829215+0000", 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0074208080000000001, 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086073599999999997, 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.883 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829215+0000", 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829215+0000", 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829215+0000", 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829232+0000", 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7564e-05 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829241+0000", 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8890000000000008e-06 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.829247+0000", 2024-04-19T03:38:08.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1149999999999999e-06 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.833338+0000", 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040911640000000004 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.833357+0000", 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8461000000000002e-05 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53412 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 1183744~4096 in=4096b,write 1740800~4096 in=4096b,write 1826816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.830661+0000", 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.005975368, 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072486060000000003, 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53412 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830661+0000", 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830661+0000", 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830660+0000", 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830670+0000", 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8439999999999993e-06 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830677+0000", 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9290000000000001e-06 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830684+0000", 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830726+0000", 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2716999999999998e-05 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830803+0000", 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6797000000000003e-05 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.830898+0000", 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5092000000000004e-05 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834273+0000", 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033747320000000001 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53413 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 638976~4096 in=4096b,write 712704~4096 in=4096b,write 720896~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.831034+0000", 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0056023660000000001, 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069531549999999999, 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.891 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53413 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831034+0000", 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831034+0000", 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831033+0000", 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831057+0000", 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4054e-05 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831075+0000", 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8321999999999998e-05 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831083+0000", 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0499999999999992e-06 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834705+0000", 2024-04-19T03:38:08.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003621679 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834795+0000", 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.988e-05 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53414 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 3497984~8192 in=8192b,write 3588096~4096 in=4096b,write 3620864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.831547+0000", 2024-04-19T03:38:08.895 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0050885410000000002, 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006485406, 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53414 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831547+0000", 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831547+0000", 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831546+0000", 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831570+0000", 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3300999999999999e-05 2024-04-19T03:38:08.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831580+0000", 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0509000000000001e-05 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831587+0000", 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8009999999999998e-06 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831633+0000", 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6227999999999999e-05 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831714+0000", 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0753000000000004e-05 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831857+0000", 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014326700000000001 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836458+0000", 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046007959999999999 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.838016+0000", 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001558338 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53416 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1982464~4096 in=4096b,write 1990656~4096 in=4096b,write 2170880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.832670+0000", 2024-04-19T03:38:08.900 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0039664009999999996, 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005423583, 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53416 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.832670+0000", 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.832670+0000", 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.832669+0000", 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.832681+0000", 2024-04-19T03:38:08.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2789000000000001e-05 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.832691+0000", 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0510000000000002e-06 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.832698+0000", 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2579999999999998e-06 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.833376+0000", 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00067857799999999999 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.833423+0000", 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7064000000000002e-05 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.833516+0000", 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2773000000000001e-05 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:08.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836488+0000", 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029722440000000002 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53421 4.12 4:4be51a30:::100000001f8.0000000b:head [write 4030464~4096 in=4096b,write 4046848~4096 in=4096b,write 4120576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.834478+0000", 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0021576820000000002, 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036803019999999999, 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.905 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53421 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834478+0000", 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834478+0000", 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834477+0000", 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834505+0000", 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8254000000000001e-05 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834514+0000", 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2679999999999994e-06 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834519+0000", 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.339e-06 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834557+0000", 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7871999999999999e-05 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834632+0000", 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5209000000000004e-05 2024-04-19T03:38:08.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834829+0000", 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00019641600000000001 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.837968+0000", 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003139401 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:53420 4.28 e57/14 4:15eeb89b:::100000001f8.00000032:head v 57'1695, mlcod=57'1692)", 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.834634+0000", 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0020022680000000002, 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003586933, 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834634+0000", 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834634+0000", 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834633+0000", 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834646+0000", 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3186999999999999e-05 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834655+0000", 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7620000000000001e-06 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834662+0000", 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6490000000000002e-06 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834688+0000", 2024-04-19T03:38:08.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6724999999999999e-05 2024-04-19T03:38:08.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.834709+0000", 2024-04-19T03:38:08.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1203e-05 2024-04-19T03:38:08.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.913 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53392 4.38 4:1fc350da:::100000001f8.0000002f:head [write 1941504~4096 in=4096b,write 2117632~4096 in=4096b,write 2125824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.824008+0000", 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.012628178, 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014258273, 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53392 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.914 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824008+0000", 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824008+0000", 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824007+0000", 2024-04-19T03:38:08.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824018+0000", 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1117999999999999e-05 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824026+0000", 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6629999999999993e-06 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824031+0000", 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7770000000000002e-06 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824064+0000", 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2737999999999997e-05 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824135+0000", 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1357000000000001e-05 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.838158+0000", 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014023167 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.838202+0000", 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4314000000000003e-05 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53393 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2473984~4096 in=4096b,write 2482176~4096 in=4096b,write 2920448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.918 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.824037+0000", 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.012598593, 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014287370000000001, 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53393 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824037+0000", 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824037+0000", 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824037+0000", 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824044+0000", 2024-04-19T03:38:08.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3869999999999997e-06 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824048+0000", 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6720000000000002e-06 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.824051+0000", 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.807e-06 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831167+0000", 2024-04-19T03:38:08.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071160770000000002 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.831253+0000", 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6420000000000003e-05 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:53424 4.30 4:0c89e311:::100000001f8.00000017:head [write 1363968~4096 in=4096b,write 1384448~4096 in=4096b,write 1404928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:08.835782+0000", 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00085404299999999997, 2024-04-19T03:38:08.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002636668, 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 53424 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.835782+0000", 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.835782+0000", 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.835781+0000", 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.835794+0000", 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2784e-05 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.835804+0000", 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0265000000000001e-05 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.835812+0000", 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836274+0000", 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000462013 2024-04-19T03:38:08.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:08.836379+0000", 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010514300000000001 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 21 2024-04-19T03:38:08.926 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:08.927 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:08.926+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:08.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:09.028 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:09.028+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:09.130 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:09.128+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:09.139 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:09.139 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:09.139 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:09.139 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:09.139 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:09.151 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:09.236 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:09.235+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:09.331 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:09.330+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:09.377 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:54026 4.36 e57/14 4:6c9c34b1:::100000001f8.00000010:head v 57'2516, mlcod=57'2514)", 2024-04-19T03:38:09.377 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.125704+0000", 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.248280106, 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025501448999999999, 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.125704+0000", 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.125704+0000", 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.125703+0000", 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.125720+0000", 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7028e-05 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.125741+0000", 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0690999999999999e-05 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.125748+0000", 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1110000000000002e-06 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.125793+0000", 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5385e-05 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.125820+0000", 2024-04-19T03:38:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.722e-05 2024-04-19T03:38:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.151162+0000", 2024-04-19T03:38:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025341552999999999 2024-04-19T03:38:09.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.151205+0000", 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3095e-05 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54031 4.38 4:1dcf718c:::100000001f8.00000022:head [write 2646016~8192,write 2785280~4096,write 2908160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.127236+0000", 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.246747736, 2024-04-19T03:38:09.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026648972999999999, 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54031 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.127236+0000", 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.127236+0000", 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.127235+0000", 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.127249+0000", 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3433e-05 2024-04-19T03:38:09.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.127265+0000", 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6044000000000001e-05 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.127270+0000", 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7830000000000004e-06 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.129111+0000", 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018406239999999999 2024-04-19T03:38:09.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.129171+0000", 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9524999999999997e-05 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153758+0000", 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024587013000000001 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153809+0000", 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1502999999999998e-05 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153885+0000", 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5827000000000004e-05 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54034 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2940928~4096,write 2965504~4096,write 2998272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.128578+0000", 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.24540546199999999, 2024-04-19T03:38:09.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.029352735000000001, 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54034 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.128578+0000", 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.128578+0000", 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.128577+0000", 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.128590+0000", 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2651e-05 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.128602+0000", 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2e-05 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.128609+0000", 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9650000000000002e-06 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.130818+0000", 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022094609999999998 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.130903+0000", 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5006999999999994e-05 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.157825+0000", 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026921759999999999 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.157870+0000", 2024-04-19T03:38:09.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5074000000000002e-05 2024-04-19T03:38:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.157931+0000", 2024-04-19T03:38:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0656999999999999e-05 2024-04-19T03:38:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54041 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3125248~8192,write 3145728~4096,write 3416064~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.131545+0000", 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.24243821500000001, 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031118666, 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54041 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.131545+0000", 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.131545+0000", 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.131545+0000", 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.131573+0000", 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8728999999999999e-05 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.131585+0000", 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.204e-05 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.131593+0000", 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7109999999999995e-06 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.132819+0000", 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001226282 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.132866+0000", 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6742000000000001e-05 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.162542+0000", 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.029675976 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.162585+0000", 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3257999999999998e-05 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.162664+0000", 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8807000000000006e-05 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:54046 4.28 e57/14 4:153ae410:::100000001f8.0000003b:head v 57'1711, mlcod=57'1709)", 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.134007+0000", 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.239976194, 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023962515, 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134007+0000", 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134007+0000", 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134007+0000", 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134019+0000", 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2363e-05 2024-04-19T03:38:09.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134029+0000", 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5060000000000001e-06 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134035+0000", 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.494e-06 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134064+0000", 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8758000000000001e-05 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134076+0000", 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.164e-05 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.157935+0000", 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023859886 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.157970+0000", 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4499999999999998e-05 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:54047 4.36 e57/14 4:6c9c34b1:::100000001f8.00000010:head v 57'2517, mlcod=57'2514)", 2024-04-19T03:38:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.134410+0000", 2024-04-19T03:38:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23957324599999999, 2024-04-19T03:38:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031458166000000003, 2024-04-19T03:38:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.402 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134410+0000", 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134410+0000", 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134410+0000", 2024-04-19T03:38:09.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134424+0000", 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4073000000000001e-05 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134433+0000", 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6740000000000003e-06 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.134440+0000", 2024-04-19T03:38:09.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6550000000000004e-06 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.136020+0000", 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001580085 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.136039+0000", 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8657000000000001e-05 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.165840+0000", 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.029800929 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.165869+0000", 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8731e-05 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54051 4.38 4:1fc350da:::100000001f8.0000002f:head [write 688128~4096,write 749568~4096,write 827392~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.406 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.135445+0000", 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23853886399999999, 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027352985, 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54051 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135445+0000", 2024-04-19T03:38:09.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135445+0000", 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135444+0000", 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135459+0000", 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5129e-05 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135469+0000", 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2580000000000001e-06 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135476+0000", 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0890000000000002e-06 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.136151+0000", 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00067533399999999998 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.136233+0000", 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2253e-05 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.162674+0000", 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026440899 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.162718+0000", 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4014000000000002e-05 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.162798+0000", 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9676000000000001e-05 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.411 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54052 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3878912~4096,write 4075520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.135822+0000", 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23816148600000001, 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027322869, 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54052 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135822+0000", 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135822+0000", 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135821+0000", 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135832+0000", 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0020000000000001e-05 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135844+0000", 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2157999999999999e-05 2024-04-19T03:38:09.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.135849+0000", 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.181e-06 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.149623+0000", 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013774155 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.149719+0000", 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6384000000000004e-05 2024-04-19T03:38:09.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.163029+0000", 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013309168 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.163072+0000", 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3659000000000003e-05 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.163145+0000", 2024-04-19T03:38:09.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2829000000000004e-05 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:54054 4.14 e57/14 4:2b28d75f:::100000001f8.00000016:head v 57'814, mlcod=57'812)", 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.137019+0000", 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23696504500000001, 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025693595999999999, 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137019+0000", 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137019+0000", 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137018+0000", 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137026+0000", 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8420000000000005e-06 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137033+0000", 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7220000000000002e-06 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137037+0000", 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.189e-06 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137065+0000", 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7591000000000001e-05 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137080+0000", 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5744999999999999e-05 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.162682+0000", 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025602007 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.162712+0000", 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9924999999999999e-05 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:54055 4.36 e57/14 4:6fa85f86:::100000001f8.00000013:head v 57'2518, mlcod=57'2514)", 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.137163+0000", 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.236820631, 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031485074000000002, 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.421 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137163+0000", 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137163+0000", 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137162+0000", 2024-04-19T03:38:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137175+0000", 2024-04-19T03:38:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2962999999999999e-05 2024-04-19T03:38:09.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137184+0000", 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9080000000000001e-06 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137190+0000", 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4750000000000001e-06 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.151237+0000", 2024-04-19T03:38:09.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014047573000000001 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.151256+0000", 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8457e-05 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168616+0000", 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017359965000000002 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168648+0000", 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2292000000000002e-05 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54056 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 2551808~4096,write 2609152~4096,write 2707456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.137223+0000", 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23676024800000001, 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027342410000000001, 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.426 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54056 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137223+0000", 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137223+0000", 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137223+0000", 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137235+0000", 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306e-05 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137245+0000", 2024-04-19T03:38:09.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0104e-05 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137252+0000", 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2790000000000001e-06 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137292+0000", 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9912e-05 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137381+0000", 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8393000000000006e-05 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137558+0000", 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017709900000000001 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.149677+0000", 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012119685999999999 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164482+0000", 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014804579 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164528+0000", 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6384999999999997e-05 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164566+0000", 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.756e-05 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54057 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 49152~4096,write 217088~4096,write 614400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.137598+0000", 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23638541900000001, 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027080702000000002, 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54057 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137598+0000", 2024-04-19T03:38:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137598+0000", 2024-04-19T03:38:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137597+0000", 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137609+0000", 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1739000000000001e-05 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137619+0000", 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8700000000000004e-06 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137627+0000", 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7780000000000007e-06 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137736+0000", 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000108825 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137814+0000", 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7873999999999993e-05 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.137951+0000", 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013720599999999999 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.149665+0000", 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011714765 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164602+0000", 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014936975 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164644+0000", 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1640000000000001e-05 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164679+0000", 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4848000000000002e-05 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.437 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54059 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 2949120~4096,write 3018752~4096,write 3198976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.138254+0000", 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23572931, 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026511058000000001, 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54059 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.438 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.138254+0000", 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.138254+0000", 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.138254+0000", 2024-04-19T03:38:09.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.138269+0000", 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5869e-05 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.138280+0000", 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0233e-05 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.138287+0000", 2024-04-19T03:38:09.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9909999999999996e-06 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.149799+0000", 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011512068 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.149875+0000", 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6161999999999993e-05 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:09.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.150038+0000", 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016269400000000001 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.154793+0000", 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047557470000000003 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164687+0000", 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0098932250000000003 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164730+0000", 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3738e-05 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164765+0000", 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5055999999999998e-05 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54061 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2961408~4096,write 2994176~4096,write 3026944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.443 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.139217+0000", 2024-04-19T03:38:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23476661400000001, 2024-04-19T03:38:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025311030000000002, 2024-04-19T03:38:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54061 2024-04-19T03:38:09.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.139217+0000", 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.139217+0000", 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.139216+0000", 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.139230+0000", 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4201e-05 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.139241+0000", 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0287e-05 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.139248+0000", 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.311e-06 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141760+0000", 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025120670000000002 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141848+0000", 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7491999999999995e-05 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.142018+0000", 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00017025100000000001 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153048+0000", 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011030457 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164452+0000", 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011403974000000001 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164494+0000", 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.189e-05 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164528+0000", 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3967999999999997e-05 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:54065 4.6 e57/14 4:616d4c41:::100000001f8.00000034:head v 57'3336, mlcod=57'3330)", 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.141184+0000", 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23279929199999999, 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027968601999999999, 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141184+0000", 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141184+0000", 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141184+0000", 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141199+0000", 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5097e-05 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141210+0000", 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0689999999999999e-05 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141216+0000", 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4540000000000004e-06 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.151257+0000", 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010040642000000001 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.151276+0000", 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9335999999999999e-05 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.169122+0000", 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017846101 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.169153+0000", 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0812999999999998e-05 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:54066 4.19 e57/14 4:9a4319fb:::100000001f8.0000002a:head v 57'1698, mlcod=57'1696)", 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.141652+0000", 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.232332124, 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024559061, 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141652+0000", 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141652+0000", 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141651+0000", 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141665+0000", 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3570000000000001e-05 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141673+0000", 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3620000000000006e-06 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141680+0000", 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5969999999999997e-06 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141712+0000", 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2113000000000002e-05 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.141727+0000", 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4965e-05 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.166182+0000", 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024455412999999999 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.166211+0000", 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8538999999999999e-05 2024-04-19T03:38:09.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54071 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 770048~4096,write 1114112~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.143799+0000", 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.23018484, 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024688743999999999, 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54071 2024-04-19T03:38:09.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143799+0000", 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143799+0000", 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143798+0000", 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143810+0000", 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1642e-05 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143820+0000", 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0657e-05 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143828+0000", 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5429999999999996e-06 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153090+0000", 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092617600000000008 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153171+0000", 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1110000000000001e-05 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153306+0000", 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013506600000000001 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.164968+0000", 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011662288999999999 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168379+0000", 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034106079999999999 2024-04-19T03:38:09.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168445+0000", 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6216000000000004e-05 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168488+0000", 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2493000000000001e-05 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.463 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:54070 4.36 e57/14 4:6c9c34b1:::100000001f8.00000010:head v 57'2519, mlcod=57'2514)", 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.143833+0000", 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.230150469, 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024836199, 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143833+0000", 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143833+0000", 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143833+0000", 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143844+0000", 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1745e-05 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143852+0000", 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2139999999999999e-06 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.143856+0000", 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2950000000000004e-06 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153147+0000", 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092906959999999993 2024-04-19T03:38:09.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153164+0000", 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7697e-05 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168650+0000", 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015486016 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168669+0000", 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8997000000000001e-05 2024-04-19T03:38:09.467 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54073 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 495616~4096,write 532480~4096,write 561152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.144636+0000", 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.22934777200000001, 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023961605, 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.468 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54073 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.144636+0000", 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.144636+0000", 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.144635+0000", 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.144644+0000", 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9800000000000004e-06 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.144651+0000", 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5950000000000004e-06 2024-04-19T03:38:09.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.144654+0000", 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5769999999999998e-06 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.154819+0000", 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010164219 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.154894+0000", 2024-04-19T03:38:09.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5018000000000006e-05 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.155039+0000", 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014541200000000001 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.165003+0000", 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099637259999999991 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168495+0000", 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034923710000000002 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168553+0000", 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7323e-05 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.168597+0000", 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4935000000000003e-05 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:54075 4.38 4:1dcf718c:::100000001f8.00000022:head [write 290816~4096,write 462848~4096,write 516096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:09.145456+0000", 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.22852787899999999, 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024500899999999999, 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 54075 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:09.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.145456+0000", 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.145456+0000", 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:09.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.145455+0000", 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.145475+0000", 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0086e-05 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.145485+0000", 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5810000000000003e-06 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.145490+0000", 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2920000000000003e-06 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.153962+0000", 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084719210000000003 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.154051+0000", 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9294000000000003e-05 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.169870+0000", 2024-04-19T03:38:09.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015818459 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.169902+0000", 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2781999999999999e-05 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:09.169957+0000", 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4206000000000002e-05 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:09.478 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:09.479 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:09.480 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:09.479+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:09.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:09.583 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:09.581+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:09.682 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:09.681+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:09.692 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:09.692 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:09.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.692 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:55255 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 516096~4096 in=4096b,write 581632~4096 in=4096b,write 643072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.678496+0000", 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.013230604, 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013253058, 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 55255 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678496+0000", 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678496+0000", 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678495+0000", 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678509+0000", 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3212e-05 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678519+0000", 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8959999999999998e-06 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678525+0000", 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1580000000000002e-06 2024-04-19T03:38:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678564+0000", 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9526000000000001e-05 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678616+0000", 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1736000000000001e-05 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678706+0000", 2024-04-19T03:38:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0406000000000001e-05 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.689695+0000", 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010988889 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:55256 4.6 4:63e80496:::100000001f8.0000001e:head [write 1167360~4096 in=4096b,write 1241088~4096 in=4096b,write 1253376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.678934+0000", 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.012792817, 2024-04-19T03:38:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012875229, 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 55256 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678934+0000", 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678934+0000", 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678933+0000", 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678946+0000", 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422000000000001e-05 2024-04-19T03:38:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678955+0000", 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7820000000000005e-06 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.678961+0000", 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5779999999999998e-06 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.681481+0000", 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025197000000000002 2024-04-19T03:38:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.681564+0000", 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3573999999999996e-05 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.681730+0000", 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016550199999999999 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.689732+0000", 2024-04-19T03:38:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080023349999999993 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:55263 4.28 4:15eeb89b:::100000001f8.00000032:head [write 24576~4096 in=4096b,write 151552~4096 in=4096b,write 413696~4096 in=4096b,write 491520~4096 in=4096b,write 565248~4096 in=4096b,write 745472~4096 in=4096b,write 815104~4096 in=4096b,write 1101824~4096 in=4096b,write 1138688~8192 in=8192b,write 1241088~4096 in=4096b,write 1683456~4096 in=4096b,write 1785856~4096 in=4096b,write 2064384~4096 in=4096b,write 2154496~4096 in=4096b,write 2162688~4096 in=4096b,write 2203648~4096 in=4096b,write 2211840~4096 in=4096b,write 2777088~4096 in=4096b,write 2867200~4096 in=4096b,write 3018752~4096 in=4096b,write 3121152~4096 in=4096b,write 3305472~4096 in=4096b,write 3325952~4096 in=4096b,write 3375104~4096 in=4096b,write 3473408~4096 in=4096b,write 3514368~4096 in=4096b,write 3768320~4096 in=4096b,write 3837952~4096 in=4096b,write 3899392~4096 in=4096b,write 4055040~4096 in=4096b,write 4087808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.680380+0000", 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.011347081, 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011500006, 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 55263 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680380+0000", 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680380+0000", 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680379+0000", 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680510+0000", 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013092799999999999 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680525+0000", 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4945e-05 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680532+0000", 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8720000000000002e-06 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680583+0000", 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0689000000000002e-05 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680697+0000", 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113965 2024-04-19T03:38:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.681289+0000", 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00059201800000000004 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.688607+0000", 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00731797 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:55264 4.36 4:6fa85f86:::100000001f8.00000013:head [write 323584~4096 in=4096b,write 360448~4096 in=4096b,write 671744~4096 in=4096b,write 913408~4096 in=4096b,write 1040384~8192 in=8192b,write 1060864~4096 in=4096b,write 1089536~4096 in=4096b,write 1273856~4096 in=4096b,write 1290240~4096 in=4096b,write 1437696~8192 in=8192b,write 1462272~4096 in=4096b,write 1576960~4096 in=4096b,write 1904640~4096 in=4096b,write 2043904~4096 in=4096b,write 2117632~4096 in=4096b,write 2232320~4096 in=4096b,write 2375680~4096 in=4096b,write 2449408~4096 in=4096b,write 2953216~4096 in=4096b,write 3186688~4096 in=4096b,write 3268608~4096 in=4096b,write 3579904~4096 in=4096b,write 3620864~4096 in=4096b,write 3641344~4096 in=4096b,write 3670016~4096 in=4096b,write 3817472~8192 in=8192b,write 3895296~4096 in=4096b,write 4038656~4096 in=4096b,write 4091904~4096 in=4096b,write 4186112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.680552+0000", 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.011174778, 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011395883000000001, 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 55264 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680552+0000", 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680552+0000", 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680551+0000", 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680745+0000", 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019323699999999999 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680756+0000", 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1871999999999999e-05 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680764+0000", 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0260000000000007e-06 2024-04-19T03:38:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680807+0000", 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2719999999999998e-05 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.680914+0000", 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010719 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.681986+0000", 2024-04-19T03:38:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010713369999999999 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:55269 4.36 4:6ee5e2c4:::100000001f9.00000000:head [write 0~1048576 in=1048576b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.681398+0000", 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.010328607, 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010596761999999999, 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 55269 2024-04-19T03:38:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.681398+0000", 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.681398+0000", 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.681397+0000", 2024-04-19T03:38:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.682586+0000", 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001188611 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.682600+0000", 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3536000000000001e-05 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.682608+0000", 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5329999999999994e-06 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.689687+0000", 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070790139999999998 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.689742+0000", 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4864000000000002e-05 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.689872+0000", 2024-04-19T03:38:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012951799999999999 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4526.0:55264 4.36 e57/14)", 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.690648+0000", 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0010785020000000001, 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013900270000000001, 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.690648+0000", 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.690648+0000", 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.690648+0000", 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.690652+0000", 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8210000000000001e-06 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.690663+0000", 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0406e-05 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.690669+0000", 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1650000000000003e-06 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:09.718 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:09.718 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 6 2024-04-19T03:38:09.718 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:09.719 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:09.803 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:09.802+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:09.883 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:09.882+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:09.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:38:09.966 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:09.966 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:09.966 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:09.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:09.984 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:09.983+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:10.085 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:10.084+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:10.186 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:10.185+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:10.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:10.239 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:10.239 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:10.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:10.239 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:10.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.239 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:10.239 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:10.239 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 130.370414638, 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:38:10.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:38:10.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:10.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:10.245 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 130.370273911, 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020310328999999998, 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865525+0000", 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865524+0000", 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865529+0000", 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0189999999999997e-06 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865538+0000", 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9930000000000001e-06 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865545+0000", 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1099999999999997e-06 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865583+0000", 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7957000000000003e-05 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865586+0000", 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2930000000000001e-06 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877100+0000", 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011513848 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877148+0000", 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7638e-05 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877223+0000", 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5273999999999998e-05 2024-04-19T03:38:10.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882131+0000", 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049082320000000002 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885752+0000", 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00362102 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885795+0000", 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2447999999999997e-05 2024-04-19T03:38:10.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885835+0000", 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0049000000000002e-05 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 130.37017363800001, 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:38:10.251 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:38:10.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:33778 4.f e54/14 4:f2a80dfe:::100000001f8.00000019:head v 54'1586, mlcod=54'1581)", 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.607858255, 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020237682, 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.257 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627940+0000", 2024-04-19T03:38:10.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627956+0000", 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5948e-05 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627965+0000", 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8769999999999999e-06 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.627972+0000", 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2180000000000002e-06 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632926+0000", 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049541020000000002 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.632946+0000", 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.018e-05 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648147+0000", 2024-04-19T03:38:10.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015201147 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:37:59.648178+0000", 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0605999999999998e-05 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.261 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:53374 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2682880~4096,write 2756608~4096,write 2830336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:08.816376+0000", 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.4194230349999999, 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02027901, 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 53374 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.816376+0000", 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.816376+0000", 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.816375+0000", 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.816396+0000", 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1529999999999999e-05 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.816405+0000", 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5429999999999994e-06 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.816409+0000", 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3379999999999998e-06 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.816439+0000", 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9499e-05 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.816492+0000", 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2800000000000003e-05 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.816582+0000", 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0747000000000004e-05 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.818663+0000", 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020808409999999999 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.836573+0000", 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017910098999999999 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.836618+0000", 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5096000000000003e-05 2024-04-19T03:38:10.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:08.836655+0000", 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6183999999999998e-05 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54026 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 606208~4096,write 720896~4096,write 778240~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.125173+0000", 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.110625215, 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026333255, 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.267 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54026 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125173+0000", 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125173+0000", 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125173+0000", 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125185+0000", 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2237e-05 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125197+0000", 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2116999999999999e-05 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125209+0000", 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1671000000000001e-05 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125251+0000", 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1947999999999999e-05 2024-04-19T03:38:10.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125343+0000", 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2378000000000002e-05 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125552+0000", 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020906000000000001 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.130960+0000", 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054076990000000002 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.151404+0000", 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020444599000000001 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.151459+0000", 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4293999999999999e-05 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.151507+0000", 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8015e-05 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54027 4.6 4:63e80496:::100000001f8.0000001e:head [write 1359872~4096,write 1564672~4096,write 1572864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.125637+0000", 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.1101615680000001, 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027756184999999999, 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54027 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125637+0000", 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125637+0000", 2024-04-19T03:38:10.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125636+0000", 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125651+0000", 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4798e-05 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125663+0000", 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1977000000000001e-05 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125671+0000", 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2239999999999995e-06 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.126904+0000", 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001232908 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.126994+0000", 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319e-05 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.127186+0000", 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019227400000000001 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132389+0000", 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052029859999999997 2024-04-19T03:38:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153327+0000", 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020937541 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153369+0000", 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2491999999999999e-05 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153393+0000", 2024-04-19T03:38:10.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3693000000000002e-05 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54035 4.6 4:63e80496:::100000001f8.0000001e:head [write 253952~4096,write 385024~4096,write 593920~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.128913+0000", 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.1068860169999999, 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025089283, 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.279 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54035 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128913+0000", 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128913+0000", 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128911+0000", 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128927+0000", 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6015000000000002e-05 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128942+0000", 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5021999999999999e-05 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128951+0000", 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2449999999999998e-06 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129234+0000", 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028331800000000001 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129329+0000", 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4717999999999997e-05 2024-04-19T03:38:10.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129429+0000", 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9989999999999996e-05 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132400+0000", 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029711970000000001 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153948+0000", 2024-04-19T03:38:10.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021548419999999999 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153980+0000", 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1813999999999997e-05 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.154002+0000", 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1631e-05 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54036 4.6 4:616d4c41:::100000001f8.00000034:head [write 2592768~4096,write 2678784~4096,write 2707456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.129240+0000", 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.1065589579999999, 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026165395000000001, 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54036 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129240+0000", 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129240+0000", 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129239+0000", 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129256+0000", 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7020999999999998e-05 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129267+0000", 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1348e-05 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129281+0000", 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4408e-05 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.130976+0000", 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001694341 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131038+0000", 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2612000000000003e-05 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131159+0000", 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012081100000000001 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133691+0000", 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002531817 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.155301+0000", 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021610032000000001 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.155368+0000", 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6860999999999996e-05 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.155405+0000", 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7211e-05 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54040 4.6 4:616d4c41:::100000001f8.00000034:head [write 278528~4096,write 356352~4096,write 475136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.131071+0000", 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.1047271599999999, 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025075534, 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.290 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54040 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131071+0000", 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131071+0000", 2024-04-19T03:38:10.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131070+0000", 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131088+0000", 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7961999999999998e-05 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131102+0000", 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3451999999999999e-05 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131110+0000", 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1040000000000007e-06 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132428+0000", 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013178829999999999 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132499+0000", 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1214e-05 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132593+0000", 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4352999999999996e-05 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.135822+0000", 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032286369999999999 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.156089+0000", 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020266879000000002 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.156124+0000", 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4727000000000001e-05 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.156147+0000", 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3314000000000001e-05 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54046 4.28 4:153ae410:::100000001f8.0000003b:head [write 94208~4096,write 204800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.133622+0000", 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.102176866, 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024498025999999999, 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54046 2024-04-19T03:38:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133622+0000", 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133622+0000", 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133621+0000", 2024-04-19T03:38:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133634+0000", 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3509000000000001e-05 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133644+0000", 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6870000000000006e-06 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133651+0000", 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4839999999999998e-06 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133691+0000", 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9897000000000001e-05 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133769+0000", 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7350999999999999e-05 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133877+0000", 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108056 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.135482+0000", 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016051640000000001 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.158062+0000", 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022579945000000001 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.158094+0000", 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1812e-05 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.158120+0000", 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5992000000000001e-05 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54047 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1433600~4096,write 1454080~4096,write 1482752~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.133917+0000", 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.101881935, 2024-04-19T03:38:10.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.032116025999999999, 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54047 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133917+0000", 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133917+0000", 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133916+0000", 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133931+0000", 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4703e-05 2024-04-19T03:38:10.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133941+0000", 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0171e-05 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133950+0000", 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5049999999999996e-06 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.134004+0000", 2024-04-19T03:38:10.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3912000000000002e-05 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.134111+0000", 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010645399999999999 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.134283+0000", 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000172881 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136306+0000", 2024-04-19T03:38:10.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020221789999999998 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.165946+0000", 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029640353000000001 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.165994+0000", 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8265e-05 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.166033+0000", 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8345e-05 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54054 4.14 4:2b28d75f:::100000001f8.00000016:head [write 3936256~4096,write 3981312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.136606+0000", 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.09919297, 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026294872, 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.307 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54054 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136606+0000", 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136606+0000", 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136605+0000", 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136617+0000", 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2619000000000001e-05 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136626+0000", 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136632+0000", 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8479999999999997e-06 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136674+0000", 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1859e-05 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136768+0000", 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3745000000000005e-05 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136914+0000", 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146551 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.138502+0000", 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00158753 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.162807+0000", 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024305177000000001 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.162862+0000", 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4447000000000002e-05 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.162900+0000", 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8859000000000002e-05 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54055 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1085440~4096,write 1114112~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.312 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.136840+0000", 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.0989589019999999, 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.033070549999999997, 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54055 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136840+0000", 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136840+0000", 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136839+0000", 2024-04-19T03:38:10.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136855+0000", 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6110999999999999e-05 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136864+0000", 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2750000000000001e-06 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136870+0000", 2024-04-19T03:38:10.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1129999999999997e-06 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136902+0000", 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1661000000000001e-05 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136957+0000", 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4449e-05 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.137068+0000", 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111702 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.138918+0000", 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001849601 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169819+0000", 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.030901556 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169868+0000", 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8254000000000003e-05 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169910+0000", 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2558000000000001e-05 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54065 4.6 4:616d4c41:::100000001f8.00000034:head [write 2146304~4096,write 2158592~4096,write 2187264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.140844+0000", 2024-04-19T03:38:10.318 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.094954548, 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029200618000000001, 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54065 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140844+0000", 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140844+0000", 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140843+0000", 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140855+0000", 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2313999999999999e-05 2024-04-19T03:38:10.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140866+0000", 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0947e-05 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140872+0000", 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0179999999999998e-06 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140920+0000", 2024-04-19T03:38:10.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7286000000000001e-05 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140990+0000", 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0419000000000005e-05 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141081+0000", 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1089999999999997e-05 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143605+0000", 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002523642 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169955+0000", 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026350022000000001 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170001+0000", 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6521999999999999e-05 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170045+0000", 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3271e-05 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54066 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 2416640~4096,write 2498560~4096,write 2555904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.141260+0000", 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.0945388110000001, 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025163710999999998, 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.324 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54066 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141260+0000", 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141260+0000", 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141259+0000", 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141279+0000", 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0254e-05 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141293+0000", 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3570999999999999e-05 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141300+0000", 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.686e-06 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141344+0000", 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4765999999999998e-05 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141410+0000", 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5747000000000006e-05 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141503+0000", 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3043999999999999e-05 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143219+0000", 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017162589999999999 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.166334+0000", 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023114253000000001 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.166384+0000", 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0837999999999997e-05 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.166423+0000", 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9023999999999998e-05 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54067 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3268608~4096,write 3432448~4096,write 3526656~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.141641+0000", 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.0941570430000001, 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023082776999999999, 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54067 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141641+0000", 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141641+0000", 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141641+0000", 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141659+0000", 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.874e-05 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141673+0000", 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3658999999999999e-05 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141681+0000", 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5719999999999997e-06 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141731+0000", 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0760000000000002e-05 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141821+0000", 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0008999999999998e-05 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141995+0000", 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017346399999999999 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143649+0000", 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016546569999999999 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.164666+0000", 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021016215000000001 2024-04-19T03:38:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.164698+0000", 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2466999999999999e-05 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.164724+0000", 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6134000000000001e-05 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.335 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54070 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3489792~4096,write 3551232~4096,write 3563520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.143397+0000", 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.0924011950000001, 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026651078000000002, 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54070 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143397+0000", 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143397+0000", 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143396+0000", 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143412+0000", 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5991e-05 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143426+0000", 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3288999999999999e-05 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143434+0000", 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3250000000000008e-06 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143484+0000", 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9960999999999998e-05 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143565+0000", 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1316000000000005e-05 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143721+0000", 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015538699999999999 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146967+0000", 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032463650000000002 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169963+0000", 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022996248 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170004+0000", 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0404000000000001e-05 2024-04-19T03:38:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170048+0000", 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681999999999997e-05 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54074 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1908736~4096,write 2121728~4096,write 2330624~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.145025+0000", 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.090773422, 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025112941, 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54074 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145025+0000", 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145025+0000", 2024-04-19T03:38:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145024+0000", 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145035+0000", 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1029000000000001e-05 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145044+0000", 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6430000000000001e-06 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145055+0000", 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145101+0000", 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5534000000000001e-05 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145157+0000", 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6178000000000003e-05 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145281+0000", 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012469900000000001 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.148859+0000", 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035774140000000001 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170083+0000", 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021224549999999998 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170116+0000", 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3077999999999997e-05 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170138+0000", 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1559000000000001e-05 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.346 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54078 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1253376~4096,write 1654784~4096,write 1703936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.146554+0000", 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.089244098, 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023670979000000002, 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54078 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.347 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146554+0000", 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146554+0000", 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146554+0000", 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:10.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146576+0000", 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2035000000000002e-05 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146588+0000", 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2026e-05 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146597+0000", 2024-04-19T03:38:10.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4229999999999994e-06 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146981+0000", 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038384500000000001 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.147046+0000", 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5204999999999997e-05 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:10.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.147156+0000", 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110178 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.149514+0000", 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023579909999999998 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170173+0000", 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020658267000000001 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170201+0000", 2024-04-19T03:38:10.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8377999999999998e-05 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170225+0000", 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4413000000000002e-05 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:10.352 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:10.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:10.355 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:10.352+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:10.431 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:10.454 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:10.453+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:10.455 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:10.458 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:10.459 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:10.529 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:10.529 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:10.542 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:10.586 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:10.585+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:10.657 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:10.656+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:10.711 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:10.711 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:10.722 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:10.763 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:10.762+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:10.859 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:10.857+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:10.943 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:10.944 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:10.956 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:10.959 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:10.958+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:11.060 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:11.059+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:11.161 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:11.160+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:11.170 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:11.170 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:11.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:11.262 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:11.261+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:11.363 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:11.362+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:11.370 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:38:11.394 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:11.394 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:11.410 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:11.465 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:11.464+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:11.565 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:11.565+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:11.657 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:11.658 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:11.667 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:11.666+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:11.675 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:11.767 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:11.766+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:11.845 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:11.845 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:11.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:11.868 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:11.867+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:11.969 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:11.968+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:12.070 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:12.069+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:12.077 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:12.078 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:12.092 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:12.172 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:12.171+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:12.271 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:12.271 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:12.272 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:12.271+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:12.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:12.373 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:12.372+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:12.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:12.473 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:12.472+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:12.490 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:12.506 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:12.574 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:12.573+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:12.660 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:12.675 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:12.674+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:12.685 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:12.689 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:12.690 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:12.755 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:12.755 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:12.755 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:12.755 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:12.755 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:12.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:12.776 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:12.775+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:12.877 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:12.876+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:12.978 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:12.976+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:13.026 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 133.15739142300001, 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020358338, 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.027 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865384+0000", 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865381+0000", 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2024-04-19T03:38:13.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865391+0000", 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0176999999999999e-05 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865402+0000", 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1355999999999999e-05 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865412+0000", 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0152e-05 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865494+0000", 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1471000000000007e-05 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865503+0000", 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319999999999992e-06 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876693+0000", 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011190617999999999 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876781+0000", 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7828e-05 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.876864+0000", 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3045000000000002e-05 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882037+0000", 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005172261 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885648+0000", 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036111400000000001 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885700+0000", 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2565000000000002e-05 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.885742+0000", 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1916999999999999e-05 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 133.15715042299999, 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024757934999999998, 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.033 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865625+0000", 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865624+0000", 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865629+0000", 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865636+0000", 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865641+0000", 2024-04-19T03:38:13.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5029999999999997e-06 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865667+0000", 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6406000000000001e-05 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.865670+0000", 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6690000000000002e-06 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877396+0000", 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01172605 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877467+0000", 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0368000000000001e-05 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.877564+0000", 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7034999999999995e-05 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.882999+0000", 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054352089999999999 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890288+0000", 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072889779999999998 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890338+0000", 2024-04-19T03:38:13.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0081999999999999e-05 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:35:59.890383+0000", 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54026 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 606208~4096,write 720896~4096,write 778240~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.125173+0000", 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.897602, 2024-04-19T03:38:13.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026333255, 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54026 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125173+0000", 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125173+0000", 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125173+0000", 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125185+0000", 2024-04-19T03:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2237e-05 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125197+0000", 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2116999999999999e-05 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125209+0000", 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1671000000000001e-05 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125251+0000", 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1947999999999999e-05 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125343+0000", 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2378000000000002e-05 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125552+0000", 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020906000000000001 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.130960+0000", 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054076990000000002 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.151404+0000", 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020444599000000001 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.151459+0000", 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4293999999999999e-05 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.151507+0000", 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8015e-05 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54027 4.6 4:63e80496:::100000001f8.0000001e:head [write 1359872~4096,write 1564672~4096,write 1572864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.125637+0000", 2024-04-19T03:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8971383529999999, 2024-04-19T03:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.027756184999999999, 2024-04-19T03:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54027 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125637+0000", 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125637+0000", 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125636+0000", 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125651+0000", 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4798e-05 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125663+0000", 2024-04-19T03:38:13.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1977000000000001e-05 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.125671+0000", 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2239999999999995e-06 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.126904+0000", 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001232908 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.126994+0000", 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0319e-05 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.127186+0000", 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019227400000000001 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132389+0000", 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052029859999999997 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153327+0000", 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020937541 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153369+0000", 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2491999999999999e-05 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153393+0000", 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3693000000000002e-05 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54035 4.6 4:63e80496:::100000001f8.0000001e:head [write 253952~4096,write 385024~4096,write 593920~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.128913+0000", 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8938628020000001, 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025089283, 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.052 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54035 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128913+0000", 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128913+0000", 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128911+0000", 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128927+0000", 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6015000000000002e-05 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128942+0000", 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5021999999999999e-05 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.128951+0000", 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2449999999999998e-06 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129234+0000", 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028331800000000001 2024-04-19T03:38:13.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129329+0000", 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4717999999999997e-05 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129429+0000", 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9989999999999996e-05 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132400+0000", 2024-04-19T03:38:13.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029711970000000001 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153948+0000", 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021548419999999999 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.153980+0000", 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1813999999999997e-05 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.154002+0000", 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1631e-05 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54036 4.6 4:616d4c41:::100000001f8.00000034:head [write 2592768~4096,write 2678784~4096,write 2707456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.129240+0000", 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8935357430000002, 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026165395000000001, 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54036 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129240+0000", 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129240+0000", 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129239+0000", 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129256+0000", 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7020999999999998e-05 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129267+0000", 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1348e-05 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.129281+0000", 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4408e-05 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.130976+0000", 2024-04-19T03:38:13.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001694341 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131038+0000", 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2612000000000003e-05 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131159+0000", 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012081100000000001 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133691+0000", 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002531817 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.155301+0000", 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021610032000000001 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.155368+0000", 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6860999999999996e-05 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.155405+0000", 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7211e-05 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54040 4.6 4:616d4c41:::100000001f8.00000034:head [write 278528~4096,write 356352~4096,write 475136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.131071+0000", 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8917039450000002, 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025075534, 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.064 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54040 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131071+0000", 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131071+0000", 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131070+0000", 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131088+0000", 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7961999999999998e-05 2024-04-19T03:38:13.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131102+0000", 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3451999999999999e-05 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.131110+0000", 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1040000000000007e-06 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132428+0000", 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013178829999999999 2024-04-19T03:38:13.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132499+0000", 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1214e-05 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.132593+0000", 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4352999999999996e-05 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.135822+0000", 2024-04-19T03:38:13.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032286369999999999 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.156089+0000", 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020266879000000002 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.156124+0000", 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4727000000000001e-05 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.156147+0000", 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3314000000000001e-05 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54046 4.28 4:153ae410:::100000001f8.0000003b:head [write 94208~4096,write 204800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.133622+0000", 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.889153651, 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024498025999999999, 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54046 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133622+0000", 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133622+0000", 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133621+0000", 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133634+0000", 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3509000000000001e-05 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133644+0000", 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6870000000000006e-06 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133651+0000", 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4839999999999998e-06 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133691+0000", 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9897000000000001e-05 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133769+0000", 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7350999999999999e-05 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133877+0000", 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108056 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.135482+0000", 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016051640000000001 2024-04-19T03:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.158062+0000", 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022579945000000001 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.158094+0000", 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1812e-05 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.158120+0000", 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5992000000000001e-05 2024-04-19T03:38:13.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54047 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1433600~4096,write 1454080~4096,write 1482752~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.133917+0000", 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.88885872, 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.032116025999999999, 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.076 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54047 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133917+0000", 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133917+0000", 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133916+0000", 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133931+0000", 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4703e-05 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133941+0000", 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0171e-05 2024-04-19T03:38:13.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.133950+0000", 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5049999999999996e-06 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.134004+0000", 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3912000000000002e-05 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.134111+0000", 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010645399999999999 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.134283+0000", 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000172881 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136306+0000", 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020221789999999998 2024-04-19T03:38:13.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.165946+0000", 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029640353000000001 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.165994+0000", 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8265e-05 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.166033+0000", 2024-04-19T03:38:13.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8345e-05 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54054 4.14 4:2b28d75f:::100000001f8.00000016:head [write 3936256~4096,write 3981312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.136606+0000", 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8861697550000001, 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026294872, 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.082 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54054 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136606+0000", 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136606+0000", 2024-04-19T03:38:13.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136605+0000", 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136617+0000", 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2619000000000001e-05 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136626+0000", 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136632+0000", 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8479999999999997e-06 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136674+0000", 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1859e-05 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136768+0000", 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3745000000000005e-05 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136914+0000", 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146551 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.138502+0000", 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00158753 2024-04-19T03:38:13.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.162807+0000", 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024305177000000001 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.162862+0000", 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4447000000000002e-05 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.162900+0000", 2024-04-19T03:38:13.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8859000000000002e-05 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54055 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1085440~4096,write 1114112~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.136840+0000", 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8859356869999999, 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.033070549999999997, 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54055 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136840+0000", 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136840+0000", 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136839+0000", 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136855+0000", 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6110999999999999e-05 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136864+0000", 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2750000000000001e-06 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136870+0000", 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1129999999999997e-06 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136902+0000", 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1661000000000001e-05 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.136957+0000", 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4449e-05 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.137068+0000", 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111702 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.138918+0000", 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001849601 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169819+0000", 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.030901556 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169868+0000", 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8254000000000003e-05 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169910+0000", 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2558000000000001e-05 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.093 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54065 4.6 4:616d4c41:::100000001f8.00000034:head [write 2146304~4096,write 2158592~4096,write 2187264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.140844+0000", 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8819313329999998, 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029200618000000001, 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54065 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.094 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140844+0000", 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140844+0000", 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140843+0000", 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140855+0000", 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2313999999999999e-05 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140866+0000", 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0947e-05 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140872+0000", 2024-04-19T03:38:13.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0179999999999998e-06 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140920+0000", 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7286000000000001e-05 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.140990+0000", 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0419000000000005e-05 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141081+0000", 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1089999999999997e-05 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143605+0000", 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002523642 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169955+0000", 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026350022000000001 2024-04-19T03:38:13.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170001+0000", 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6521999999999999e-05 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170045+0000", 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3271e-05 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54066 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 2416640~4096,write 2498560~4096,write 2555904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.141260+0000", 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8815155959999998, 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025163710999999998, 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54066 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141260+0000", 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141260+0000", 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141259+0000", 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141279+0000", 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0254e-05 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141293+0000", 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3570999999999999e-05 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141300+0000", 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.686e-06 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141344+0000", 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4765999999999998e-05 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141410+0000", 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5747000000000006e-05 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141503+0000", 2024-04-19T03:38:13.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3043999999999999e-05 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143219+0000", 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017162589999999999 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.166334+0000", 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023114253000000001 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.166384+0000", 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0837999999999997e-05 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.166423+0000", 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9023999999999998e-05 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.105 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54067 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3268608~4096,write 3432448~4096,write 3526656~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.141641+0000", 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8811338279999998, 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023082776999999999, 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54067 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141641+0000", 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141641+0000", 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141641+0000", 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141659+0000", 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.874e-05 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141673+0000", 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3658999999999999e-05 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141681+0000", 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5719999999999997e-06 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141731+0000", 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0760000000000002e-05 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141821+0000", 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0008999999999998e-05 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.141995+0000", 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017346399999999999 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143649+0000", 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016546569999999999 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.164666+0000", 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021016215000000001 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.164698+0000", 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2466999999999999e-05 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.164724+0000", 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6134000000000001e-05 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54070 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3489792~4096,write 3551232~4096,write 3563520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.143397+0000", 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8793779800000001, 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026651078000000002, 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.111 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54070 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143397+0000", 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143397+0000", 2024-04-19T03:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143396+0000", 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143412+0000", 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5991e-05 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143426+0000", 2024-04-19T03:38:13.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3288999999999999e-05 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143434+0000", 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3250000000000008e-06 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143484+0000", 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9960999999999998e-05 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143565+0000", 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1316000000000005e-05 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.143721+0000", 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015538699999999999 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146967+0000", 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032463650000000002 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.169963+0000", 2024-04-19T03:38:13.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022996248 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170004+0000", 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0404000000000001e-05 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170048+0000", 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681999999999997e-05 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54074 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1908736~4096,write 2121728~4096,write 2330624~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.145025+0000", 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8777502070000001, 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.025112941, 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54074 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145025+0000", 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145025+0000", 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145024+0000", 2024-04-19T03:38:13.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145035+0000", 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1029000000000001e-05 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145044+0000", 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6430000000000001e-06 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145055+0000", 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145101+0000", 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5534000000000001e-05 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145157+0000", 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6178000000000003e-05 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.145281+0000", 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012469900000000001 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.148859+0000", 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035774140000000001 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170083+0000", 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021224549999999998 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170116+0000", 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3077999999999997e-05 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170138+0000", 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1559000000000001e-05 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:54078 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1253376~4096,write 1654784~4096,write 1703936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:38:13.122 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:09.146554+0000", 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.8762208830000002, 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023670979000000002, 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54078 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146554+0000", 2024-04-19T03:38:13.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146554+0000", 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146554+0000", 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146576+0000", 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2035000000000002e-05 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146588+0000", 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2026e-05 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146597+0000", 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4229999999999994e-06 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.146981+0000", 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038384500000000001 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.147046+0000", 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5204999999999997e-05 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.147156+0000", 2024-04-19T03:38:13.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110178 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.149514+0000", 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023579909999999998 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170173+0000", 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020658267000000001 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170201+0000", 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8377999999999998e-05 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:09.170225+0000", 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4413000000000002e-05 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62178 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 823296~4096,write 1073152~4096,write 1175552~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:12.957857+0000", 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.064917924000000002, 2024-04-19T03:38:13.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.028206213000000001, 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62178 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.957857+0000", 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.957857+0000", 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.957857+0000", 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.957871+0000", 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.42e-05 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.957882+0000", 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0865e-05 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.957888+0000", 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2559999999999999e-06 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.959722+0000", 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001833681 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.959820+0000", 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8907999999999996e-05 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.959988+0000", 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167918 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.969405+0000", 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0094171359999999996 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.985963+0000", 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016557941999999999 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.986023+0000", 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9484000000000002e-05 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.986064+0000", 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0708999999999999e-05 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62190 4.6 4:616d4c41:::100000001f8.00000034:head [write 3219456~4096,write 3248128~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:12.962363+0000", 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.060412526000000001, 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023700279000000001, 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62190 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962363+0000", 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962363+0000", 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962362+0000", 2024-04-19T03:38:13.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962377+0000", 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4574e-05 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962389+0000", 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2145e-05 2024-04-19T03:38:13.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962397+0000", 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.963524+0000", 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011271149999999999 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.963607+0000", 2024-04-19T03:38:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2449999999999998e-05 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.963755+0000", 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014807199999999999 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.969413+0000", 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056583859999999996 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.985961+0000", 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016547890999999999 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.986020+0000", 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8956999999999998e-05 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.986063+0000", 2024-04-19T03:38:13.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2917000000000003e-05 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62191 4.6 4:616d4c41:::100000001f8.00000034:head [write 1716224~4096,write 1740800~4096,write 1769472~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:12.962612+0000", 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.060163266, 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023589632999999999, 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:13.140 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62191 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962612+0000", 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962612+0000", 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962611+0000", 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962636+0000", 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4658999999999999e-05 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962649+0000", 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2481e-05 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.962657+0000", 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4360000000000002e-06 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:13.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.967013+0000", 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043556039999999999 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.967099+0000", 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6708999999999999e-05 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.967254+0000", 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015494900000000001 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:13.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.969888+0000", 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026336490000000001 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.986116+0000", 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016228349999999999 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.986164+0000", 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7799000000000001e-05 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:13.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:12.986202+0000", 2024-04-19T03:38:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7642999999999999e-05 2024-04-19T03:38:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:13.146 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:13.146 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:13.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:13.148 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:13.146+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:13.248 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:13.247+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:13.327 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:13.327 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:13.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.327 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62892 4.6 e58/14)", 2024-04-19T03:38:13.327 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292382+0000", 2024-04-19T03:38:13.327 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020446196, 2024-04-19T03:38:13.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020467341999999999, 2024-04-19T03:38:13.327 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.327 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292382+0000", 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292382+0000", 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292381+0000", 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292395+0000", 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4168000000000001e-05 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292401+0000", 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5489999999999997e-06 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292406+0000", 2024-04-19T03:38:13.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9250000000000003e-06 2024-04-19T03:38:13.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.330 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.330 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62902 4.2c 4.a871486c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.330 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292798+0000", 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020029689, 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020104292999999999, 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62902 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292798+0000", 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292798+0000", 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292798+0000", 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292808+0000", 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0178e-05 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292814+0000", 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1310000000000003e-06 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292819+0000", 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9629999999999997e-06 2024-04-19T03:38:13.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.334 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.334 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.334 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62948 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3719168~4096 in=4096b,write 3874816~4096 in=4096b,write 3903488~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.334 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.301845+0000", 2024-04-19T03:38:13.334 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010982627, 2024-04-19T03:38:13.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011130480999999999, 2024-04-19T03:38:13.335 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.335 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:13.335 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.335 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.335 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.335 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62948 2024-04-19T03:38:13.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.335 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301845+0000", 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301845+0000", 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301845+0000", 2024-04-19T03:38:13.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301859+0000", 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4425e-05 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301867+0000", 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8490000000000006e-06 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301873+0000", 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301935+0000", 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2661000000000002e-05 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302020+0000", 2024-04-19T03:38:13.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4852999999999995e-05 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302170+0000", 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000149877 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306756+0000", 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045854379999999998 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.339 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:63002 4.36 e58/14)", 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.310740+0000", 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0020881459999999999, 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023113299999999999, 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310740+0000", 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310740+0000", 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310739+0000", 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310756+0000", 2024-04-19T03:38:13.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7481000000000001e-05 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310770+0000", 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3889e-05 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310777+0000", 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5209999999999999e-06 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62835 4.36 e58/14 4:6c9c34b1:::100000001f8.00000010:head v 58'2939, mlcod=58'2936)", 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.291847+0000", 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020980577, 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021252139999999999, 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291847+0000", 2024-04-19T03:38:13.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291847+0000", 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291847+0000", 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291869+0000", 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2234000000000001e-05 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291875+0000", 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0390000000000001e-06 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291880+0000", 2024-04-19T03:38:13.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0259999999999998e-06 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294520+0000", 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002639551 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294537+0000", 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7075000000000002e-05 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.347 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62869 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.347 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292394+0000", 2024-04-19T03:38:13.347 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020433756000000001, 2024-04-19T03:38:13.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020762371000000002, 2024-04-19T03:38:13.348 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.348 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.348 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.348 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.348 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.349 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62869 2024-04-19T03:38:13.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.349 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292394+0000", 2024-04-19T03:38:13.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292394+0000", 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292394+0000", 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292406+0000", 2024-04-19T03:38:13.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1943000000000001e-05 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292411+0000", 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7679999999999997e-06 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292416+0000", 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4989999999999996e-06 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62952 4.1c e58/14 4:39b842ef:::100000001f8.00000029:head v 58'1004, mlcod=58'1001)", 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292802+0000", 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020025369000000001, 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020407247, 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292802+0000", 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292802+0000", 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292802+0000", 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292817+0000", 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5082999999999999e-05 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292822+0000", 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1710000000000001e-06 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292826+0000", 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1019999999999999e-06 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302739+0000", 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099125889999999994 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302757+0000", 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8016000000000002e-05 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62951 4.a 4:50194ce5:::100000001f8.00000027:head [write 2351104~4096 in=4096b,write 2498560~4096 in=4096b,write 2527232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.301883+0000", 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010944448000000001, 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011388525, 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.355 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62951 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301883+0000", 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301883+0000", 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301883+0000", 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301896+0000", 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3332e-05 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301908+0000", 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1895999999999999e-05 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301915+0000", 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1520000000000003e-06 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303848+0000", 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019327210000000001 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303934+0000", 2024-04-19T03:38:13.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6489000000000005e-05 2024-04-19T03:38:13.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.359 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.359 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.359 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63003 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.359 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.310738+0000", 2024-04-19T03:38:13.359 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0020897789999999999, 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025987549999999999, 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63003 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310738+0000", 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310738+0000", 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310737+0000", 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310765+0000", 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7515999999999999e-05 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310774+0000", 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0100000000000001e-06 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310782+0000", 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.038e-06 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.362 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62844 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 126976~4096 in=4096b,write 208896~4096 in=4096b,write 262144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.291870+0000", 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020957670000000001, 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021525530000000001, 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62844 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291870+0000", 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291870+0000", 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291870+0000", 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291883+0000", 2024-04-19T03:38:13.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3701e-05 2024-04-19T03:38:13.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291891+0000", 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8159999999999994e-06 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291896+0000", 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3510000000000001e-06 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303902+0000", 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012005541 2024-04-19T03:38:13.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303988+0000", 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6178000000000001e-05 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62895 4.36 e58/14)", 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292410+0000", 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020418003000000001, 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021047720999999998, 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.367 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292410+0000", 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292410+0000", 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292409+0000", 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292420+0000", 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0886999999999999e-05 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292426+0000", 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292432+0000", 2024-04-19T03:38:13.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3619999999999997e-06 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62903 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 397312~4096 in=4096b,write 512000~4096 in=4096b,write 659456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292823+0000", 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020004497, 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020687533000000001, 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.370 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62903 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292823+0000", 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292823+0000", 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292823+0000", 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292835+0000", 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1785e-05 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292841+0000", 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0909999999999998e-06 2024-04-19T03:38:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292845+0000", 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6140000000000002e-06 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308718+0000", 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015872811000000001 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308789+0000", 2024-04-19T03:38:13.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0816999999999996e-05 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62954 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.302258+0000", 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010569343, 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011359108, 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.374 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62954 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302258+0000", 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302258+0000", 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302258+0000", 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302280+0000", 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2265000000000001e-05 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302289+0000", 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3079999999999997e-06 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302300+0000", 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0618000000000001e-05 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63005 4.a 4:50194ce5:::100000001f8.00000027:head [write 2072576~4096 in=4096b,write 2207744~4096 in=4096b,write 2584576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.311622+0000", 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.001206113, 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020733209999999999, 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.377 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63005 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311622+0000", 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311622+0000", 2024-04-19T03:38:13.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311621+0000", 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311633+0000", 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2622e-05 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311643+0000", 2024-04-19T03:38:13.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4329999999999993e-06 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311650+0000", 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5460000000000003e-06 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311688+0000", 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7932000000000002e-05 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311761+0000", 2024-04-19T03:38:13.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2627999999999996e-05 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62838 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'956, mlcod=58'952)", 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.291885+0000", 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020943046999999999, 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021913702, 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291885+0000", 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291885+0000", 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291884+0000", 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291902+0000", 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7340999999999999e-05 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291907+0000", 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6899999999999997e-06 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291912+0000", 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7389999999999999e-06 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296529+0000", 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00461722 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296547+0000", 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7380999999999998e-05 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62871 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292420+0000", 2024-04-19T03:38:13.384 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020407980999999999, 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021456049000000001, 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62871 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292420+0000", 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292420+0000", 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292419+0000", 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292433+0000", 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3356999999999999e-05 2024-04-19T03:38:13.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292438+0000", 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0329999999999999e-06 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292442+0000", 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5399999999999997e-06 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62953 4.6 e58/14)", 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292830+0000", 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019997729999999998, 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021112822, 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292830+0000", 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292830+0000", 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292830+0000", 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292841+0000", 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1399e-05 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292846+0000", 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8930000000000004e-06 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292850+0000", 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1180000000000002e-06 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62957 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.390 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.302307+0000", 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010520397000000001, 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011697131, 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62957 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302307+0000", 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302307+0000", 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302307+0000", 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302319+0000", 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2723e-05 2024-04-19T03:38:13.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9890000000000003e-06 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302333+0000", 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:63004 4.19 e58/14 4:997b7129:::100000001f8.00000000:head v 58'1991, mlcod=58'1982)", 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.312113+0000", 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00071498299999999998, 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019574499999999999, 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312113+0000", 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312113+0000", 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312112+0000", 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312126+0000", 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3606e-05 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312134+0000", 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1009999999999992e-06 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312140+0000", 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5649999999999998e-06 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312532+0000", 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00039181900000000001 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312550+0000", 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629999999999999e-05 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62845 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.291902+0000", 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020925918000000002, 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022239483000000001, 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.397 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62845 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291902+0000", 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291902+0000", 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291901+0000", 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291914+0000", 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2583e-05 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291921+0000", 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9079999999999998e-06 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291926+0000", 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2569999999999998e-06 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62905 4.6 e58/14)", 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292436+0000", 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020391936999999999, 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021767420999999999, 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.400 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292436+0000", 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292436+0000", 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292436+0000", 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292455+0000", 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9199e-05 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292461+0000", 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1430000000000003e-06 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292467+0000", 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6250000000000004e-06 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62959 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.303777+0000", 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0090508159999999997, 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010483253, 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.403 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62959 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303777+0000", 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303777+0000", 2024-04-19T03:38:13.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303776+0000", 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303870+0000", 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4009000000000001e-05 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303880+0000", 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9539999999999999e-06 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303887+0000", 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5399999999999998e-06 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:63006 4.6 e58/14)", 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.312778+0000", 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.0183999999999999e-05, 2024-04-19T03:38:13.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001541361, 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312778+0000", 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312778+0000", 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312777+0000", 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312792+0000", 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.491e-05 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312800+0000", 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6209999999999993e-06 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312807+0000", 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4169999999999997e-06 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62840 4.36 e58/14 4:6da220e6:::100000001f8.0000003f:head v 58'2940, mlcod=58'2936)", 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.291917+0000", 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020911148000000001, 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022452547999999999, 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291917+0000", 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291917+0000", 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291916+0000", 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291931+0000", 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4222999999999999e-05 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291937+0000", 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8299999999999998e-06 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291942+0000", 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8250000000000004e-06 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.297084+0000", 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051414290000000003 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.297101+0000", 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6915999999999999e-05 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.412 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62956 4.3f e58/14 4:fde182c5:::100000001f8.00000039:head v 58'967, mlcod=58'964)", 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292854+0000", 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019973909000000001, 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021580162999999999, 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292854+0000", 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292854+0000", 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292854+0000", 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292867+0000", 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3233e-05 2024-04-19T03:38:13.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292872+0000", 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0860000000000001e-06 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292876+0000", 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.89e-06 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305740+0000", 2024-04-19T03:38:13.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012863914000000001 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305760+0000", 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0273999999999999e-05 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62960 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.303894+0000", 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0089338060000000007, 2024-04-19T03:38:13.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010604743, 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62960 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303894+0000", 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303894+0000", 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303893+0000", 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303911+0000", 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7445e-05 2024-04-19T03:38:13.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303919+0000", 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9570000000000002e-06 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303924+0000", 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5509999999999999e-06 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:63007 4.3f e58/14)", 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.313536+0000", 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9992919, 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001080896, 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313536+0000", 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313536+0000", 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313535+0000", 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313549+0000", 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4075e-05 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313560+0000", 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.043e-05 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313624+0000", 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3979000000000005e-05 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.422 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62843 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'957, mlcod=58'952)", 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.291953+0000", 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020874441000000001, 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022718552999999999, 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291953+0000", 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291953+0000", 2024-04-19T03:38:13.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291953+0000", 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291967+0000", 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4440000000000001e-05 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291974+0000", 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8460000000000002e-06 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291979+0000", 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7990000000000001e-06 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298210+0000", 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062310669999999999 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298229+0000", 2024-04-19T03:38:13.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9196999999999999e-05 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62908 4.19 e58/14 4:9a4319fb:::100000001f8.0000002a:head v 58'1984, mlcod=58'1982)", 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292471+0000", 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020357178, 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.02226421, 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292471+0000", 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292471+0000", 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292470+0000", 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292485+0000", 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4357e-05 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292491+0000", 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.652e-06 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292496+0000", 2024-04-19T03:38:13.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7180000000000004e-06 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293228+0000", 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00073153400000000005 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293248+0000", 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0231999999999999e-05 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.429 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62912 4.11 4.c6d22ad1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292878+0000", 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019949589, 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021917318000000002, 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.430 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62912 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292878+0000", 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292878+0000", 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292878+0000", 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292889+0000", 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1581e-05 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292895+0000", 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.682e-06 2024-04-19T03:38:13.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292900+0000", 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2959999999999998e-06 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62962 4.29 4.51b1e829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.303929+0000", 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0088984349999999997, 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010924802000000001, 2024-04-19T03:38:13.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62962 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303929+0000", 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303929+0000", 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303929+0000", 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303950+0000", 2024-04-19T03:38:13.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0857999999999999e-05 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303957+0000", 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0169999999999999e-06 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303963+0000", 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0390000000000001e-06 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.436 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63008 4.38 4.e1fdc8b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.313581+0000", 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9992466, 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00133175, 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63008 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.437 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313581+0000", 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313581+0000", 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313581+0000", 2024-04-19T03:38:13.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313594+0000", 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3195e-05 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313603+0000", 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9679999999999995e-06 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313609+0000", 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62846 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3901, mlcod=58'3896)", 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.291985+0000", 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020843200999999999, 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022993904999999999, 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291985+0000", 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291985+0000", 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291984+0000", 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291998+0000", 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3268000000000001e-05 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292003+0000", 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292007+0000", 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3139999999999997e-06 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296892+0000", 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048851040000000004 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296911+0000", 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8221000000000001e-05 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.443 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62881 4.11 4:893be98d:::100000001f8.00000001:head [write 1245184~4096 in=4096b,write 1257472~4096 in=4096b,write 1269760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292482+0000", 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020345427999999999, 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022575093000000001, 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.444 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62881 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292482+0000", 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292482+0000", 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292482+0000", 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292493+0000", 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1284000000000001e-05 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292499+0000", 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7459999999999997e-06 2024-04-19T03:38:13.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292504+0000", 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7400000000000004e-06 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308130+0000", 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015626546000000002 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308201+0000", 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0431000000000004e-05 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62964 4.2c 4.a871486c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.303968+0000", 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0088592199999999992, 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011158671, 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.448 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62964 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303968+0000", 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303968+0000", 2024-04-19T03:38:13.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303968+0000", 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303989+0000", 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1336e-05 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303998+0000", 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2940000000000006e-06 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304003+0000", 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4700000000000001e-06 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(client.4526.0:62841 4.2f e58/14)", 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.314423+0000", 2024-04-19T03:38:13.451 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.998404, 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075899400000000003, 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314423+0000", 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314423+0000", 2024-04-19T03:38:13.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314423+0000", 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314428+0000", 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8760000000000004e-06 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314436+0000", 2024-04-19T03:38:13.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5609999999999999e-06 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314443+0000", 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.562e-06 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62848 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3902, mlcod=58'3896)", 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292012+0000", 2024-04-19T03:38:13.454 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020816122999999999, 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023221223999999999, 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292012+0000", 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292012+0000", 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292011+0000", 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292025+0000", 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3833e-05 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292031+0000", 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5639999999999996e-06 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292036+0000", 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299185+0000", 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071494549999999999 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299201+0000", 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6367000000000001e-05 2024-04-19T03:38:13.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62913 4.19 e58/14 4:997b7129:::100000001f8.00000000:head v 58'1985, mlcod=58'1982)", 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292500+0000", 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020327685000000002, 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022794129999999999, 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292500+0000", 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292500+0000", 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292500+0000", 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292513+0000", 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2765000000000001e-05 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292518+0000", 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4929999999999998e-06 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292522+0000", 2024-04-19T03:38:13.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1860000000000002e-06 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294813+0000", 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022905489999999998 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294832+0000", 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9247000000000001e-05 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62920 4.35 4:af28909f:::100000001f8.0000001b:head [write 2711552~4096 in=4096b,write 2904064~4096 in=4096b,write 3289088~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292931+0000", 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019896268000000002, 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022433721, 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62920 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292931+0000", 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292931+0000", 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292931+0000", 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292943+0000", 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1571e-05 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292956+0000", 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292961+0000", 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1989999999999997e-06 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298506+0000", 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055448399999999997 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298577+0000", 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1262999999999999e-05 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62966 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304008+0000", 2024-04-19T03:38:13.465 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0088193820000000006, 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011431154000000001, 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62966 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304008+0000", 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304008+0000", 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304008+0000", 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304022+0000", 2024-04-19T03:38:13.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4307999999999999e-05 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304029+0000", 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3799999999999999e-06 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304034+0000", 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3079999999999998e-06 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63010 4.2c 4.a871486c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.314531+0000", 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9982967, 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00095465899999999995, 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63010 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314531+0000", 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314531+0000", 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314530+0000", 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314543+0000", 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2757e-05 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314551+0000", 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6500000000000002e-06 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314559+0000", 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1500000000000002e-06 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.471 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62847 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.291931+0000", 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020896929000000002, 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023597869, 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62847 2024-04-19T03:38:13.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291931+0000", 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291931+0000", 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291930+0000", 2024-04-19T03:38:13.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291942+0000", 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1812e-05 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292058+0000", 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115678 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292067+0000", 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6440000000000006e-06 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62882 4.2c 4:36128e15:::100000001f8.00000008:head [write 3911680~4096 in=4096b,write 3919872~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292508+0000", 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020319935000000001, 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023072664, 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.475 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62882 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292508+0000", 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292508+0000", 2024-04-19T03:38:13.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292507+0000", 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292519+0000", 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1291000000000001e-05 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292525+0000", 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4620000000000001e-06 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292530+0000", 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4449999999999998e-06 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308732+0000", 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016202174999999999 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308803+0000", 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1049000000000004e-05 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62921 4.c 4:33b8095f:::100000001f8.0000003a:head [write 1712128~4096 in=4096b,write 2043904~4096 in=4096b,write 2146304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292966+0000", 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019861713, 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022680611999999999, 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.479 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62921 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292966+0000", 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292966+0000", 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292966+0000", 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292978+0000", 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2565000000000001e-05 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292984+0000", 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9970000000000004e-06 2024-04-19T03:38:13.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292989+0000", 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9309999999999999e-06 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313964+0000", 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020974606 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.314045+0000", 2024-04-19T03:38:13.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1555000000000001e-05 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62967 4.2c 4.a871486c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304039+0000", 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0087883820000000008, 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01167702, 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.483 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62967 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304039+0000", 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304039+0000", 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304039+0000", 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304060+0000", 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0910000000000001e-05 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304066+0000", 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4699999999999999e-06 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304072+0000", 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2179999999999998e-06 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62858 4.3f e58/14 4:fde182c5:::100000001f8.00000039:head v 58'966, mlcod=58'964)", 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292039+0000", 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020788468000000001, 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023738938000000001, 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.486 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292039+0000", 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292039+0000", 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292039+0000", 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292055+0000", 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.609e-05 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292060+0000", 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2469999999999999e-06 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292065+0000", 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2169999999999996e-06 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302161+0000", 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010096353000000001 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302182+0000", 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1189e-05 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62914 4.2e e58/14)", 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292526+0000", 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020301533, 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023314122, 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292526+0000", 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292526+0000", 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292526+0000", 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292540+0000", 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3611000000000001e-05 2024-04-19T03:38:13.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292545+0000", 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4439999999999999e-06 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292550+0000", 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.492 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62922 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2424832~4096 in=4096b,write 2433024~4096 in=4096b,write 2482176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292994+0000", 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019834073000000001, 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022902790999999999, 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62922 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292994+0000", 2024-04-19T03:38:13.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292994+0000", 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292993+0000", 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293006+0000", 2024-04-19T03:38:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2498e-05 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293013+0000", 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8000000000000001e-06 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293018+0000", 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4820000000000002e-06 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313767+0000", 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020748570000000001 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313841+0000", 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4098999999999996e-05 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62969 4.2c 4.a871486c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304076+0000", 2024-04-19T03:38:13.496 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0087512530000000005, 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011890950000000001, 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62969 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304076+0000", 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304076+0000", 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304076+0000", 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304092+0000", 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6059999999999999e-05 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304098+0000", 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4289999999999998e-06 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304104+0000", 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4149999999999998e-06 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62860 4.6 e58/14 4:63e80496:::100000001f8.0000001e:head v 58'3903, mlcod=58'3896)", 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292070+0000", 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020757871000000001, 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023934183000000001, 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292070+0000", 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292070+0000", 2024-04-19T03:38:13.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292070+0000", 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292087+0000", 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7068e-05 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292092+0000", 2024-04-19T03:38:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1900000000000003e-06 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292096+0000", 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8859999999999997e-06 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301035+0000", 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0089391009999999996 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301051+0000", 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6288000000000001e-05 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62885 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292534+0000", 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020294133999999998, 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023530552999999999, 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.503 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62885 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292534+0000", 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292534+0000", 2024-04-19T03:38:13.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292533+0000", 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292543+0000", 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0196e-05 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292548+0000", 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9289999999999997e-06 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292553+0000", 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5920000000000002e-06 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62925 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.506 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.293024+0000", 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019804058999999999, 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023126612000000001, 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62925 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293024+0000", 2024-04-19T03:38:13.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293024+0000", 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293023+0000", 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293035+0000", 2024-04-19T03:38:13.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1612e-05 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293041+0000", 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9660000000000001e-06 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293047+0000", 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.801e-06 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.509 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62970 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304109+0000", 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0087191439999999999, 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012109463000000001, 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62970 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.510 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304109+0000", 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304109+0000", 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304108+0000", 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304126+0000", 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304134+0000", 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4000000000000003e-06 2024-04-19T03:38:13.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304139+0000", 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2510000000000002e-06 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62850 4.2c 4:36128e15:::100000001f8.00000008:head [write 2965504~4096 in=4096b,write 3379200~4096 in=4096b,write 3751936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292075+0000", 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020752841000000001, 2024-04-19T03:38:13.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024216564999999999, 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62850 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292075+0000", 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292075+0000", 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292074+0000", 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292091+0000", 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6915e-05 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292100+0000", 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8070000000000006e-06 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292117+0000", 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7300999999999999e-05 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307146+0000", 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015029231000000001 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307231+0000", 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4691999999999995e-05 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62887 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 471040~4096 in=4096b,write 548864~4096 in=4096b,write 704512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292557+0000", 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020270295000000001, 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023817313999999999, 2024-04-19T03:38:13.517 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62887 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292557+0000", 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292557+0000", 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292557+0000", 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292567+0000", 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0088000000000001e-05 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292573+0000", 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7540000000000003e-06 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292577+0000", 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.352e-06 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294066+0000", 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0014885880000000001 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294160+0000", 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4158000000000002e-05 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294305+0000", 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014456899999999999 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308706+0000", 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014400926 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.521 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62927 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.293052+0000", 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019775530999999999, 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023419623000000001, 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62927 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.522 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293052+0000", 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293052+0000", 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293052+0000", 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293062+0000", 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0335e-05 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294571+0000", 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001509182 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294580+0000", 2024-04-19T03:38:13.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2439999999999993e-06 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62974 4.11 4.b197dc91 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304144+0000", 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0086835300000000001, 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012392066, 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.525 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62974 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304144+0000", 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304144+0000", 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304144+0000", 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304160+0000", 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6759e-05 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304167+0000", 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6030000000000001e-06 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304173+0000", 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6559999999999997e-06 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62861 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1014, mlcod=58'1011)", 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292099+0000", 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020728468999999999, 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024502790999999999, 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.528 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292099+0000", 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292099+0000", 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292099+0000", 2024-04-19T03:38:13.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292113+0000", 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.438e-05 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292119+0000", 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4859999999999997e-06 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292123+0000", 2024-04-19T03:38:13.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.544e-06 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293181+0000", 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001057833 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.293199+0000", 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7541999999999999e-05 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.531 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62915 4.1c e58/14 4:39b842ef:::100000001f8.00000029:head v 58'1003, mlcod=58'1001)", 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292554+0000", 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020274151000000001, 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024113763, 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292554+0000", 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292554+0000", 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292553+0000", 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292567+0000", 2024-04-19T03:38:13.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3539e-05 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292573+0000", 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6599999999999998e-06 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292578+0000", 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6970000000000001e-06 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301407+0000", 2024-04-19T03:38:13.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088288580000000002 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301426+0000", 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8819000000000001e-05 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62930 4.11 4.c6d22ad1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.294590+0000", 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.018238171000000001, 2024-04-19T03:38:13.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022143126999999999, 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62930 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294590+0000", 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294590+0000", 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294589+0000", 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294611+0000", 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2974999999999999e-05 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294621+0000", 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1789999999999997e-06 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294627+0000", 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1129999999999997e-06 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.538 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62978 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304177+0000", 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0086503199999999995, 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01261694, 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62978 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.539 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304177+0000", 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304177+0000", 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304177+0000", 2024-04-19T03:38:13.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304196+0000", 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9117999999999999e-05 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304202+0000", 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3389999999999998e-06 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304208+0000", 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3249999999999998e-06 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62851 4.38 4:1fc350da:::100000001f8.0000002f:head [write 1368064~4096 in=4096b,write 1708032~4096 in=4096b,write 2113536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292123+0000", 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020704576999999998, 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024739094999999999, 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.542 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62851 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292123+0000", 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292123+0000", 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292123+0000", 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292136+0000", 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3706000000000001e-05 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292143+0000", 2024-04-19T03:38:13.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9070000000000001e-06 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292149+0000", 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6289999999999998e-06 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292270+0000", 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012146600000000001 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292358+0000", 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8079999999999997e-05 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62889 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292582+0000", 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020245982999999999, 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024349829999999999, 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.546 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62889 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292582+0000", 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292582+0000", 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292581+0000", 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292592+0000", 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1049e-05 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292598+0000", 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292602+0000", 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3649999999999997e-06 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62933 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.294632+0000", 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.018195382999999999, 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022365135000000001, 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.549 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62933 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294632+0000", 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294632+0000", 2024-04-19T03:38:13.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294632+0000", 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294647+0000", 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939e-05 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294654+0000", 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2429999999999999e-06 2024-04-19T03:38:13.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294660+0000", 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6450000000000002e-06 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62982 4.29 4.51b1e829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304212+0000", 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0086154820000000007, 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012840663, 2024-04-19T03:38:13.552 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62982 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304212+0000", 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304212+0000", 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304212+0000", 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304228+0000", 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6518999999999999e-05 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304236+0000", 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5329999999999997e-06 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304240+0000", 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5920000000000002e-06 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62866 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'958, mlcod=58'952)", 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292134+0000", 2024-04-19T03:38:13.555 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020694094999999999, 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025045841999999999, 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292134+0000", 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292134+0000", 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292133+0000", 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292147+0000", 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.381e-05 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292153+0000", 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3550000000000004e-06 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292157+0000", 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4399999999999998e-06 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299130+0000", 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069728940000000003 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299146+0000", 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.558 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62916 4.28 e58/14 4:15eeb89b:::100000001f8.00000032:head v 58'1981, mlcod=58'1977)", 2024-04-19T03:38:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292583+0000", 2024-04-19T03:38:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020244964000000001, 2024-04-19T03:38:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024659642999999998, 2024-04-19T03:38:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292583+0000", 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292583+0000", 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292582+0000", 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292596+0000", 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292601+0000", 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1900000000000003e-06 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292606+0000", 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3039999999999998e-06 2024-04-19T03:38:13.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298177+0000", 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055715929999999997 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298197+0000", 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.016e-05 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62934 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.294665+0000", 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.018162728999999999, 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022642774000000001, 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62934 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294665+0000", 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294665+0000", 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294665+0000", 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294678+0000", 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3893999999999999e-05 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294686+0000", 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0949999999999998e-06 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294691+0000", 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2290000000000002e-06 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62985 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304245+0000", 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0085830330000000003, 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013122665, 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62985 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304245+0000", 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304245+0000", 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304244+0000", 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304261+0000", 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6416999999999999e-05 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304268+0000", 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8070000000000002e-06 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304272+0000", 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4360000000000004e-06 2024-04-19T03:38:13.570 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.075009814999999994, 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079617751, 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.571 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:13.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62890 4.35 4:af28909f:::100000001f8.0000001b:head [write 430080~4096 in=4096b,write 716800~4096 in=4096b,write 741376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292606+0000", 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020222121999999999, 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024932961, 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62890 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292606+0000", 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292606+0000", 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292605+0000", 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292615+0000", 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7429999999999997e-06 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292620+0000", 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9130000000000002e-06 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292624+0000", 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2189999999999998e-06 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.295253+0000", 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0026288539999999999 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.295325+0000", 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2466999999999996e-05 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62935 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.579 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.294695+0000", 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.018132246000000001, 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022927125999999999, 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62935 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294695+0000", 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294695+0000", 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294695+0000", 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294708+0000", 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3491e-05 2024-04-19T03:38:13.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294715+0000", 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5069999999999997e-06 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.294720+0000", 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1399999999999999e-06 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62987 4.a 4:50194ce5:::100000001f8.00000027:head [write 1507328~4096 in=4096b,write 1785856~4096 in=4096b,write 1847296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304276+0000", 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0085517609999999997, 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01342146, 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62987 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304276+0000", 2024-04-19T03:38:13.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304276+0000", 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304276+0000", 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304287+0000", 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1131999999999999e-05 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304293+0000", 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5810000000000002e-06 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304298+0000", 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4490000000000001e-06 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305468+0000", 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011698489999999999 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305560+0000", 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2602000000000005e-05 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.586 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62867 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3904, mlcod=58'3896)", 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292161+0000", 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020666712, 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025648466000000002, 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292161+0000", 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292161+0000", 2024-04-19T03:38:13.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292161+0000", 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292175+0000", 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4394e-05 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292181+0000", 2024-04-19T03:38:13.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292186+0000", 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0420000000000002e-06 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303427+0000", 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011240735999999999 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303444+0000", 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7209000000000001e-05 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62917 4.36 e58/14)", 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292610+0000", 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020218011000000001, 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025263607, 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.590 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292610+0000", 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292610+0000", 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292609+0000", 2024-04-19T03:38:13.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292622+0000", 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.253e-05 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292627+0000", 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0180000000000001e-06 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292631+0000", 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9020000000000001e-06 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62988 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304302+0000", 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0085255330000000001, 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013603733999999999, 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.593 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62988 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304302+0000", 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304302+0000", 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304302+0000", 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304318+0000", 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5869e-05 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304324+0000", 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6649999999999997e-06 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304329+0000", 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.437e-06 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62873 4.6 e58/14 4:63e80496:::100000001f8.0000001e:head v 58'3905, mlcod=58'3896)", 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292190+0000", 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020637987999999999, 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025748679999999999, 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292190+0000", 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292190+0000", 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292190+0000", 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292204+0000", 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4256999999999999e-05 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292209+0000", 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2750000000000003e-06 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292214+0000", 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6659999999999999e-06 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308342+0000", 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016128057000000001 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308360+0000", 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8556e-05 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62891 4.29 4:94178d8a:::100000001f8.00000006:head [write 3141632~4096 in=4096b,write 3149824~4096 in=4096b,write 3223552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292628+0000", 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020199915999999998, 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025386906000000001, 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62891 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.600 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292628+0000", 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292628+0000", 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292627+0000", 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292639+0000", 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1727e-05 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292646+0000", 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0910000000000004e-06 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292651+0000", 2024-04-19T03:38:13.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3699999999999997e-06 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313578+0000", 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020927628 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313663+0000", 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5041000000000001e-05 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62963 4.6 e58/14)", 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.295122+0000", 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.017705783999999999, 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022973285, 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.295122+0000", 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.295122+0000", 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.295121+0000", 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.295135+0000", 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3094e-05 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.295142+0000", 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.295148+0000", 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0310000000000004e-06 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62989 4.35 4:af28909f:::100000001f8.0000001b:head [write 352256~4096 in=4096b,write 360448~4096 in=4096b,write 397312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304492+0000", 2024-04-19T03:38:13.606 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0083358000000000008, 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01367119, 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62989 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304492+0000", 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304492+0000", 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304491+0000", 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304513+0000", 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1875e-05 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304525+0000", 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1764e-05 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304532+0000", 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.17e-06 2024-04-19T03:38:13.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.316213+0000", 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011681489999999999 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.316289+0000", 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5607999999999998e-05 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62854 4.29 4:94178d8a:::100000001f8.00000006:head [write 1052672~4096 in=4096b,write 1089536~4096 in=4096b,write 1171456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292196+0000", 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020631753999999999, 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.02605151, 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62854 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292196+0000", 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292196+0000", 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292195+0000", 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292209+0000", 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3162999999999999e-05 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292215+0000", 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5679999999999996e-06 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292221+0000", 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4879999999999998e-06 2024-04-19T03:38:13.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298620+0000", 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063989959999999997 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298698+0000", 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7931999999999999e-05 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62919 4.6 e58/14)", 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292635+0000", 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020192380999999999, 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025689829000000001, 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292635+0000", 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292635+0000", 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292635+0000", 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292648+0000", 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2492e-05 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292653+0000", 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9099999999999996e-06 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292657+0000", 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9480000000000001e-06 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62980 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1015, mlcod=58'1011)", 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304855+0000", 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0079726699999999994, 2024-04-19T03:38:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013518735, 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304855+0000", 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304855+0000", 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304854+0000", 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304876+0000", 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2228000000000001e-05 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304892+0000", 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5835e-05 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304899+0000", 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9909999999999996e-06 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308577+0000", 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003677521 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308598+0000", 2024-04-19T03:38:13.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0905999999999999e-05 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62874 4.6 e58/14 4:635f8cb4:::100000001f8.0000003c:head v 58'3906, mlcod=58'3896)", 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292218+0000", 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020609216, 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026215043, 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292218+0000", 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292218+0000", 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292218+0000", 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292232+0000", 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3628000000000001e-05 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292237+0000", 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0780000000000003e-06 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292241+0000", 2024-04-19T03:38:13.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.053e-06 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313565+0000", 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021324010000000001 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313584+0000", 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9021e-05 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62894 4.2c 4:36128e15:::100000001f8.00000008:head [write 147456~4096 in=4096b,write 217088~4096 in=4096b,write 270336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292655+0000", 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020172991000000001, 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025841676000000001, 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62894 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292655+0000", 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292655+0000", 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292654+0000", 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292665+0000", 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0229e-05 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292670+0000", 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1510000000000003e-06 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292674+0000", 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1400000000000002e-06 2024-04-19T03:38:13.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312390+0000", 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019716324 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312478+0000", 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7503000000000006e-05 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.628 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62983 4.28 e58/14 4:15eeb89b:::100000001f8.00000032:head v 58'1983, mlcod=58'1977)", 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.304905+0000", 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0079226899999999996, 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013659071, 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304905+0000", 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304905+0000", 2024-04-19T03:38:13.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304905+0000", 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304924+0000", 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9690999999999998e-05 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304930+0000", 2024-04-19T03:38:13.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.823e-06 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304935+0000", 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.118e-06 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305711+0000", 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077611200000000003 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305732+0000", 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0230000000000001e-05 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62856 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 3391488~4096 in=4096b,write 3477504~4096 in=4096b,write 3543040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292231+0000", 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020596718, 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026406285000000002, 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.632 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62856 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292231+0000", 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292231+0000", 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292230+0000", 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292243+0000", 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2731999999999999e-05 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292250+0000", 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7360000000000004e-06 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292256+0000", 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6720000000000001e-06 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301607+0000", 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0093516750000000003 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301699+0000", 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1590999999999998e-05 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.635 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62924 4.19 e58/14 4:997b7129:::100000001f8.00000000:head v 58'1986, mlcod=58'1982)", 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292660+0000", 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020168037, 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026044095, 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292660+0000", 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292660+0000", 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292660+0000", 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292672+0000", 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2605999999999999e-05 2024-04-19T03:38:13.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292677+0000", 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7609999999999998e-06 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292681+0000", 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6500000000000002e-06 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296746+0000", 2024-04-19T03:38:13.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004064954 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296765+0000", 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9480999999999999e-05 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62965 4.6 e58/14)", 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.297587+0000", 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.015240556000000001, 2024-04-19T03:38:13.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021175724, 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.297587+0000", 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.297587+0000", 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.297587+0000", 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.297598+0000", 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0762e-05 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.297601+0000", 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5930000000000002e-06 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.297605+0000", 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1810000000000001e-06 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62879 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'959, mlcod=58'952)", 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292245+0000", 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020583107999999999, 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026569531, 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.642 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292245+0000", 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292245+0000", 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292244+0000", 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292258+0000", 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4024e-05 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292265+0000", 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3060000000000003e-06 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292269+0000", 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5499999999999996e-06 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301414+0000", 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0091448020000000005 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301447+0000", 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3096000000000003e-05 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62897 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292677+0000", 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020150287999999999, 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026198111, 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62897 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292677+0000", 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292677+0000", 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292677+0000", 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292687+0000", 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7629999999999995e-06 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292692+0000", 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0329999999999999e-06 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292696+0000", 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1840000000000001e-06 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.648 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62940 4.11 4.3537c7d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.299672+0000", 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.013155629, 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019258773, 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62940 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299672+0000", 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299672+0000", 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299671+0000", 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299698+0000", 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6998000000000001e-05 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300867+0000", 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011694710000000001 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300878+0000", 2024-04-19T03:38:13.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0281e-05 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.070925377999999997, 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077095895999999997, 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.652 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62859 4.11 4:893be98d:::100000001f8.00000001:head [write 221184~4096 in=4096b,write 249856~4096 in=4096b,write 258048~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.656 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292261+0000", 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020566628, 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026828156999999998, 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62859 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292261+0000", 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292261+0000", 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292261+0000", 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292274+0000", 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3071000000000001e-05 2024-04-19T03:38:13.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292280+0000", 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3749999999999999e-06 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292286+0000", 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5210000000000002e-06 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300565+0000", 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082797319999999997 2024-04-19T03:38:13.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300645+0000", 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9234999999999996e-05 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62942 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.300886+0000", 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011941558, 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018268922999999999, 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.660 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62942 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300886+0000", 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300886+0000", 2024-04-19T03:38:13.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300885+0000", 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300913+0000", 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7282000000000001e-05 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300923+0000", 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0603e-05 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300930+0000", 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7279999999999998e-06 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.663 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62991 4.2c 4.faffd3ac (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.305483+0000", 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0073445969999999996, 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013725396000000001, 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62991 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305483+0000", 2024-04-19T03:38:13.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305483+0000", 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305482+0000", 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305509+0000", 2024-04-19T03:38:13.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6254999999999998e-05 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305521+0000", 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2179e-05 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305529+0000", 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7999999999999999e-06 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.666 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62880 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3907, mlcod=58'3896)", 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292273+0000", 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020554859000000002, 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026990468, 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292273+0000", 2024-04-19T03:38:13.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292273+0000", 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292273+0000", 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292286+0000", 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3088000000000001e-05 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292291+0000", 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5470000000000004e-06 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292296+0000", 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3359999999999997e-06 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318110+0000", 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025814024000000001 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318127+0000", 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7629e-05 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62898 4.11 4.b197dc91 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292700+0000", 2024-04-19T03:38:13.670 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020127873000000001, 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026619437999999999, 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62898 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292700+0000", 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292700+0000", 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292700+0000", 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292712+0000", 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2554999999999999e-05 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292717+0000", 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1719999999999998e-06 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292722+0000", 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3769999999999998e-06 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62992 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1016, mlcod=58'1011)", 2024-04-19T03:38:13.673 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.306520+0000", 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0063077410000000004, 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012860068000000001, 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306520+0000", 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306520+0000", 2024-04-19T03:38:13.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306519+0000", 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306538+0000", 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8915000000000001e-05 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306546+0000", 2024-04-19T03:38:13.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0730000000000005e-06 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306551+0000", 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1189999999999996e-06 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313721+0000", 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071691430000000002 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313739+0000", 2024-04-19T03:38:13.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8295999999999999e-05 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62863 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292291+0000", 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020536919000000001, 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027145288, 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62863 2024-04-19T03:38:13.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292291+0000", 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292291+0000", 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292290+0000", 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292303+0000", 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2870999999999999e-05 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292309+0000", 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6300000000000003e-06 2024-04-19T03:38:13.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292314+0000", 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0440000000000003e-06 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62926 4.19 e58/14 4:997b7129:::100000001f8.00000000:head v 58'1987, mlcod=58'1982)", 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292707+0000", 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020120315999999999, 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026784026999999998, 2024-04-19T03:38:13.680 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292707+0000", 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292707+0000", 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292707+0000", 2024-04-19T03:38:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292719+0000", 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292725+0000", 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.947e-06 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292729+0000", 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6399999999999999e-06 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298890+0000", 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006161616 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.298910+0000", 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9743000000000001e-05 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62971 4.3f e58/14 4:fde182c5:::100000001f8.00000039:head v 58'968, mlcod=58'964)", 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.301206+0000", 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011622120999999999, 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018345107999999999, 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301206+0000", 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301206+0000", 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301205+0000", 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301223+0000", 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8343e-05 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301232+0000", 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8089999999999999e-06 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301238+0000", 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6289999999999998e-06 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311005+0000", 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0097676369999999992 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0939999999999999e-05 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.069976997999999999, 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076765785000000003, 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.687 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:13.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62899 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 3571712~4096 in=4096b,write 3842048~4096 in=4096b,write 3919872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292726+0000", 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020101388000000001, 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026963332999999999, 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62899 2024-04-19T03:38:13.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292726+0000", 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292726+0000", 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292726+0000", 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292735+0000", 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4080000000000004e-06 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292740+0000", 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0860000000000001e-06 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292745+0000", 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0990000000000001e-06 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305714+0000", 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012969824 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.305794+0000", 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9833000000000006e-05 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.694 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62973 4.36 e58/14)", 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.301243+0000", 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011584209999999999, 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018519978999999999, 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301243+0000", 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301243+0000", 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301243+0000", 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301258+0000", 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5260999999999998e-05 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301266+0000", 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4170000000000003e-06 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301271+0000", 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:38:13.697 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62993 4.19 e58/14 4:997b7129:::100000001f8.00000000:head v 58'1989, mlcod=58'1982)", 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.306861+0000", 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0059671610000000003, 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012960365, 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306861+0000", 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306861+0000", 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306860+0000", 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306881+0000", 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0545000000000001e-05 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306886+0000", 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9760000000000003e-06 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.306889+0000", 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4039999999999999e-06 2024-04-19T03:38:13.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307034+0000", 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014477199999999999 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307050+0000", 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5925000000000001e-05 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62864 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292318+0000", 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020509485000000001, 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027575499999999999, 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62864 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292318+0000", 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292318+0000", 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292318+0000", 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292330+0000", 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2539e-05 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292336+0000", 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6609999999999997e-06 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292341+0000", 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7690000000000004e-06 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62929 4.28 e58/14 4:15eeb89b:::100000001f8.00000032:head v 58'1982, mlcod=58'1977)", 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292732+0000", 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020095833, 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027233225999999999, 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292732+0000", 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292732+0000", 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292732+0000", 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292743+0000", 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1368e-05 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292748+0000", 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292752+0000", 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.968e-06 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299601+0000", 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068492129999999998 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.299619+0000", 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7784000000000001e-05 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62976 4.19 e58/14 4:997b7129:::100000001f8.00000000:head v 58'1988, mlcod=58'1982)", 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.301276+0000", 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011551703, 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018768294000000001, 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.708 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301276+0000", 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301276+0000", 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301276+0000", 2024-04-19T03:38:13.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301289+0000", 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2975e-05 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301295+0000", 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0750000000000003e-06 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301299+0000", 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5639999999999998e-06 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302854+0000", 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015543620000000001 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302880+0000", 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6681000000000001e-05 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62994 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.307011+0000", 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0058166679999999997, 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013100215, 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62994 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307011+0000", 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307011+0000", 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307010+0000", 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307029+0000", 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8372999999999998e-05 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307038+0000", 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2359999999999993e-06 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.307045+0000", 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2699999999999999e-06 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.714 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62900 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 2035712~4096 in=4096b,write 2076672~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292748+0000", 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020079336999999999, 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027433645, 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62900 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.715 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292748+0000", 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292748+0000", 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292748+0000", 2024-04-19T03:38:13.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292758+0000", 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292763+0000", 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1680000000000003e-06 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292767+0000", 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3390000000000003e-06 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300353+0000", 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075857620000000002 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300438+0000", 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4691999999999995e-05 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.300577+0000", 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013897700000000001 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308745+0000", 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081678500000000008 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62977 4.1c e58/14 4:39b842ef:::100000001f8.00000029:head v 58'1005, mlcod=58'1001)", 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.301304+0000", 2024-04-19T03:38:13.719 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.01152393, 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018967411999999999, 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301304+0000", 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301304+0000", 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301304+0000", 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301315+0000", 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1953999999999999e-05 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301322+0000", 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1279999999999996e-06 2024-04-19T03:38:13.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301326+0000", 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.673e-06 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304359+0000", 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030328669999999999 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.304376+0000", 2024-04-19T03:38:13.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7255e-05 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62996 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.308066+0000", 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0047612610000000001, 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012265312, 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.723 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62996 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308066+0000", 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308066+0000", 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308066+0000", 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308088+0000", 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2818000000000001e-05 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308105+0000", 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6948000000000001e-05 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308114+0000", 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4689999999999997e-06 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62865 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3956736~4096 in=4096b,write 4067328~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292345+0000", 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020482396999999999, 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028043660000000002, 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.726 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62865 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292345+0000", 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292345+0000", 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292345+0000", 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292356+0000", 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1141000000000001e-05 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292361+0000", 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3170000000000001e-06 2024-04-19T03:38:13.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292366+0000", 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4689999999999999e-06 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303049+0000", 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010682931999999999 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.303162+0000", 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113348 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.729 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62936 4.6 e58/14)", 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292755+0000", 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020072768000000001, 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027700546999999999, 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292755+0000", 2024-04-19T03:38:13.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292755+0000", 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292755+0000", 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292766+0000", 2024-04-19T03:38:13.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1382999999999999e-05 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292771+0000", 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7210000000000002e-06 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292775+0000", 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.732e-06 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.732 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62995 4.19 e58/14 4:997b7129:::100000001f8.00000000:head v 58'1990, mlcod=58'1982)", 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.308278+0000", 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0045492400000000004, 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012226117999999999, 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308278+0000", 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308278+0000", 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308278+0000", 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308298+0000", 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0540999999999999e-05 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308308+0000", 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2210000000000003e-06 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308315+0000", 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7100000000000007e-06 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310981+0000", 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0026656449999999999 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311000+0000", 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9474999999999999e-05 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62841 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1044480~4096 in=4096b,write 1110016~4096 in=4096b,write 1150976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.291786+0000", 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021041316000000001, 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028782702, 2024-04-19T03:38:13.736 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62841 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291786+0000", 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291786+0000", 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291785+0000", 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291807+0000", 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2201999999999999e-05 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291818+0000", 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0991e-05 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291824+0000", 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6080000000000003e-06 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312045+0000", 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020221005 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312146+0000", 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010142800000000001 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.312316+0000", 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016965599999999999 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317480+0000", 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051634910000000001 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.740 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62888 4.6 e58/14)", 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292354+0000", 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020473414999999998, 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028291044000000001, 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292354+0000", 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292354+0000", 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292354+0000", 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292368+0000", 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.376e-05 2024-04-19T03:38:13.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292373+0000", 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3770000000000004e-06 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292378+0000", 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4220000000000002e-06 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.743 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62901 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292771+0000", 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020056569999999999, 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027931483, 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62901 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292771+0000", 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292771+0000", 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292771+0000", 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292783+0000", 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1728e-05 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292788+0000", 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5960000000000003e-06 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292793+0000", 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3569999999999997e-06 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62943 4.11 4.c6d22ad1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.301771+0000", 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011056554999999999, 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018984957, 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62943 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301771+0000", 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301771+0000", 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301771+0000", 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301791+0000", 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0443999999999999e-05 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301801+0000", 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8959999999999998e-06 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301808+0000", 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3849999999999996e-06 2024-04-19T03:38:13.749 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62997 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3547136~4096 in=4096b,write 3657728~4096 in=4096b,write 3784704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.308470+0000", 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0043574929999999996, 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012347375000000001, 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.750 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62997 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308470+0000", 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308470+0000", 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308469+0000", 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308485+0000", 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6118000000000001e-05 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308495+0000", 2024-04-19T03:38:13.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6339999999999996e-06 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.308502+0000", 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.199e-06 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.320640+0000", 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01213799 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.320724+0000", 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3257000000000006e-05 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62941 4.36 e58/14)", 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.292778+0000", 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020050005999999999, 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028102954999999999, 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.754 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292778+0000", 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292778+0000", 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292778+0000", 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292789+0000", 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.131e-05 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292794+0000", 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5999999999999997e-06 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292799+0000", 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1350000000000002e-06 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62944 4.11 4.b197dc91 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.301814+0000", 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011013472999999999, 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019116582999999999, 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.757 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62944 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301814+0000", 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301814+0000", 2024-04-19T03:38:13.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301814+0000", 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301826+0000", 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2799000000000001e-05 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301834+0000", 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5889999999999997e-06 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.301840+0000", 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0850000000000002e-06 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:63000 4.2d 4.9760552d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.309674+0000", 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.003154174, 2024-04-19T03:38:13.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011316912, 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 63000 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.309674+0000", 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.309674+0000", 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.309673+0000", 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.309697+0000", 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4207e-05 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.309716+0000", 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8915000000000001e-05 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.309724+0000", 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0080000000000002e-06 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 124 2024-04-19T03:38:13.763 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:13.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:38:13.766 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:13.766 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:13.764+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:13.865 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:13.864+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:13.967 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:13.965+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:13.991 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:13.991 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:13.991 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:14.007 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:14.067 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:14.066+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:14.168 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:14.168+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:14.193 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:14.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95808514199999995, 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:14.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:14.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.198 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95692980800000005, 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:14.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95549891200000003, 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.204 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:14.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:14.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:14.209 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95463594399999996, 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:14.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:14.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:14.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95420275200000004, 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95275471499999997, 2024-04-19T03:38:14.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:14.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:14.223 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95207954400000006, 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:14.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:14.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:14.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:14.228 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95058897399999998, 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:14.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95018686600000002, 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.236 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95014349200000003, 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:14.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:14.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:14.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:14.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.95011157700000004, 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:14.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.94867027800000003, 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:14.245 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:14.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:14.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:14.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.94841483900000001, 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.251 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:14.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:14.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.94772189799999995, 2024-04-19T03:38:14.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:14.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62831 4.36 e58/14 4:6fa85f86:::100000001f8.00000013:head v 58'2938, mlcod=58'2936)", 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.94672003500000002, 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074231808999999996, 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.260 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243852+0000", 2024-04-19T03:38:14.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243867+0000", 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4694e-05 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291730+0000", 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.047863307000000001 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291749+0000", 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9361999999999999e-05 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292182+0000", 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00043303999999999999 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292206+0000", 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3519999999999998e-05 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318066+0000", 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025860409000000001 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318084+0000", 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.806e-05 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:14.264 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.11098363, 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:14.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:14.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:14.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:14.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.110289786, 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.270 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:14.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:14.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:14.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:14.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.10988748499999999, 2024-04-19T03:38:14.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:14.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:14.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.280 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.107283631, 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.281 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.106924926, 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:14.286 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:14.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:14.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:14.291 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:14.291 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:14.293 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:14.291+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:14.293 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:38:14.394 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:14.393+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:14.495 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:14.494+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:14.502 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:14.502 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65641 4.6 4:63e80496:::100000001f8.0000001e:head [write 1740800~4096 in=4096b,write 1871872~4096 in=4096b,write 1970176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.490869+0000", 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0090027119999999995, 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090339400000000007, 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65641 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.490869+0000", 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.490869+0000", 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.490868+0000", 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.490882+0000", 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4113e-05 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.490893+0000", 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0812000000000001e-05 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.490899+0000", 2024-04-19T03:38:14.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6960000000000002e-06 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.494494+0000", 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035951070000000002 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.494588+0000", 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4265000000000006e-05 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.494821+0000", 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000233174 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499374+0000", 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045529389999999998 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65645 4.6 4:616d4c41:::100000001f8.00000034:head [write 4018176~4096 in=4096b,write 4046848~4096 in=4096b,write 4055040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.492439+0000", 2024-04-19T03:38:14.507 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.007433098, 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075811020000000002, 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65645 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492439+0000", 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492439+0000", 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492438+0000", 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492451+0000", 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2775000000000001e-05 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492461+0000", 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0596e-05 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492467+0000", 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8649999999999998e-06 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497004+0000", 2024-04-19T03:38:14.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045366470000000004 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497114+0000", 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110766 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497308+0000", 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019324000000000001 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65646 4.e 4:73e84e43:::100000001f8.00000004:head [write 786432~4096 in=4096b,write 1007616~4096 in=4096b,write 1077248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.492848+0000", 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0070232380000000002, 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072529350000000003, 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65646 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492848+0000", 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492848+0000", 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492847+0000", 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492867+0000", 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9262999999999998e-05 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492886+0000", 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9381e-05 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.492897+0000", 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0569e-05 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499232+0000", 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063354309999999999 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499326+0000", 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4006999999999996e-05 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65647 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4096 in=4096b,write 40960~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.515 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.493176+0000", 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0066961039999999996, 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070141969999999998, 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65647 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.493176+0000", 2024-04-19T03:38:14.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.493176+0000", 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.493175+0000", 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.493188+0000", 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3111e-05 2024-04-19T03:38:14.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.493198+0000", 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0437e-05 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.493213+0000", 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4858000000000001e-05 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499404+0000", 2024-04-19T03:38:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061910130000000004 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499482+0000", 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7866000000000003e-05 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499619+0000", 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702000000000001 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:65653 4.12 e59/14 4:4be51a30:::100000001f8.0000000b:head v 59'2088, mlcod=59'2086)", 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.495825+0000", 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0040469479999999999, 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048185570000000002, 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495825+0000", 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495825+0000", 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495824+0000", 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495839+0000", 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5398000000000001e-05 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495859+0000", 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9981000000000001e-05 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495867+0000", 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1699999999999997e-06 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495914+0000", 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6663999999999999e-05 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495932+0000", 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7839999999999999e-05 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65654 4.22 4:47e99c31:::100000001f8.00000025:head [write 57344~4096 in=4096b,write 188416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.495883+0000", 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0039886569999999996, 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004837521, 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.523 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65654 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495883+0000", 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495883+0000", 2024-04-19T03:38:14.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495882+0000", 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495897+0000", 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5274999999999999e-05 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495909+0000", 2024-04-19T03:38:14.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2201000000000001e-05 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495918+0000", 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3189999999999995e-06 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.495956+0000", 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8343999999999997e-05 2024-04-19T03:38:14.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.496069+0000", 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011324600000000001 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:65655 4.f e59/14 4:f0d983b2:::100000001f8.0000001f:head v 59'3095, mlcod=59'3093)", 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.496549+0000", 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.003322714, 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042510480000000003, 2024-04-19T03:38:14.527 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.496549+0000", 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.496549+0000", 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.496548+0000", 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.496565+0000", 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7014999999999999e-05 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.496574+0000", 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8130000000000002e-06 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.496581+0000", 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9319999999999999e-06 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.496646+0000", 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5078000000000003e-05 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.496674+0000", 2024-04-19T03:38:14.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7512999999999999e-05 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65658 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1015808~4096 in=4096b,write 1171456~4096 in=4096b,write 1417216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.497405+0000", 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0024667399999999998, 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034685889999999998, 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.531 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65658 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497405+0000", 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497405+0000", 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497404+0000", 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497419+0000", 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5690999999999999e-05 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497433+0000", 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3956e-05 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497443+0000", 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4329999999999993e-06 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497476+0000", 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2974e-05 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497527+0000", 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0985000000000001e-05 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.497619+0000", 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2516000000000007e-05 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:65659 4.23 e59/14 4:c6f90462:::100000001f8.00000037:head v 59'1030, mlcod=59'1028)", 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.498208+0000", 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001663538, 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0027420539999999998, 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.535 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498208+0000", 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498208+0000", 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498207+0000", 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498225+0000", 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7759999999999999e-05 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498238+0000", 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2629999999999999e-05 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498245+0000", 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6650000000000003e-06 2024-04-19T03:38:14.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498311+0000", 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5369000000000004e-05 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498335+0000", 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4596999999999998e-05 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:65656 4.f e59/14 4:f2a80dfe:::100000001f8.00000019:head v 59'3096, mlcod=59'3093)", 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.498322+0000", 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001549251, 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026907620000000002, 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498322+0000", 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498322+0000", 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498322+0000", 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498334+0000", 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2138e-05 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498343+0000", 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9269999999999994e-06 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498349+0000", 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3470000000000004e-06 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498916+0000", 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000566827 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498936+0000", 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9958000000000001e-05 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65661 4.13 4:caef1406:::100000001f8.00000031:head [write 3792896~4096 in=4096b,write 4059136~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.498643+0000", 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001228381, 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024388859999999999, 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.542 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65661 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498643+0000", 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498643+0000", 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498642+0000", 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498657+0000", 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4987000000000001e-05 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498675+0000", 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7606999999999999e-05 2024-04-19T03:38:14.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498683+0000", 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4409999999999993e-06 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498725+0000", 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2091000000000001e-05 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.498817+0000", 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1440999999999994e-05 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.545 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65663 4.24 4:27adda6e:::100000001f8.0000000f:head [write 3805184~4096 in=4096b,write 3854336~4096 in=4096b,write 4009984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.499512+0000", 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00036000799999999999, 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016450200000000001, 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.546 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65663 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499512+0000", 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499512+0000", 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499511+0000", 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499525+0000", 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3772e-05 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499536+0000", 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1527e-05 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499544+0000", 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1839999999999999e-06 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499587+0000", 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3214000000000003e-05 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499672+0000", 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4866999999999999e-05 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65664 4.2a 4:57147dc3:::100000001f8.00000011:head [write 3989504~4096 in=4096b,write 4034560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.499955+0000", 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9999166, 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001277916, 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65664 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499955+0000", 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499955+0000", 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499954+0000", 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499967+0000", 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.294e-05 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499982+0000", 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4630000000000001e-05 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.499990+0000", 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2870000000000004e-06 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500169+0000", 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000179047 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500256+0000", 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6759000000000001e-05 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65665 4.25 4:a76ff001:::100000001f8.0000002b:head [write 3661824~4096 in=4096b,write 3760128~4096 in=4096b,write 3780608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.500194+0000", 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9996777, 2024-04-19T03:38:14.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00113412, 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65665 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500194+0000", 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500194+0000", 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500193+0000", 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500213+0000", 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0163999999999999e-05 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500228+0000", 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4228e-05 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500236+0000", 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.687e-06 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500315+0000", 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8510000000000006e-05 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500397+0000", 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2583999999999994e-05 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65666 4.3 4:c222b65c:::100000001f8.00000021:head [write 2629632~4096 in=4096b,write 2674688~4096 in=4096b,write 2732032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.500633+0000", 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9992385, 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00078854900000000004, 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.557 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65666 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500633+0000", 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500633+0000", 2024-04-19T03:38:14.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500632+0000", 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500645+0000", 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3244000000000001e-05 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500658+0000", 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2503999999999999e-05 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.500672+0000", 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4341999999999999e-05 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.501338+0000", 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00066587199999999997 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:65667 4.25 4.800ff6e5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.501380+0000", 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9984913, 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012214100000000001, 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 65667 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:14.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.501380+0000", 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.501380+0000", 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.501379+0000", 2024-04-19T03:38:14.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.501394+0000", 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4645e-05 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.501405+0000", 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0988999999999999e-05 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:14.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.501413+0000", 2024-04-19T03:38:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5490000000000006e-06 2024-04-19T03:38:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:14.564 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 16 2024-04-19T03:38:14.564 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:14.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:14.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-04-19T03:38:14.609 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:14.608+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:14.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:14.696 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:14.695+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:14.771 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:14.771 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:14.771 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:14.771 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:14.771 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:14.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:14.797 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:14.796+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:14.888 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:14.898 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:14.897+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:14.912 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:14.912 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:14.913 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:14.916 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:14.916 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:14.999 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:14.998+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:15.038 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:15.038 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:15.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:15.100 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:15.099+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:15.200 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:15.200+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:15.228 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:15.228 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:15.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:15.301 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:15.300+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:15.402 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:15.401+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:15.455 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:15.456 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:15.469 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:15.513 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:15.512+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:15.604 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:15.603+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:15.641 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:15.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:15.705 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:15.703+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:15.806 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:15.804+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:15.848 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:15.848 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:15.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:15.906 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:15.905+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:16.008 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:16.007+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:16.108 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:16.107+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:16.118 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:16.118 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:16.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:16.210 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:16.209+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:16.311 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:16.310+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:16.384 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:16.384 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:16.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:38:16.403 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:16.412 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:16.411+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:16.513 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:16.512+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:16.582 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:16.582 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:16.597 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:16.614 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:16.613+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:16.716 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:16.714+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:16.816 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:16.815+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:16.817 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:16.817 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:16.833 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:16.917 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:16.916+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:16.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:17.018 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:17.017+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:17.019 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:17.019 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:17.033 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:17.106 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:17.119 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:17.118+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:17.129 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:17.130 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:17.130 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:17.130 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:17.133 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:17.134 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:17.219 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:17.218+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:17.257 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:17.257 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:17.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.257 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71517 4.e 4:73e84e43:::100000001f8.00000004:head [write 872448~4096 in=4096b,write 897024~4096 in=4096b,write 983040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.221947+0000", 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.031458380000000001, 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.031495111999999999, 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71517 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221947+0000", 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221947+0000", 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221946+0000", 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221962+0000", 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5829999999999999e-05 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221974+0000", 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1753000000000001e-05 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221982+0000", 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6039999999999993e-06 2024-04-19T03:38:17.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235429+0000", 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013446991 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235488+0000", 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8851999999999998e-05 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.261 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71571 4.27 4:e68799fb:::100000001f8.00000018:head [write 3174400~4096 in=4096b,write 3244032~4096 in=4096b,write 3260416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.245190+0000", 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0082158849999999992, 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083757320000000003, 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71571 2024-04-19T03:38:17.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245190+0000", 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245190+0000", 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245189+0000", 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245203+0000", 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4095e-05 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245213+0000", 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.005e-05 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245220+0000", 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9249999999999998e-06 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245359+0000", 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013891700000000001 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245455+0000", 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6199999999999994e-05 2024-04-19T03:38:17.265 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71519 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 106496~4096 in=4096b,write 131072~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.222670+0000", 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.030735182999999999, 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.030974833, 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.266 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71519 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.222670+0000", 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.222670+0000", 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.222670+0000", 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.222683+0000", 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3249e-05 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.222692+0000", 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2639999999999997e-06 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.222699+0000", 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8369999999999999e-06 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.237351+0000", 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.01465209 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.237425+0000", 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3517999999999996e-05 2024-04-19T03:38:17.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.237558+0000", 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133215 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241482+0000", 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039244409999999999 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71575 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.246442+0000", 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0069635779999999998, 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0072832019999999999, 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71575 2024-04-19T03:38:17.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246442+0000", 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246442+0000", 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246441+0000", 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246456+0000", 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4979e-05 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246467+0000", 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1547e-05 2024-04-19T03:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246476+0000", 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3639999999999999e-06 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71521 4.e 4:73e84e43:::100000001f8.00000004:head [write 798720~4096 in=4096b,write 999424~4096 in=4096b,write 1007616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.223312+0000", 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.030093568000000001, 2024-04-19T03:38:17.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.030475878000000001, 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71521 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.223312+0000", 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.223312+0000", 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.223311+0000", 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.223327+0000", 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.571e-05 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.223338+0000", 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1277999999999999e-05 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.223347+0000", 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3019999999999995e-06 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247338+0000", 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023991036 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247392+0000", 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4768999999999997e-05 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:71576 4.37 e59/14 4:ecbf0fb2:::100000001f8.00000038:head v 59'3336, mlcod=59'3334)", 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.247049+0000", 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.006356319, 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068079059999999999, 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247049+0000", 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247049+0000", 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247049+0000", 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247065+0000", 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082e-05 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247074+0000", 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.73e-06 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247082+0000", 2024-04-19T03:38:17.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247120+0000", 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8574e-05 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247142+0000", 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1852e-05 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71578 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.247486+0000", 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0059199359999999998, 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064364790000000002, 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71578 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247486+0000", 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247486+0000", 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247485+0000", 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247499+0000", 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4462e-05 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247510+0000", 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0657e-05 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247518+0000", 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1079999999999993e-06 2024-04-19T03:38:17.284 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:71581 4.f e59/14 4:f26fdfa9:::100000001f8.00000002:head v 59'3355, mlcod=59'3353)", 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.249552+0000", 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0038534530000000002, 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044255340000000001, 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249552+0000", 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249552+0000", 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249551+0000", 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249567+0000", 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5908000000000001e-05 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249580+0000", 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2439999999999999e-05 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249587+0000", 2024-04-19T03:38:17.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.435e-06 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249673+0000", 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6213999999999998e-05 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249694+0000", 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0842000000000001e-05 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:71546 4.2d e59/14 4:b7099a35:::100000001f8.0000000e:head v 59'2232, mlcod=59'2221)", 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.234851+0000", 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.018554269000000002, 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019189810000000002, 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.234851+0000", 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.234851+0000", 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.234851+0000", 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.234864+0000", 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3148e-05 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.234871+0000", 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0079999999999996e-06 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.234875+0000", 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4850000000000001e-06 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.243730+0000", 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0088551080000000004 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.243758+0000", 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7988e-05 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.292 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:71577 4.37 e59/14 4:ef395e89:::100000001f8.00000020:head v 59'3337, mlcod=59'3334)", 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.249673+0000", 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.003733129, 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004429901, 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249673+0000", 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249673+0000", 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249672+0000", 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249690+0000", 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8139999999999999e-05 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249700+0000", 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7739999999999999e-06 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.249708+0000", 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0879999999999995e-06 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250139+0000", 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043092500000000003 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250159+0000", 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.052e-05 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71549 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2187264~4096 in=4096b,write 2220032~4096 in=4096b,write 2269184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.296 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.235305+0000", 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.018100271000000001, 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018866523999999999, 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71549 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235305+0000", 2024-04-19T03:38:17.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235305+0000", 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235304+0000", 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235322+0000", 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7975e-05 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235336+0000", 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3851e-05 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235345+0000", 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1689999999999998e-06 2024-04-19T03:38:17.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.243364+0000", 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008018687 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.243447+0000", 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2841000000000002e-05 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.243570+0000", 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012355100000000001 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246761+0000", 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031908869999999999 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.301 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71550 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 720896~4096 in=4096b,write 765952~4096 in=4096b,write 778240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.235356+0000", 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.018049982999999999, 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018909367, 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.302 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71550 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235356+0000", 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235356+0000", 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235355+0000", 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235371+0000", 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5676e-05 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235380+0000", 2024-04-19T03:38:17.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3219999999999999e-06 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235387+0000", 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5610000000000004e-06 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246788+0000", 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011401105999999999 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246872+0000", 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3969999999999997e-05 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247083+0000", 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00021094899999999999 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.306 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:71584 4.f e59/14 4:f0d983b2:::100000001f8.0000001f:head v 59'3356, mlcod=59'3353)", 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.251788+0000", 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0016174850000000001, 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002561182, 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251788+0000", 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251788+0000", 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251787+0000", 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251802+0000", 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4802e-05 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251819+0000", 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6778000000000001e-05 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251829+0000", 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7419999999999992e-06 2024-04-19T03:38:17.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253458+0000", 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016293519999999999 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253479+0000", 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0615000000000002e-05 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.310 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71552 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 4104192~4096 in=4096b,write 4116480~4096 in=4096b,write 4124672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.235395+0000", 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.018010556, 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019028972000000002, 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71552 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.311 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235395+0000", 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235395+0000", 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235395+0000", 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235407+0000", 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2234e-05 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235416+0000", 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9649999999999997e-06 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235422+0000", 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3910000000000003e-06 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250280+0000", 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014857466 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250357+0000", 2024-04-19T03:38:17.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7078999999999998e-05 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250520+0000", 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016380799999999999 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71589 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.251802+0000", 2024-04-19T03:38:17.315 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0016035139999999999, 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002712211, 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71589 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251802+0000", 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251802+0000", 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251801+0000", 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251815+0000", 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3900000000000001e-05 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251824+0000", 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0739999999999999e-06 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251831+0000", 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9460000000000001e-06 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71553 4.25 4:a76ff001:::100000001f8.0000002b:head [write 417792~4096 in=4096b,write 499712~4096 in=4096b,write 606208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.235701+0000", 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.017704658000000002, 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018877999999999999, 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.319 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71553 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235701+0000", 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235701+0000", 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235700+0000", 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235714+0000", 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4088e-05 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235727+0000", 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2632e-05 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.235734+0000", 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5750000000000003e-06 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251328+0000", 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015593441 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.251410+0000", 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1972999999999996e-05 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71592 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.253039+0000", 2024-04-19T03:38:17.323 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00036665800000000001, 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001618015, 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71592 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253039+0000", 2024-04-19T03:38:17.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253039+0000", 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253038+0000", 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253056+0000", 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8389999999999998e-05 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253070+0000", 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3926e-05 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253078+0000", 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7309999999999993e-06 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71527 4.25 4:a76ff001:::100000001f8.0000002b:head [write 3858432~4096 in=4096b,write 3940352~4096 in=4096b,write 3969024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.225542+0000", 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.027863399, 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029182362, 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.327 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71527 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.225542+0000", 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.225542+0000", 2024-04-19T03:38:17.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.225541+0000", 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.225557+0000", 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6121e-05 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.225570+0000", 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2268e-05 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.225579+0000", 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4930000000000004e-06 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245215+0000", 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019635481999999999 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245325+0000", 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110345 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:71554 4.2d e59/14 4:b4aa06e9:::100000001f8.0000001d:head v 59'2233, mlcod=59'2221)", 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.236404+0000", 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.017001301999999999, 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018394635999999999, 2024-04-19T03:38:17.331 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236404+0000", 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236404+0000", 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236404+0000", 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236419+0000", 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5208000000000001e-05 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236431+0000", 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2483999999999999e-05 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236439+0000", 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.357e-06 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246307+0000", 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0098681729999999992 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246329+0000", 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1861999999999998e-05 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:71585 4.37 e59/14 4:ef395e89:::100000001f8.00000020:head v 59'3338, mlcod=59'3334)", 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.253308+0000", 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.7880000000000005e-05, 2024-04-19T03:38:17.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015673639999999999, 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253308+0000", 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253308+0000", 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253307+0000", 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253331+0000", 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3546000000000001e-05 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253345+0000", 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4790000000000001e-05 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253354+0000", 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.371e-06 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253445+0000", 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1502999999999994e-05 2024-04-19T03:38:17.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253467+0000", 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1747e-05 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:71588 4.2d e59/14 4:b7099a35:::100000001f8.0000000e:head v 59'2234, mlcod=59'2228)", 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.253361+0000", 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.4546999999999999e-05, 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00157873, 2024-04-19T03:38:17.339 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253361+0000", 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253361+0000", 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253361+0000", 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253373+0000", 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2112e-05 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253381+0000", 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0909999999999993e-06 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253386+0000", 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8180000000000003e-06 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253441+0000", 2024-04-19T03:38:17.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5566000000000003e-05 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.253464+0000", 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2823000000000002e-05 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71556 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 3088384~4096 in=4096b,write 3313664~4096 in=4096b,write 3424256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.236640+0000", 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0167653, 2024-04-19T03:38:17.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018371377000000001, 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71556 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236640+0000", 2024-04-19T03:38:17.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236640+0000", 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236640+0000", 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236652+0000", 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2078e-05 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236666+0000", 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4231e-05 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236672+0000", 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6590000000000001e-06 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250359+0000", 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013686775999999999 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250443+0000", 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3821999999999998e-05 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71595 4.22 4:47e99c31:::100000001f8.00000025:head [write 1572864~4096 in=4096b,write 1896448~4096 in=4096b,write 2039808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.254191+0000", 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9992142, 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090734099999999999, 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.348 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71595 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254191+0000", 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254191+0000", 2024-04-19T03:38:17.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254191+0000", 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254206+0000", 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254217+0000", 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1296e-05 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254225+0000", 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3459999999999994e-06 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254280+0000", 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5154000000000001e-05 2024-04-19T03:38:17.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254377+0000", 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6761000000000004e-05 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71557 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1769472~4096 in=4096b,write 1789952~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.236950+0000", 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.016455516, 2024-04-19T03:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018224580000000001, 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71557 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236950+0000", 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236950+0000", 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236949+0000", 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236961+0000", 2024-04-19T03:38:17.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1637000000000001e-05 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236970+0000", 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7080000000000003e-06 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.236977+0000", 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.289e-06 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250262+0000", 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013284976 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250358+0000", 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5674000000000006e-05 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250504+0000", 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146868 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.356 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71558 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 208896~4096 in=4096b,write 262144~4096 in=4096b,write 274432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.238299+0000", 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.015106694, 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016965566000000001, 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.357 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71558 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.238299+0000", 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.238299+0000", 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.238298+0000", 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.238316+0000", 2024-04-19T03:38:17.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.802e-05 2024-04-19T03:38:17.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.238327+0000", 2024-04-19T03:38:17.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0885e-05 2024-04-19T03:38:17.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.238334+0000", 2024-04-19T03:38:17.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.255e-06 2024-04-19T03:38:17.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254669+0000", 2024-04-19T03:38:17.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016334953999999999 2024-04-19T03:38:17.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254758+0000", 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8419999999999997e-05 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.254941+0000", 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000183349 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71565 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.240464+0000", 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.012941833999999999, 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014889395999999999, 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71565 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.240464+0000", 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.240464+0000", 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.240463+0000", 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.240474+0000", 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.062e-05 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.240482+0000", 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.240487+0000", 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5430000000000004e-06 2024-04-19T03:38:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71536 4.15 4:aada5e43:::100000001f8.00000028:head [write 2703360~4096 in=4096b,write 2740224~4096 in=4096b,write 2936832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.229032+0000", 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.024373873000000001, 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026386377999999999, 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71536 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.229032+0000", 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.229032+0000", 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.229031+0000", 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.229043+0000", 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2113000000000001e-05 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.229051+0000", 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.605e-06 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.229058+0000", 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8310000000000003e-06 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246803+0000", 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017745631000000001 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.246858+0000", 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4453999999999997e-05 2024-04-19T03:38:17.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.247070+0000", 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000212556 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.255198+0000", 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081279089999999991 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.255415+0000", 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000216562 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71513 4.6 4:616d4c41:::100000001f8.00000034:head [write 2310144~4096 in=4096b,write 2428928~4096 in=4096b,write 2969600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.221566+0000", 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.031839771000000003, 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.033966367999999997, 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:17.371 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71513 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221566+0000", 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221566+0000", 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221565+0000", 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221585+0000", 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0013e-05 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221597+0000", 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2310000000000001e-05 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.221606+0000", 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9069999999999996e-06 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.233352+0000", 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011745903 2024-04-19T03:38:17.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.233593+0000", 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000241167 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.233748+0000", 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015471199999999999 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241370+0000", 2024-04-19T03:38:17.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076218780000000003 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71541 4.25 4:a76ff001:::100000001f8.0000002b:head [write 2551808~4096 in=4096b,write 2666496~4096 in=4096b,write 2699264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.231073+0000", 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.022332939, 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024552155999999999, 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71541 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.231073+0000", 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.231073+0000", 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.231072+0000", 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.231088+0000", 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5990000000000001e-05 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.231101+0000", 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3423e-05 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.231109+0000", 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.14e-06 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.248486+0000", 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017376414 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.248578+0000", 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2899000000000006e-05 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71567 4.1c 4:39b842ef:::100000001f8.00000029:head [write 3276800~4096 in=4096b,write 3457024~4096 in=4096b,write 3518464~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.241525+0000", 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.011880999999999999, 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014147707000000001, 2024-04-19T03:38:17.381 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71567 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241525+0000", 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241525+0000", 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241524+0000", 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241542+0000", 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8005000000000001e-05 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241659+0000", 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117663 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241668+0000", 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245407+0000", 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037397849999999998 2024-04-19T03:38:17.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245497+0000", 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9761999999999999e-05 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245730+0000", 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023287399999999999 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.250171+0000", 2024-04-19T03:38:17.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044409599999999999 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:71568 4.34 4:2d2c9530:::100000001f8.00000036:head [write 2478080~4096 in=4096b,write 2580480~4096 in=4096b,write 2588672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:17.241735+0000", 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.011670167, 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014004519, 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.386 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 71568 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241735+0000", 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241735+0000", 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241735+0000", 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241748+0000", 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3889e-05 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241764+0000", 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5243e-05 2024-04-19T03:38:17.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.241771+0000", 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.763e-06 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245643+0000", 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038712659999999999 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:17.245715+0000", 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2372000000000004e-05 2024-04-19T03:38:17.389 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.390 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.390 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.390 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.390 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:17.390 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 31 2024-04-19T03:38:17.390 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:17.391 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:38:17.392 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:17.390+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:17.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:17.492 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:17.491+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:17.593 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:17.592+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:17.646 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:17.646 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:17.647 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:17.647 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:17.647 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:17.665 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:17.708 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:17.706+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:17.795 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:17.794+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:17.896 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:17.895+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:17.903 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62826 4.28 4:153ae410:::100000001f8.0000003b:head [write 2859008~4096,write 2879488~4096,write 2994176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6617198719999999, 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082994795999999996, 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.904 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62826 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238468+0000", 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238495+0000", 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6894999999999999e-05 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238509+0000", 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4479e-05 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238518+0000", 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5879999999999998e-06 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239736+0000", 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001217982 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239833+0000", 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7609999999999995e-05 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240012+0000", 2024-04-19T03:38:17.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017837300000000001 2024-04-19T03:38:17.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241924+0000", 2024-04-19T03:38:17.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019127059999999999 2024-04-19T03:38:17.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321356+0000", 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079431515999999994 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321413+0000", 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6657000000000003e-05 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321464+0000", 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1004999999999997e-05 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.909 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.910 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62827 4.14 4:2b28d75f:::100000001f8.00000016:head [write 2510848~4096,write 2531328~4096,write 2609152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.910 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:17.910 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6613219030000002, 2024-04-19T03:38:17.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078975696999999997, 2024-04-19T03:38:17.910 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.910 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.910 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62827 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:17.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238866+0000", 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238880+0000", 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4592e-05 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238891+0000", 2024-04-19T03:38:17.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866000000000001e-05 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238903+0000", 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1409e-05 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238947+0000", 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4249000000000003e-05 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239039+0000", 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1673000000000001e-05 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239193+0000", 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000154766 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241112+0000", 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001918248 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317726+0000", 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.076614071000000006 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317798+0000", 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2123e-05 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317842+0000", 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4651000000000003e-05 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.915 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62828 4.15 4:aada5e43:::100000001f8.00000028:head [write 3923968~4096,write 4173824~4096,write 4182016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6607995330000005, 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080658297000000004, 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62828 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239388+0000", 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239425+0000", 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239444+0000", 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8615e-05 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239454+0000", 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7319999999999993e-06 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239500+0000", 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6529000000000001e-05 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239594+0000", 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3849000000000002e-05 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239755+0000", 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000160636 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241461+0000", 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001706017 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.319969+0000", 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078508475999999994 2024-04-19T03:38:17.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320011+0000", 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1897999999999998e-05 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320047+0000", 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6257999999999997e-05 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62829 4.6 4:616d4c41:::100000001f8.00000034:head [write 278528~4096,write 290816~4096,write 315392~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6604769069999996, 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080406688000000004, 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62829 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239711+0000", 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239756+0000", 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5117000000000002e-05 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239767+0000", 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239773+0000", 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6749999999999999e-06 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239813+0000", 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0564e-05 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239873+0000", 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9837000000000003e-05 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240017+0000", 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014359799999999999 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247032+0000", 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070153300000000002 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320024+0000", 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.072991901999999997 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320075+0000", 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1644000000000002e-05 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320118+0000", 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3016000000000003e-05 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62830 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3342336~4096,write 3416064~4096,write 3444736~12288] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6596355349999996, 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079711315000000005, 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62830 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240552+0000", 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240572+0000", 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9324999999999999e-05 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240583+0000", 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1422e-05 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240591+0000", 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9300000000000003e-06 2024-04-19T03:38:17.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241899+0000", 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001307938 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241952+0000", 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3220999999999997e-05 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.242053+0000", 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010141000000000001 2024-04-19T03:38:17.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247058+0000", 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050044659999999999 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320176+0000", 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.073118060999999998 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320223+0000", 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7231000000000002e-05 2024-04-19T03:38:17.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320264+0000", 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1236000000000003e-05 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62831 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2031616~4096,write 2043904~4096,write 2138112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.658644765, 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078715436, 2024-04-19T03:38:17.933 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62831 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241543+0000", 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241558+0000", 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4491000000000001e-05 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241571+0000", 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3029e-05 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241579+0000", 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243598+0000", 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002019337 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243646+0000", 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8183999999999998e-05 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243736+0000", 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9691999999999994e-05 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248424+0000", 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046880960000000001 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320165+0000", 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071741299999999994 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320218+0000", 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2271000000000001e-05 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320259+0000", 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1777000000000003e-05 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.938 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6570083789999996, 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:17.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6543877580000004, 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:17.944 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6519443369999998, 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.950 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:17.955 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6511766919999999, 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:17.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:17.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62860 4.6 4:63e80496:::100000001f8.0000001e:head [write 3608576~4096,write 3649536~4096,write 4050944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6462282559999997, 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082270504999999994, 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62860 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253959+0000", 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253974+0000", 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4139e-05 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253993+0000", 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8955999999999999e-05 2024-04-19T03:38:17.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254001+0000", 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8130000000000002e-06 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254042+0000", 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0728e-05 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254096+0000", 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4147000000000002e-05 2024-04-19T03:38:17.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254218+0000", 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121736 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256573+0000", 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002355261 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336147+0000", 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079574000000000006 2024-04-19T03:38:17.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336193+0000", 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5881999999999999e-05 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336231+0000", 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7793999999999998e-05 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.966 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62867 4.6 4:616d4c41:::100000001f8.00000034:head [write 3358720~4096,write 3641344~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6433823959999998, 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079551001999999996, 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62867 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256805+0000", 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256820+0000", 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4856e-05 2024-04-19T03:38:17.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256834+0000", 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.344e-05 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256843+0000", 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7829999999999993e-06 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256891+0000", 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7704000000000003e-05 2024-04-19T03:38:17.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.257012+0000", 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012072499999999999 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.257176+0000", 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164554 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260920+0000", 2024-04-19T03:38:17.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037431470000000001 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336292+0000", 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.075372163000000006 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336325+0000", 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3182999999999997e-05 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336357+0000", 2024-04-19T03:38:17.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2391000000000002e-05 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.640584488, 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.972 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6378833650000004, 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:17.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:17.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62888 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2416640~4096,write 2445312~4096,write 2744320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6345612799999998, 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083295955000000005, 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62888 2024-04-19T03:38:17.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:17.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265662+0000", 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5512000000000002e-05 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265673+0000", 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0429e-05 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265678+0000", 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6779999999999997e-06 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265716+0000", 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7367000000000003e-05 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265773+0000", 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7500000000000002e-05 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265910+0000", 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013703700000000001 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268901+0000", 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029905539999999999 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348859+0000", 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079958414000000005 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348895+0000", 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5652999999999999e-05 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348923+0000", 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8603999999999999e-05 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62892 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3272704~4096,write 3305472~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6331319610000001, 2024-04-19T03:38:17.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.081941512999999994, 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62892 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267055+0000", 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267070+0000", 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4296e-05 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267083+0000", 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3451e-05 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267092+0000", 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9409999999999996e-06 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267331+0000", 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023835999999999999 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267390+0000", 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9388999999999997e-05 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267500+0000", 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109651 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.269522+0000", 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020223200000000002 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348951+0000", 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079429079999999999 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348979+0000", 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7572e-05 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348998+0000", 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.969e-05 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.993 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62895 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 4104192~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6319434810000004, 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080708229000000006, 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62895 2024-04-19T03:38:17.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268244+0000", 2024-04-19T03:38:17.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268263+0000", 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8410000000000002e-05 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268282+0000", 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9177999999999998e-05 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268291+0000", 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6260000000000001e-06 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268330+0000", 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9835000000000001e-05 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268409+0000", 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8597000000000007e-05 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268515+0000", 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105925 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.270754+0000", 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022391109999999998 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348876+0000", 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078122081999999995 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348917+0000", 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.104e-05 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348953+0000", 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6276000000000003e-05 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:17.999 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.7697878349999998, 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.004 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64817 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3067904~4096,write 3092480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130822+0000", 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.7693669779999999, 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078473251999999993, 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64817 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.005 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130822+0000", 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130822+0000", 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130821+0000", 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130835+0000", 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4105e-05 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130917+0000", 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1793999999999996e-05 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130927+0000", 2024-04-19T03:38:18.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0273e-05 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.174863+0000", 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.043935241999999999 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.174949+0000", 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6137000000000006e-05 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.175094+0000", 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014537900000000001 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.191295+0000", 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016200491000000001 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.209209+0000", 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017914195000000001 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.209252+0000", 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3263000000000002e-05 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.209295+0000", 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2830000000000002e-05 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64911 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 974848~4096,write 1024000~4096,write 1384448~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.7397472980000002, 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080437593000000002, 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64911 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160440+0000", 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160459+0000", 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8419000000000001e-05 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.161129+0000", 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00067022399999999997 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.161145+0000", 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727999999999999e-05 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218134+0000", 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.056989712999999997 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218224+0000", 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9463999999999996e-05 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218410+0000", 2024-04-19T03:38:18.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185985 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.231493+0000", 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013083347 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240797+0000", 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0093039620000000007 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:18.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240843+0000", 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6153999999999999e-05 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240879+0000", 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5769999999999998e-05 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.015 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:18.016 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:18.015+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:18.017 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:18.117 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:18.116+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:18.195 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:18.195 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:18.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.195 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:73550 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 700416~4096 in=4096b,write 786432~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.195 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:18.194483+0000", 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00062128400000000005, 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064016300000000002, 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 73550 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.194483+0000", 2024-04-19T03:38:18.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.194483+0000", 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.194482+0000", 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.194494+0000", 2024-04-19T03:38:18.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2126999999999999e-05 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.194506+0000", 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1935e-05 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.194514+0000", 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7449999999999995e-06 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.194553+0000", 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9255000000000003e-05 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.194643+0000", 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0362e-05 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.194764+0000", 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012012599999999999 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:73547 4.6 e60/14 4:635f8cb4:::100000001f8.0000003c:head v 60'4592, mlcod=60'4589)", 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:18.192808+0000", 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0022956420000000001, 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002362112, 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.192808+0000", 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.192808+0000", 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.192808+0000", 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.192822+0000", 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4483e-05 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.192833+0000", 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0343000000000001e-05 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.192840+0000", 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5580000000000003e-06 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.192863+0000", 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2449000000000001e-05 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:18.192874+0000", 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0930999999999999e-05 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 2 2024-04-19T03:38:18.203 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:18.210 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:18.255 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:18.254+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:18.319 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:18.318+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:18.390 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:18.390 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:18.390 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:18.390 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:18.390 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:18.407 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:18.422 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:18.421+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:18.521 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:18.520+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:18.622 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:18.621+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:18.638 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:18.638 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.4007449139999997, 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:18.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:18.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:18.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:18.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3995895799999998, 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:18.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3981586840000002, 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.649 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:18.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.654 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3972957160000004, 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:18.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:18.658 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3968625240000003, 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:18.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:18.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.663 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.395414487, 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3947393159999999, 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.669 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:18.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3932487460000003, 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.673 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:18.677 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.392846638, 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:18.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:18.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3928032640000003, 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.685 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3927713490000002, 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:18.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:18.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3913300499999997, 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.690 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:18.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3910746109999996, 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.39038167, 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.700 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:18.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:18.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62831 4.36 e58/14 4:6fa85f86:::100000001f8.00000013:head v 58'2938, mlcod=58'2936)", 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 5.3893798070000001, 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074231808999999996, 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243852+0000", 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243867+0000", 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4694e-05 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291730+0000", 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.047863307000000001 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291749+0000", 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9361999999999999e-05 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292182+0000", 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00043303999999999999 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292206+0000", 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3519999999999998e-05 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318066+0000", 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025860409000000001 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318084+0000", 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.806e-05 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5536434019999996, 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.709 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:18.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:18.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:18.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:18.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5529495579999999, 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.714 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:18.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:18.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.719 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5525472569999996, 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.720 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:18.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:18.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:18.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5499434030000003, 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:18.725 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:18.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.5495846980000003, 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.731 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:18.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:18.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:18.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:18.736 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:18.738 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:18.736+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:18.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:18.838 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:18.837+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:18.940 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:18.938+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:18.940 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:18.940 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75067 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 4128768~4096 in=4096b,write 4149248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.933509+0000", 2024-04-19T03:38:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0031453800000000001, 2024-04-19T03:38:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031749679999999998, 2024-04-19T03:38:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:18.941 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75067 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933509+0000", 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933509+0000", 2024-04-19T03:38:18.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933508+0000", 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933521+0000", 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2539e-05 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933543+0000", 2024-04-19T03:38:18.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1886999999999999e-05 2024-04-19T03:38:18.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933553+0000", 2024-04-19T03:38:18.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0716e-05 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933596+0000", 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2750000000000002e-05 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933677+0000", 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0542000000000002e-05 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75068 4.13 4:cbf33e86:::100000001f8.00000026:head [write 3780608~4096 in=4096b,write 4014080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.933569+0000", 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0030856289999999999, 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032063119999999998, 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75068 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933569+0000", 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933569+0000", 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933568+0000", 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933584+0000", 2024-04-19T03:38:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6303e-05 2024-04-19T03:38:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933594+0000", 2024-04-19T03:38:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9739999999999997e-06 2024-04-19T03:38:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933601+0000", 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5919999999999997e-06 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933854+0000", 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00025331399999999998 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933931+0000", 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6789e-05 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75070 4.19 4:997b7129:::100000001f8.00000000:head [write 327680~4096 in=4096b,write 344064~4096 in=4096b,write 430080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.933612+0000", 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0030425360000000002, 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032515719999999999, 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75070 2024-04-19T03:38:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933612+0000", 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933612+0000", 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933611+0000", 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933625+0000", 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3499999999999999e-05 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933633+0000", 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9470000000000003e-06 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933639+0000", 2024-04-19T03:38:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1099999999999999e-06 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933689+0000", 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0380999999999998e-05 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933780+0000", 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0501999999999995e-05 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933920+0000", 2024-04-19T03:38:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013977099999999999 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75071 4.13 4.617ccfd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.933829+0000", 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0028261100000000002, 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031051619999999999, 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75071 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933829+0000", 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933829+0000", 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933828+0000", 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933842+0000", 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3901e-05 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933853+0000", 2024-04-19T03:38:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1443999999999999e-05 2024-04-19T03:38:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933861+0000", 2024-04-19T03:38:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7649999999999993e-06 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:75069 4.2d e60/14 4:b4aa06e9:::100000001f8.0000001d:head v 60'2347, mlcod=60'2345)", 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.934083+0000", 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.002571444, 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028868000000000001, 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934083+0000", 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934083+0000", 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934083+0000", 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934095+0000", 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2473000000000001e-05 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934105+0000", 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6989999999999998e-06 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934112+0000", 2024-04-19T03:38:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.905e-06 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934934+0000", 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082259900000000003 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934956+0000", 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1744000000000001e-05 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:75074 4.f e60/14 4:f2a80dfe:::100000001f8.00000019:head v 60'3531, mlcod=60'3529)", 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.935288+0000", 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001366995, 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001735105, 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935288+0000", 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935288+0000", 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935287+0000", 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935298+0000", 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1437000000000001e-05 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935309+0000", 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944999999999999e-05 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935316+0000", 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5200000000000003e-06 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935374+0000", 2024-04-19T03:38:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8289999999999999e-05 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935397+0000", 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2711e-05 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75075 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 45056~4096 in=4096b,write 233472~4096 in=4096b,write 249856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.935253+0000", 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0014013179999999999, 2024-04-19T03:38:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001810016, 2024-04-19T03:38:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75075 2024-04-19T03:38:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935253+0000", 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935253+0000", 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935252+0000", 2024-04-19T03:38:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935290+0000", 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7932999999999997e-05 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935313+0000", 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2370000000000001e-05 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935321+0000", 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9289999999999998e-06 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935364+0000", 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3077000000000001e-05 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935443+0000", 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9770000000000004e-05 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.935599+0000", 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015515400000000001 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75077 4.22 4:47e99c31:::100000001f8.00000025:head [write 3674112~4096 in=4096b,write 3682304~4096 in=4096b,write 3768320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.936019+0000", 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00063560500000000002, 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001099044, 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75077 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936019+0000", 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936019+0000", 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936018+0000", 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936057+0000", 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8625999999999999e-05 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936068+0000", 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1112e-05 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936074+0000", 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9109999999999998e-06 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936120+0000", 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6455000000000002e-05 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936205+0000", 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4795000000000004e-05 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75078 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.936373+0000", 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00028199099999999999, 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083382499999999995, 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75078 2024-04-19T03:38:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936373+0000", 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936373+0000", 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936372+0000", 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936386+0000", 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3917000000000001e-05 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936396+0000", 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0688e-05 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.936405+0000", 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1070000000000005e-06 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75079 4.3d 4.b9df5cbd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.937121+0000", 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9995337, 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000163129, 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75079 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.937121+0000", 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.937121+0000", 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.937120+0000", 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.937137+0000", 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7223000000000001e-05 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.937153+0000", 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5858e-05 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.937162+0000", 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75052 4.6 4:63e80496:::100000001f8.0000001e:head [write 4145152~4096 in=4096b,write 4165632~4096 in=4096b,write 4190208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.926286+0000", 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.010368529, 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011073052, 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75052 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.926286+0000", 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.926286+0000", 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.926285+0000", 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.926300+0000", 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.465e-05 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.926314+0000", 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4347e-05 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.926323+0000", 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0820000000000005e-06 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.926422+0000", 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8752999999999995e-05 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.926496+0000", 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3817000000000002e-05 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.926689+0000", 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000192831 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.933329+0000", 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066403269999999997 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75054 4.6 4:616d4c41:::100000001f8.00000034:head [write 1970176~4096 in=4096b,write 2105344~4096 in=4096b,write 2154496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.927461+0000", 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0091931889999999992, 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010001136000000001, 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75054 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.927461+0000", 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.927461+0000", 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.927461+0000", 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.927474+0000", 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3164e-05 2024-04-19T03:38:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.927488+0000", 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4372999999999999e-05 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.927497+0000", 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7979999999999995e-06 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929559+0000", 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020619560000000002 2024-04-19T03:38:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929622+0000", 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2674000000000003e-05 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929778+0000", 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015660899999999999 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934736+0000", 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049579050000000003 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75057 4.32 4:4f726a0c:::100000001f8.00000012:head [write 1970176~4096 in=4096b,write 2101248~4096 in=4096b,write 2183168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.928564+0000", 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0080907830000000007, 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0090045560000000004, 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75057 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.928564+0000", 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.928564+0000", 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.928563+0000", 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.928577+0000", 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4253999999999999e-05 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.928590+0000", 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3274e-05 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.928599+0000", 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4740000000000005e-06 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929230+0000", 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000631272 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929329+0000", 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8921999999999999e-05 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75058 4.32 4:4f726a0c:::100000001f8.00000012:head [write 1552384~4096 in=4096b,write 1839104~4096 in=4096b,write 1916928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.929202+0000", 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0074528820000000001, 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0084686669999999992, 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75058 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929202+0000", 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929202+0000", 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929201+0000", 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929215+0000", 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3889e-05 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929226+0000", 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0925e-05 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929234+0000", 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.038e-06 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.931300+0000", 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020661799999999999 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.931388+0000", 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8088000000000001e-05 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75059 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3280896~4096 in=4096b,write 3403776~4096 in=4096b,write 3452928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.929300+0000", 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0073544830000000002, 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085010950000000002, 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75059 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929300+0000", 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:18.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929300+0000", 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929299+0000", 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:19.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929311+0000", 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1664e-05 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929321+0000", 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0305e-05 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929327+0000", 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9800000000000003e-06 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:19.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929376+0000", 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8662000000000003e-05 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929461+0000", 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4936000000000001e-05 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929611+0000", 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015008299999999999 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:19.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.934765+0000", 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051540559999999997 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75060 4.36 4:6fa85f86:::100000001f8.00000013:head [write 757760~4096 in=4096b,write 921600~4096 in=4096b,write 983040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.929677+0000", 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0069777850000000002, 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0082141160000000005, 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:19.003 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75060 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929677+0000", 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929677+0000", 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929676+0000", 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929689+0000", 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3305000000000001e-05 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929699+0000", 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9110000000000005e-06 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929708+0000", 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1810000000000007e-06 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929826+0000", 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011801 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.929900+0000", 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3652999999999994e-05 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930036+0000", 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013594599999999999 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75061 4.24 4:27adda6e:::100000001f8.0000000f:head [write 1978368~4096 in=4096b,write 2142208~4096 in=4096b,write 2981888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.930203+0000", 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0064518580000000004, 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0077692509999999996, 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:19.007 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75061 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930203+0000", 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:19.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930203+0000", 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930202+0000", 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930215+0000", 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2649999999999999e-05 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:19.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930226+0000", 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1708e-05 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930235+0000", 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1020000000000003e-06 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930296+0000", 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0062000000000002e-05 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930398+0000", 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102218 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75062 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1425408~4096 in=4096b,write 1556480~4096 in=4096b,write 1568768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.930696+0000", 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0059584169999999997, 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007350858, 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:19.011 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75062 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930696+0000", 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930696+0000", 2024-04-19T03:38:19.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930695+0000", 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930709+0000", 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3747000000000001e-05 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:19.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930722+0000", 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3261000000000001e-05 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930742+0000", 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9845999999999999e-05 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932212+0000", 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014700550000000001 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:19.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932323+0000", 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110263 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932494+0000", 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000171473 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75063 4.19 4:997b7129:::100000001f8.00000000:head [write 806912~4096 in=4096b,write 946176~4096 in=4096b,write 1019904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.930950+0000", 2024-04-19T03:38:19.015 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0057049869999999999, 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071755619999999999, 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75063 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930950+0000", 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930950+0000", 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930949+0000", 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930963+0000", 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3881e-05 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930979+0000", 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6059e-05 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.930987+0000", 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0639999999999994e-06 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.931041+0000", 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3773999999999997e-05 2024-04-19T03:38:19.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.931127+0000", 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6219999999999998e-05 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.931297+0000", 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017059 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.937034+0000", 2024-04-19T03:38:19.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057370939999999999 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75064 4.24 4:27adda6e:::100000001f8.0000000f:head [write 1921024~4096 in=4096b,write 3043328~4096 in=4096b,write 3092480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.932351+0000", 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0043040439999999999, 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058581359999999999, 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:19.020 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75064 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932351+0000", 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932351+0000", 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932350+0000", 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932363+0000", 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.366e-05 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932374+0000", 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0791999999999999e-05 2024-04-19T03:38:19.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932382+0000", 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4630000000000004e-06 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932506+0000", 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012419300000000001 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932592+0000", 2024-04-19T03:38:19.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6168999999999994e-05 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:75065 4.12 e60/14 4:4be51a30:::100000001f8.0000000b:head v 60'2378, mlcod=60'2376)", 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.932392+0000", 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0042622040000000003, 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005893171, 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932392+0000", 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932392+0000", 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932392+0000", 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932409+0000", 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6642000000000001e-05 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932415+0000", 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4520000000000002e-06 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932422+0000", 2024-04-19T03:38:19.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6329999999999999e-06 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932483+0000", 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0999000000000003e-05 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932504+0000", 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1387e-05 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:75066 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 995328~4096 in=4096b,write 1019904~4096 in=4096b,write 1110016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:18.932397+0000", 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0042573330000000003, 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059557029999999997, 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 75066 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:19.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932397+0000", 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932397+0000", 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932397+0000", 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932410+0000", 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3591000000000001e-05 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932419+0000", 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4840000000000004e-06 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932425+0000", 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.455e-06 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932474+0000", 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8773000000000002e-05 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932565+0000", 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1367999999999997e-05 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:18.932739+0000", 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017347400000000001 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.031 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:19.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:19.032 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:19.032 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 22 2024-04-19T03:38:19.032 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:19.033 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:19.040 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:19.039+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:19.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:19.141 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:19.140+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:19.242 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:19.241+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:19.276 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:19.276 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:19.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:19.332 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:19.357 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:19.361 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:19.361 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:19.378 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:19.377+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:19.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:38:19.444 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:19.443+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:19.545 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:19.544+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:19.555 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:19.555 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:19.570 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:19.647 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:19.645+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:19.748 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:19.747+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:19.762 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:19.762 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:19.776 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:19.849 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:19.848+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:19.950 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:19.949+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:19.960 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:19.960 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:19.975 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:20.051 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:20.050+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:20.152 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:20.151+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:20.156 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:20.156 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:20.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:20.254 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:20.253+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:20.357 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:20.355+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:20.388 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:20.388 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:20.392 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:38:20.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-04-19T03:38:20.404 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:20.455 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:20.454+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:20.556 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:20.555+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:20.651 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:20.652 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:20.657 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:20.656+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:20.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:20.758 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:20.757+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:20.859 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:20.857+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:20.875 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:20.875 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:20.887 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:20.960 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:20.958+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:21.062 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:21.060+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:21.079 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:21.172 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:21.169+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:21.274 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:21.262+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:21.317 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:21.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:21.365 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:21.363+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:21.466 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:21.464+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:21.538 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:21.538 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:21.551 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:21.565 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:21.589 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:21.593 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:21.593 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:21.595 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:21.594+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:21.667 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:21.666+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:21.769 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81334 4.34 4:2d2c9530:::100000001f8.00000036:head [write 2080768~4096 in=4096b,write 2220032~4096 in=4096b,write 2523136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.762103+0000", 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0020777510000000001, 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002098595, 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81334 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762103+0000", 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762103+0000", 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762102+0000", 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762115+0000", 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3523000000000001e-05 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762127+0000", 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1389999999999999e-05 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762135+0000", 2024-04-19T03:38:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4109999999999996e-06 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762189+0000", 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3916999999999999e-05 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762293+0000", 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010430299999999999 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81335 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.762400+0000", 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001780406, 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018544900000000001, 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81335 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762400+0000", 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762400+0000", 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762399+0000", 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762416+0000", 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6810999999999999e-05 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762427+0000", 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0871e-05 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762434+0000", 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81336 4.13 4:caef1406:::100000001f8.00000031:head [write 3346432~4096 in=4096b,write 3428352~4096 in=4096b,write 3473408~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.762793+0000", 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0013877060000000001, 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015369509999999999, 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81336 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762793+0000", 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762793+0000", 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762792+0000", 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762805+0000", 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3569e-05 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762815+0000", 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3489999999999998e-06 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762915+0000", 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100232 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.763689+0000", 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077384700000000003 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.763779+0000", 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0426000000000005e-05 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81337 4.2a 4.c3be28ea (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.764304+0000", 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.999876, 2024-04-19T03:38:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107058, 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81337 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764304+0000", 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764304+0000", 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764303+0000", 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764319+0000", 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5560999999999999e-05 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764334+0000", 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4541e-05 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764342+0000", 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4519999999999997e-06 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764393+0000", 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0753e-05 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81339 4.34 4:2d2c9530:::100000001f8.00000036:head [write 2740224~4096 in=4096b,write 2756608~4096 in=4096b,write 2777088~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.764357+0000", 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9998236, 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011820999999999999, 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81339 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764357+0000", 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764357+0000", 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764356+0000", 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764370+0000", 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4078e-05 2024-04-19T03:38:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764379+0000", 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9439999999999994e-06 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764386+0000", 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9199999999999998e-06 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764427+0000", 2024-04-19T03:38:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1179e-05 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81321 4.6 4:616d4c41:::100000001f8.00000034:head [write 3219456~4096 in=4096b,write 3227648~4096 in=4096b,write 3235840~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.756738+0000", 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0074422769999999997, 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0078102479999999997, 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81321 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.756738+0000", 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.756738+0000", 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.756737+0000", 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.756754+0000", 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6625000000000001e-05 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.756765+0000", 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0925e-05 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.756770+0000", 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1220000000000003e-06 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.759509+0000", 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0027391379999999999 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.759595+0000", 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6038000000000005e-05 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.759758+0000", 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000162848 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.763468+0000", 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037097150000000001 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81324 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1290240~4096 in=4096b,write 1298432~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.758163+0000", 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0060175150000000002, 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064805110000000004, 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81324 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758163+0000", 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758163+0000", 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758162+0000", 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758172+0000", 2024-04-19T03:38:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5899999999999997e-06 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758178+0000", 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5549999999999999e-06 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758185+0000", 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.657e-06 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.763438+0000", 2024-04-19T03:38:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052525519999999997 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.763520+0000", 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1981e-05 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.763665+0000", 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000145804 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81326 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.758958+0000", 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0052222079999999999, 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057602369999999996, 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81326 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758958+0000", 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758958+0000", 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758957+0000", 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758975+0000", 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7915e-05 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.758997+0000", 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1702999999999999e-05 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.759006+0000", 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.524e-06 2024-04-19T03:38:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81329 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 3956736~4096 in=4096b,write 3981312~4096 in=4096b,write 4030464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.760077+0000", 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0041033850000000002, 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046864919999999996, 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81329 2024-04-19T03:38:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760077+0000", 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760077+0000", 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760076+0000", 2024-04-19T03:38:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760091+0000", 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4885000000000001e-05 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760105+0000", 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4058e-05 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760114+0000", 2024-04-19T03:38:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5900000000000008e-06 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760167+0000", 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3041999999999998e-05 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760282+0000", 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000115831 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81330 4.3 4:c222b65c:::100000001f8.00000021:head [write 3362816~4096 in=4096b,write 3436544~4096 in=4096b,write 3706880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.760517+0000", 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0036636730000000001, 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043480649999999999, 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81330 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760517+0000", 2024-04-19T03:38:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760517+0000", 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760516+0000", 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760530+0000", 2024-04-19T03:38:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760542+0000", 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1992e-05 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760552+0000", 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9070000000000002e-06 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760602+0000", 2024-04-19T03:38:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0228000000000001e-05 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760695+0000", 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2917999999999994e-05 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81331 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 3256320~4096 in=4096b,write 3280896~4096 in=4096b,write 3452928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.760952+0000", 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0032284929999999998, 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039759540000000003, 2024-04-19T03:38:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81331 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760952+0000", 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760952+0000", 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760951+0000", 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760965+0000", 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4297999999999999e-05 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760976+0000", 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1143e-05 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.760984+0000", 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8499999999999994e-06 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761036+0000", 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1322000000000001e-05 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761157+0000", 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012158 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81332 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 4042752~4096 in=4096b,write 4128768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.761332+0000", 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0028487320000000001, 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036377610000000002, 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81332 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761332+0000", 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761332+0000", 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761331+0000", 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761342+0000", 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1246e-05 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761354+0000", 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1606999999999999e-05 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761361+0000", 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8129999999999998e-06 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762137+0000", 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077603600000000002 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762234+0000", 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7654999999999999e-05 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.762400+0000", 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016619900000000001 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.764873+0000", 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024721280000000001 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:81333 4.25 4:a76ff001:::100000001f8.0000002b:head [write 2764800~4096 in=4096b,write 2912256~4096 in=4096b,write 3088384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:21.761577+0000", 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0026034249999999999, 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034401840000000002, 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 81333 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761577+0000", 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761577+0000", 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761576+0000", 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761600+0000", 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3394999999999999e-05 2024-04-19T03:38:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761611+0000", 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1491000000000001e-05 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761619+0000", 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2549999999999997e-06 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761668+0000", 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8578999999999997e-05 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:21.761773+0000", 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104663 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 13 2024-04-19T03:38:21.819 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:21.820 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:21.768+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:21.821 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:21.906 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:21.905+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:21.970 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:21.968+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:22.058 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:22.058 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:22.058 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:22.058 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:22.058 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:22.071 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:22.069+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:22.075 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:22.171 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:22.169+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:22.273 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:22.272+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:22.331 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:22.331 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62826 4.28 4:153ae410:::100000001f8.0000003b:head [write 2859008~4096,write 2879488~4096,write 2994176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0900342340000009, 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082994795999999996, 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62826 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238468+0000", 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238495+0000", 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6894999999999999e-05 2024-04-19T03:38:22.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238509+0000", 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4479e-05 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238518+0000", 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5879999999999998e-06 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239736+0000", 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001217982 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239833+0000", 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7609999999999995e-05 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240012+0000", 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017837300000000001 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241924+0000", 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019127059999999999 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321356+0000", 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079431515999999994 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321413+0000", 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6657000000000003e-05 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321464+0000", 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1004999999999997e-05 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62827 4.14 4:2b28d75f:::100000001f8.00000016:head [write 2510848~4096,write 2531328~4096,write 2609152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0896362649999993, 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078975696999999997, 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.338 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62827 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238866+0000", 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238880+0000", 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4592e-05 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238891+0000", 2024-04-19T03:38:22.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866000000000001e-05 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238903+0000", 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1409e-05 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238947+0000", 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4249000000000003e-05 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239039+0000", 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1673000000000001e-05 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239193+0000", 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000154766 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241112+0000", 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001918248 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317726+0000", 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.076614071000000006 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317798+0000", 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2123e-05 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317842+0000", 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4651000000000003e-05 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62828 4.15 4:aada5e43:::100000001f8.00000028:head [write 3923968~4096,write 4173824~4096,write 4182016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0891138950000006, 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080658297000000004, 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62828 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.344 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239388+0000", 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239425+0000", 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239444+0000", 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8615e-05 2024-04-19T03:38:22.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239454+0000", 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7319999999999993e-06 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239500+0000", 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6529000000000001e-05 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239594+0000", 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3849000000000002e-05 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239755+0000", 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000160636 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241461+0000", 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001706017 2024-04-19T03:38:22.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.319969+0000", 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078508475999999994 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320011+0000", 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1897999999999998e-05 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320047+0000", 2024-04-19T03:38:22.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6257999999999997e-05 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62829 4.6 4:616d4c41:::100000001f8.00000034:head [write 278528~4096,write 290816~4096,write 315392~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0887912689999997, 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080406688000000004, 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62829 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239711+0000", 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239756+0000", 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5117000000000002e-05 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239767+0000", 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239773+0000", 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6749999999999999e-06 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239813+0000", 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0564e-05 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239873+0000", 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9837000000000003e-05 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240017+0000", 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014359799999999999 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247032+0000", 2024-04-19T03:38:22.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070153300000000002 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320024+0000", 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.072991901999999997 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320075+0000", 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1644000000000002e-05 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320118+0000", 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3016000000000003e-05 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62830 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3342336~4096,write 3416064~4096,write 3444736~12288] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0879498969999997, 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079711315000000005, 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62830 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240552+0000", 2024-04-19T03:38:22.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240572+0000", 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9324999999999999e-05 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240583+0000", 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1422e-05 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240591+0000", 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9300000000000003e-06 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241899+0000", 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001307938 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241952+0000", 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3220999999999997e-05 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.242053+0000", 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010141000000000001 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247058+0000", 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050044659999999999 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320176+0000", 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.073118060999999998 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320223+0000", 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7231000000000002e-05 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320264+0000", 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1236000000000003e-05 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62831 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2031616~4096,write 2043904~4096,write 2138112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0869591270000001, 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078715436, 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62831 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:22.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:22.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241543+0000", 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241558+0000", 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4491000000000001e-05 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241571+0000", 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3029e-05 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241579+0000", 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243598+0000", 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002019337 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243646+0000", 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8183999999999998e-05 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243736+0000", 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9691999999999994e-05 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248424+0000", 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046880960000000001 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320165+0000", 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071741299999999994 2024-04-19T03:38:22.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320218+0000", 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2271000000000001e-05 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320259+0000", 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1777000000000003e-05 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0853227410000006, 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:22.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0827021200000004, 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.375 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:22.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:22.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0802586989999998, 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.381 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:22.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:22.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.079491054, 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.387 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:22.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:22.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62860 4.6 4:63e80496:::100000001f8.0000001e:head [write 3608576~4096,write 3649536~4096,write 4050944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0745426180000006, 2024-04-19T03:38:22.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082270504999999994, 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62860 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:22.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253959+0000", 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253974+0000", 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4139e-05 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253993+0000", 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8955999999999999e-05 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254001+0000", 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8130000000000002e-06 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254042+0000", 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0728e-05 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254096+0000", 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4147000000000002e-05 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254218+0000", 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121736 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256573+0000", 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002355261 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336147+0000", 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079574000000000006 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336193+0000", 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5881999999999999e-05 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336231+0000", 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7793999999999998e-05 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62867 4.6 4:616d4c41:::100000001f8.00000034:head [write 3358720~4096,write 3641344~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0716967579999999, 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079551001999999996, 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.399 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62867 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256805+0000", 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256820+0000", 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4856e-05 2024-04-19T03:38:22.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256834+0000", 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.344e-05 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256843+0000", 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7829999999999993e-06 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256891+0000", 2024-04-19T03:38:22.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7704000000000003e-05 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.257012+0000", 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012072499999999999 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.257176+0000", 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164554 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260920+0000", 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037431470000000001 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336292+0000", 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.075372163000000006 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336325+0000", 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3182999999999997e-05 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336357+0000", 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2391000000000002e-05 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0688988500000001, 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.405 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:22.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0661977270000005, 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.411 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:22.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:22.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62888 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2416640~4096,write 2445312~4096,write 2744320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.416 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0628756419999998, 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083295955000000005, 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62888 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265662+0000", 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5512000000000002e-05 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265673+0000", 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0429e-05 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265678+0000", 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6779999999999997e-06 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265716+0000", 2024-04-19T03:38:22.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7367000000000003e-05 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265773+0000", 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7500000000000002e-05 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265910+0000", 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013703700000000001 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268901+0000", 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029905539999999999 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348859+0000", 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079958414000000005 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348895+0000", 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5652999999999999e-05 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348923+0000", 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8603999999999999e-05 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62892 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3272704~4096,write 3305472~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0614463230000002, 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.081941512999999994, 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62892 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267055+0000", 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267070+0000", 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4296e-05 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267083+0000", 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3451e-05 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267092+0000", 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9409999999999996e-06 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267331+0000", 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023835999999999999 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267390+0000", 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9388999999999997e-05 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267500+0000", 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109651 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.269522+0000", 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020223200000000002 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348951+0000", 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079429079999999999 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348979+0000", 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7572e-05 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348998+0000", 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.969e-05 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.427 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62895 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 4104192~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0602578430000005, 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080708229000000006, 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62895 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268244+0000", 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268263+0000", 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8410000000000002e-05 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268282+0000", 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9177999999999998e-05 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268291+0000", 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6260000000000001e-06 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268330+0000", 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9835000000000001e-05 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268409+0000", 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8597000000000007e-05 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268515+0000", 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105925 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.270754+0000", 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022391109999999998 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348876+0000", 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078122081999999995 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348917+0000", 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.104e-05 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348953+0000", 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6276000000000003e-05 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.1981021970000008, 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.433 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:22.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64817 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3067904~4096,write 3092480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130822+0000", 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.1976813400000008, 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078473251999999993, 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.439 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64817 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130822+0000", 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130822+0000", 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130821+0000", 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130835+0000", 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4105e-05 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130917+0000", 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1793999999999996e-05 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130927+0000", 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0273e-05 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.174863+0000", 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.043935241999999999 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.174949+0000", 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6137000000000006e-05 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.175094+0000", 2024-04-19T03:38:22.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014537900000000001 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.191295+0000", 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016200491000000001 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.209209+0000", 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017914195000000001 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.209252+0000", 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3263000000000002e-05 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.209295+0000", 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2830000000000002e-05 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64911 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 974848~4096,write 1024000~4096,write 1384448~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:22.444 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.1680616599999993, 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080437593000000002, 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64911 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160440+0000", 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160459+0000", 2024-04-19T03:38:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8419000000000001e-05 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.161129+0000", 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00067022399999999997 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.161145+0000", 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727999999999999e-05 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:22.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218134+0000", 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.056989712999999997 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218224+0000", 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9463999999999996e-05 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218410+0000", 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185985 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.231493+0000", 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013083347 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240797+0000", 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0093039620000000007 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240843+0000", 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6153999999999999e-05 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:22.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:22.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240879+0000", 2024-04-19T03:38:22.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5769999999999998e-05 2024-04-19T03:38:22.450 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.450 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.450 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.450 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:22.450 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:22.450 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:22.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:38:22.452 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:22.449+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:22.453 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:22.552 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:22.551+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:22.642 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:22.642 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:22.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83124 4.28 e61/14 4:153ae410:::100000001f8.0000003b:head v 61'2603, mlcod=61'2601)", 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.599850+0000", 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.033769133999999999, 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.033794032000000002, 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599850+0000", 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599850+0000", 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599849+0000", 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599864+0000", 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939999999999999e-05 2024-04-19T03:38:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599873+0000", 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6999999999999997e-06 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599879+0000", 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7080000000000002e-06 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599919+0000", 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0645000000000001e-05 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599942+0000", 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2537000000000001e-05 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83161 4.3b e61/14 4:dcc0c15f:::100000001f8.0000001a:head v 61'1303, mlcod=61'1300)", 2024-04-19T03:38:22.646 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.612615+0000", 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021003422000000001, 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021093087999999999, 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612615+0000", 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612615+0000", 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612615+0000", 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612630+0000", 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4679e-05 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612643+0000", 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3261999999999999e-05 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612649+0000", 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1789999999999996e-06 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624401+0000", 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011752271999999999 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624419+0000", 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7215999999999999e-05 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83192 4.2c 4.a871486c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.623249+0000", 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010369655, 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010524063, 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.650 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83192 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623249+0000", 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623249+0000", 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623248+0000", 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623274+0000", 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5989000000000001e-05 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623285+0000", 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1266e-05 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623294+0000", 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4239999999999993e-06 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83125 4.30 4:0c89e311:::100000001f8.00000017:head [write 3457024~4096 in=4096b,write 3497984~4096 in=4096b,write 3665920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.599816+0000", 2024-04-19T03:38:22.653 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.033803144, 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.034020838999999997, 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83125 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599816+0000", 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599816+0000", 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599815+0000", 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599866+0000", 2024-04-19T03:38:22.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1422000000000003e-05 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599879+0000", 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3124e-05 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599887+0000", 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2429999999999999e-06 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607408+0000", 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0075213759999999998 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607470+0000", 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2440000000000005e-05 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83162 4.33 e61/14 4:cf6d7a6c:::100000001f8.0000000a:head v 61'1266, mlcod=61'1264)", 2024-04-19T03:38:22.657 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.612679+0000", 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020939224999999999, 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021224608999999998, 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612679+0000", 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612679+0000", 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612679+0000", 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612701+0000", 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2116999999999998e-05 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612708+0000", 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1199999999999996e-06 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612714+0000", 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.339e-06 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624394+0000", 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011680533999999999 2024-04-19T03:38:22.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624412+0000", 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7649e-05 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83194 4.36 e61/14)", 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.624205+0000", 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0094135839999999991, 2024-04-19T03:38:22.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00976022, 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624205+0000", 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624205+0000", 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624204+0000", 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624233+0000", 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8436999999999999e-05 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624242+0000", 2024-04-19T03:38:22.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0289999999999994e-06 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624248+0000", 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5980000000000002e-06 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83165 4.c 4:33b8095f:::100000001f8.0000003a:head [write 1101824~4096 in=4096b,write 1126400~4096 in=4096b,write 1163264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.612786+0000", 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020832459000000001, 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.021234790999999999, 2024-04-19T03:38:22.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83165 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612786+0000", 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612786+0000", 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612785+0000", 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612799+0000", 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3546999999999999e-05 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612811+0000", 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2381000000000001e-05 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612819+0000", 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4300000000000006e-06 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630894+0000", 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018074096000000001 2024-04-19T03:38:22.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630958+0000", 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4939999999999998e-05 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83195 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.624226+0000", 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.009392526, 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0098725870000000004, 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.668 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83195 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624226+0000", 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624226+0000", 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624225+0000", 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624237+0000", 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2164000000000001e-05 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624246+0000", 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3119999999999994e-06 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624251+0000", 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4099999999999999e-06 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.671 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83196 4.c 4.fa901dcc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.624486+0000", 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0091325369999999996, 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096718749999999999, 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83196 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624486+0000", 2024-04-19T03:38:22.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624486+0000", 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624485+0000", 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624514+0000", 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8745e-05 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624523+0000", 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1419999999999999e-06 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624530+0000", 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6320000000000002e-06 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.674 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83127 4.6 e61/14 4:62d56fc8:::100000001f8.0000001c:head v 61'5174, mlcod=61'5171)", 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.601469+0000", 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.032150191000000002, 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032746821000000002, 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601469+0000", 2024-04-19T03:38:22.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601469+0000", 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601468+0000", 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601480+0000", 2024-04-19T03:38:22.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1969e-05 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601491+0000", 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1161999999999999e-05 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601496+0000", 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6090000000000003e-06 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605338+0000", 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038424990000000001 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605351+0000", 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2808e-05 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83197 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1650688~4096 in=4096b,write 1658880~4096 in=4096b,write 1740800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.624785+0000", 2024-04-19T03:38:22.678 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0088336839999999996, 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094972549999999996, 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83197 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624785+0000", 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624785+0000", 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624784+0000", 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624823+0000", 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8689000000000002e-05 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624834+0000", 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.078e-05 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624842+0000", 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1659999999999994e-06 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624886+0000", 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3751000000000002e-05 2024-04-19T03:38:22.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624997+0000", 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000111437 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83203 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.626980+0000", 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.006638288, 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007366325, 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.682 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83203 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626980+0000", 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626980+0000", 2024-04-19T03:38:22.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626979+0000", 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626995+0000", 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6220000000000001e-05 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627008+0000", 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2357999999999999e-05 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627016+0000", 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1950000000000003e-06 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83130 4.36 e61/14 4:6da220e6:::100000001f8.0000003f:head v 61'3899, mlcod=61'3896)", 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.601810+0000", 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.031809219999999999, 2024-04-19T03:38:22.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032591637, 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601810+0000", 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601810+0000", 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601809+0000", 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601820+0000", 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0658e-05 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601824+0000", 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4139999999999996e-06 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601828+0000", 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2100000000000002e-06 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610695+0000", 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088677410000000002 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610712+0000", 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7235999999999999e-05 2024-04-19T03:38:22.688 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83168 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.613824+0000", 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019794809999999999, 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020635797000000001, 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.689 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83168 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.613824+0000", 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.613824+0000", 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.613823+0000", 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.613833+0000", 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3729999999999999e-06 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.613840+0000", 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2590000000000003e-06 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.613845+0000", 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1189999999999996e-06 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83204 4.29 4:94178d8a:::100000001f8.00000006:head [write 36864~4096 in=4096b,write 221184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.627025+0000", 2024-04-19T03:38:22.692 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00659371, 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074926589999999996, 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83204 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627025+0000", 2024-04-19T03:38:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627025+0000", 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627025+0000", 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627032+0000", 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7489999999999998e-06 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627039+0000", 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.109e-06 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627044+0000", 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5990000000000004e-06 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627209+0000", 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000164859 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627288+0000", 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8809999999999999e-05 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83129 4.28 e61/14 4:15eeb89b:::100000001f8.00000032:head v 61'2604, mlcod=61'2601)", 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.601906+0000", 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.031712589999999999, 2024-04-19T03:38:22.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032676302999999997, 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601906+0000", 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601906+0000", 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601906+0000", 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601915+0000", 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5880000000000004e-06 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601920+0000", 2024-04-19T03:38:22.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9699999999999998e-06 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.601923+0000", 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9909999999999998e-06 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.602577+0000", 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00065398500000000005 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.602597+0000", 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9690999999999998e-05 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83155 4.36 e61/14 4:6c9c34b1:::100000001f8.00000010:head v 61'3901, mlcod=61'3896)", 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.614112+0000", 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019506253000000001, 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020532603, 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.700 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614112+0000", 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614112+0000", 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614112+0000", 2024-04-19T03:38:22.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614129+0000", 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7580000000000001e-05 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614137+0000", 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9799999999999998e-06 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614142+0000", 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5560000000000001e-06 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631101+0000", 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016958713 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631117+0000", 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.628e-05 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.703 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83199 4.28 e61/14 4:15eeb89b:::100000001f8.00000032:head v 61'2606, mlcod=61'2601)", 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.627092+0000", 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0065264950000000002, 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076100660000000004, 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627092+0000", 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627092+0000", 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627092+0000", 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627106+0000", 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4844000000000001e-05 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627115+0000", 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5450000000000003e-06 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627122+0000", 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8449999999999997e-06 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632924+0000", 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058026470000000002 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632966+0000", 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1205999999999998e-05 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83132 4.19 e61/14 4:997b7129:::100000001f8.00000000:head v 61'2613, mlcod=61'2610)", 2024-04-19T03:38:22.707 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.602695+0000", 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.030924139, 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032066417, 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.602695+0000", 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.602695+0000", 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.602694+0000", 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.602712+0000", 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.755e-05 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.602721+0000", 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0489999999999993e-06 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.602728+0000", 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9920000000000001e-06 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.611175+0000", 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084478880000000006 2024-04-19T03:38:22.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.611195+0000", 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9082000000000001e-05 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83200 4.14 e61/14 4:2b28d75f:::100000001f8.00000016:head v 61'1280, mlcod=61'1275)", 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.627127+0000", 2024-04-19T03:38:22.711 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0064913719999999996, 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076953710000000003, 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627127+0000", 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627127+0000", 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627127+0000", 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627138+0000", 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1382e-05 2024-04-19T03:38:22.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627145+0000", 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9240000000000001e-06 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.627150+0000", 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7099999999999998e-06 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630907+0000", 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037570020000000002 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630929+0000", 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1458999999999999e-05 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.715 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83135 4.23 4:c6f90462:::100000001f8.00000037:head [write 1470464~4096 in=4096b,write 1904640~4096 in=4096b,write 2011136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.603186+0000", 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.030432743000000002, 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.031710413999999999, 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83135 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.603186+0000", 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.603186+0000", 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.603185+0000", 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.603242+0000", 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7025999999999999e-05 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.603254+0000", 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1916000000000001e-05 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.603261+0000", 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.357e-06 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.603302+0000", 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0720999999999999e-05 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.603352+0000", 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0167999999999998e-05 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.603438+0000", 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5597000000000001e-05 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608030+0000", 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045917830000000003 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.720 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83206 4.1b 4.d7c0abdb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.628126+0000", 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0054927350000000003, 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068582499999999998, 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83206 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628126+0000", 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628126+0000", 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628125+0000", 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628141+0000", 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6155999999999999e-05 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628149+0000", 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0569999999999993e-06 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628155+0000", 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6099999999999997e-06 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83134 4.6 e61/14 4:616d4c41:::100000001f8.00000034:head v 61'5175, mlcod=61'5171)", 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.604558+0000", 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.029060425000000001, 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030482097, 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.604558+0000", 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.604558+0000", 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.604558+0000", 2024-04-19T03:38:22.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.604574+0000", 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6937000000000001e-05 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.604583+0000", 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7940000000000008e-06 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.604590+0000", 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2389999999999999e-06 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609038+0000", 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044489359999999997 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609058+0000", 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9193000000000001e-05 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.727 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83170 4.14 e61/14 4:2b28d75f:::100000001f8.00000016:head v 61'1278, mlcod=61'1275)", 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.614937+0000", 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.018681252999999998, 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020169267000000001, 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614937+0000", 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614937+0000", 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614937+0000", 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614966+0000", 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9422000000000001e-05 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614978+0000", 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1936000000000001e-05 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.614985+0000", 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0679999999999999e-06 2024-04-19T03:38:22.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624157+0000", 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0091712419999999996 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624173+0000", 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6314e-05 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.731 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83205 4.2e e61/14)", 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.628196+0000", 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0054227490000000001, 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069522949999999998, 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628196+0000", 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628196+0000", 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628196+0000", 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628205+0000", 2024-04-19T03:38:22.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0229999999999998e-06 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628211+0000", 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2489999999999998e-06 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628215+0000", 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6150000000000001e-06 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.734 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83138 4.14 e61/14 4:2b28d75f:::100000001f8.00000016:head v 61'1277, mlcod=61'1275)", 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.605386+0000", 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.028233033000000001, 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.029791188999999999, 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605386+0000", 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605386+0000", 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605385+0000", 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605402+0000", 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7144999999999999e-05 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605411+0000", 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1710000000000008e-06 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605419+0000", 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.131e-06 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607606+0000", 2024-04-19T03:38:22.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021870370000000002 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607617+0000", 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1275e-05 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83171 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2490368~4096 in=4096b,write 2527232~4096 in=4096b,write 2543616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.615101+0000", 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.018517374999999999, 2024-04-19T03:38:22.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020114330999999999, 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83171 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615101+0000", 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615101+0000", 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615101+0000", 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615117+0000", 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6716999999999999e-05 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615129+0000", 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1968e-05 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615137+0000", 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3150000000000003e-06 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633918+0000", 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018781049000000001 2024-04-19T03:38:22.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.634005+0000", 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7700000000000004e-05 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.634142+0000", 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013712800000000001 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83208 4.33 e61/14)", 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.628924+0000", 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0046947830000000001, 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063339700000000004, 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628924+0000", 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628924+0000", 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628923+0000", 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628940+0000", 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7037e-05 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628956+0000", 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5699999999999999e-05 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.628963+0000", 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0859999999999996e-06 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83143 4.c 4:33b8095f:::100000001f8.0000003a:head [write 385024~4096 in=4096b,write 405504~4096 in=4096b,write 466944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.745 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.605408+0000", 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.028210303999999999, 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.029881074000000001, 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83143 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605408+0000", 2024-04-19T03:38:22.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605408+0000", 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605408+0000", 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605419+0000", 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:38:22.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605426+0000", 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5229999999999998e-06 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.605432+0000", 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.096e-06 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612510+0000", 2024-04-19T03:38:22.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007078666 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612596+0000", 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5308000000000004e-05 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83163 4.6 e61/14 4:63e80496:::100000001f8.0000001e:head v 61'5177, mlcod=61'5171)", 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.615367+0000", 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.018251422999999999, 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019960405000000001, 2024-04-19T03:38:22.749 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615367+0000", 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615367+0000", 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615367+0000", 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615393+0000", 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6083000000000001e-05 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615403+0000", 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0227999999999999e-05 2024-04-19T03:38:22.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.615410+0000", 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3050000000000004e-06 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631095+0000", 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015684903 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631114+0000", 2024-04-19T03:38:22.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8482e-05 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83209 4.30 4.88c79130 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.629102+0000", 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0045169870000000001, 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062678300000000003, 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.753 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83209 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629102+0000", 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629102+0000", 2024-04-19T03:38:22.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629101+0000", 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629116+0000", 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4977000000000001e-05 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629126+0000", 2024-04-19T03:38:22.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0081999999999999e-05 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629133+0000", 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2699999999999999e-06 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83210 4.11 4:8be3ecac:::100000001f8.00000005:head [write 0~4096 in=4096b,write 49152~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.629775+0000", 2024-04-19T03:38:22.756 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0038434929999999999, 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005643828, 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83210 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629775+0000", 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629775+0000", 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629775+0000", 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629785+0000", 2024-04-19T03:38:22.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9920000000000002e-06 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629793+0000", 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1319999999999994e-06 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629798+0000", 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3499999999999996e-06 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631103+0000", 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013052210000000001 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631151+0000", 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8167000000000001e-05 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83148 4.38 4:1d13bf87:::100000001f8.00000030:head [write 2457600~4096 in=4096b,write 2510848~4096 in=4096b,write 2670592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.607028+0000", 2024-04-19T03:38:22.760 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.026590320000000001, 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028469735999999999, 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83148 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607028+0000", 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607028+0000", 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607028+0000", 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607039+0000", 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0757000000000001e-05 2024-04-19T03:38:22.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607046+0000", 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9240000000000001e-06 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607050+0000", 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6059999999999996e-06 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608410+0000", 2024-04-19T03:38:22.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001360235 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608517+0000", 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000106945 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83167 4.36 e61/14 4:6c9c34b1:::100000001f8.00000010:head v 61'3902, mlcod=61'3896)", 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.616157+0000", 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.017461854999999998, 2024-04-19T03:38:22.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.019416248000000001, 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.616157+0000", 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.616157+0000", 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.616156+0000", 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.616187+0000", 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1177000000000003e-05 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.616207+0000", 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9939e-05 2024-04-19T03:38:22.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.616215+0000", 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7870000000000002e-06 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633269+0000", 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017053999 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633309+0000", 2024-04-19T03:38:22.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9814000000000002e-05 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83211 4.3b e61/14)", 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.630295+0000", 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0033239189999999998, 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0053434850000000002, 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.768 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630295+0000", 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630295+0000", 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630294+0000", 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630308+0000", 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3947e-05 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630314+0000", 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.524e-06 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630318+0000", 2024-04-19T03:38:22.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0890000000000002e-06 2024-04-19T03:38:22.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.771 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.771 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.773 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83176 4.19 e61/14 4:9a4319fb:::100000001f8.0000002a:head v 61'2614, mlcod=61'2610)", 2024-04-19T03:38:22.773 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.617502+0000", 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.016116786000000001, 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018200203000000002, 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617502+0000", 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617502+0000", 2024-04-19T03:38:22.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617501+0000", 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617515+0000", 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3528e-05 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617526+0000", 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0807e-05 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617532+0000", 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4289999999999998e-06 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617561+0000", 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8680999999999999e-05 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617573+0000", 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2242000000000001e-05 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83212 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2490368~4096 in=4096b,write 2707456~4096 in=4096b,write 2985984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.630613+0000", 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.003005495, 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051574610000000003, 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83212 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630613+0000", 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630613+0000", 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630613+0000", 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630622+0000", 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6320000000000003e-06 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630629+0000", 2024-04-19T03:38:22.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3400000000000003e-06 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630633+0000", 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4710000000000001e-06 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632924+0000", 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022913690000000001 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633013+0000", 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8876999999999996e-05 2024-04-19T03:38:22.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83149 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2338816~4096 in=4096b,write 2396160~4096 in=4096b,write 2437120~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.607399+0000", 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.02621983, 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028450828000000001, 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83149 2024-04-19T03:38:22.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607399+0000", 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607399+0000", 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607398+0000", 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607413+0000", 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4817999999999999e-05 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607430+0000", 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7337999999999999e-05 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607437+0000", 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8909999999999998e-06 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607483+0000", 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6338999999999998e-05 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607564+0000", 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0438999999999993e-05 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.607714+0000", 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015010699999999999 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626200+0000", 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018485866 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83177 4.14 e61/14 4:2b28d75f:::100000001f8.00000016:head v 61'1279, mlcod=61'1275)", 2024-04-19T03:38:22.785 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.617941+0000", 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.015678195999999998, 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017988130000000001, 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617941+0000", 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617941+0000", 2024-04-19T03:38:22.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617940+0000", 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617986+0000", 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5979999999999997e-05 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.617997+0000", 2024-04-19T03:38:22.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1333e-05 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618004+0000", 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3770000000000001e-06 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626483+0000", 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084792389999999995 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626507+0000", 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3964e-05 2024-04-19T03:38:22.788 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83110 4.2c 4:36128e15:::100000001f8.00000008:head [write 3608576~4096 in=4096b,write 3805184~4096 in=4096b,write 3948544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.594574+0000", 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.039045120000000003, 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.041422971000000003, 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83110 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.789 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.594574+0000", 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.594574+0000", 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.594573+0000", 2024-04-19T03:38:22.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.594590+0000", 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6793e-05 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.594599+0000", 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6260000000000007e-06 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.594606+0000", 2024-04-19T03:38:22.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9600000000000003e-06 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.594639+0000", 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3003000000000002e-05 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.594689+0000", 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9818999999999999e-05 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83178 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3465216~4096 in=4096b,write 3588096~4096 in=4096b,write 3727360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.618099+0000", 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.015519806000000001, 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017965124999999998, 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83178 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618099+0000", 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618099+0000", 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618098+0000", 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618111+0000", 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2836999999999999e-05 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618121+0000", 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0309000000000001e-05 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618128+0000", 2024-04-19T03:38:22.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0119999999999999e-06 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.625922+0000", 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00779351 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626003+0000", 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1557999999999994e-05 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(client.4526.0:83151 4.12 e61/14 ondisk, result = 0)", 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.630962+0000", 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0026570809999999999, 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051543140000000001, 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630962+0000", 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630962+0000", 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630961+0000", 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630966+0000", 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7389999999999999e-06 2024-04-19T03:38:22.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630976+0000", 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8810000000000008e-06 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630980+0000", 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7539999999999997e-06 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636095+0000", 2024-04-19T03:38:22.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051149790000000004 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636104+0000", 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4309999999999994e-06 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636116+0000", 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2164000000000001e-05 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83173 4.2e e61/14 4:75be0f36:::100000001f8.0000003d:head v 61'1322, mlcod=61'1318)", 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.618969+0000", 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.014650104000000001, 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017220249, 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618969+0000", 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618969+0000", 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.618968+0000", 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.619011+0000", 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3143999999999999e-05 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.619023+0000", 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1508999999999999e-05 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.619029+0000", 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.63e-06 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635605+0000", 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016575309 2024-04-19T03:38:22.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635625+0000", 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9938000000000001e-05 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(client.4526.0:83158 4.12 e61/14 ondisk, result = 0)", 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.631310+0000", 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0023088230000000002, 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049333780000000004, 2024-04-19T03:38:22.804 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631310+0000", 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631310+0000", 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.805 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631309+0000", 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631314+0000", 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3320000000000002e-06 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631322+0000", 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.926e-06 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631327+0000", 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8130000000000001e-06 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636130+0000", 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048030989999999999 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636134+0000", 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8700000000000002e-06 2024-04-19T03:38:22.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83181 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.619561+0000", 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.014057445, 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016739964, 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83181 2024-04-19T03:38:22.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.619561+0000", 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.619561+0000", 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.619561+0000", 2024-04-19T03:38:22.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.619572+0000", 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1963999999999999e-05 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.619583+0000", 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0946e-05 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.619591+0000", 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4529999999999996e-06 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83112 4.6 e61/14 4:616d4c41:::100000001f8.00000034:head v 61'5173, mlcod=61'5171)", 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.595548+0000", 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.038070562000000002, 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.040817273000000001, 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595548+0000", 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595548+0000", 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595548+0000", 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595565+0000", 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6957999999999999e-05 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595572+0000", 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6369999999999999e-06 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595578+0000", 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7339999999999996e-06 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595616+0000", 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8507000000000002e-05 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595636+0000", 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9072e-05 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.814 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83136 4.6 e61/14 4:635f8cb4:::100000001f8.0000003c:head v 61'5176, mlcod=61'5171)", 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.608046+0000", 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.025573107000000001, 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028379904000000001, 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608046+0000", 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608046+0000", 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608045+0000", 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608058+0000", 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2663000000000001e-05 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.816 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608065+0000", 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0210000000000002e-06 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608070+0000", 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2100000000000001e-06 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.611407+0000", 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033364499999999999 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.611418+0000", 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1459e-05 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83182 4.c 4.fa901dcc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.620011+0000", 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.013607958999999999, 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016473601000000001, 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.818 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83182 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620011+0000", 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620011+0000", 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620010+0000", 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620026+0000", 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5557999999999999e-05 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620037+0000", 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1206000000000001e-05 2024-04-19T03:38:22.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620044+0000", 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1339999999999998e-06 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83214 4.3b e61/14)", 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.631906+0000", 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0017126520000000001, 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046303189999999999, 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631906+0000", 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631906+0000", 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.822 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631906+0000", 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631928+0000", 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2266e-05 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631936+0000", 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7489999999999998e-06 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631941+0000", 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2000000000000002e-06 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83113 4.38 4:1d13bf87:::100000001f8.00000030:head [write 696320~4096 in=4096b,write 774144~4096 in=4096b,write 942080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.595628+0000", 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.037990283999999999, 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.040960647000000003, 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.824 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83113 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595628+0000", 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595628+0000", 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595627+0000", 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595645+0000", 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7518999999999999e-05 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595655+0000", 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5969999999999998e-06 2024-04-19T03:38:22.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.595662+0000", 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1940000000000001e-06 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598881+0000", 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032191519999999999 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598934+0000", 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3468999999999999e-05 2024-04-19T03:38:22.827 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83140 4.2e e61/14 4:75be0f36:::100000001f8.0000003d:head v 61'1321, mlcod=61'1318)", 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.608080+0000", 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.025538332, 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028573153, 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608080+0000", 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608080+0000", 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608080+0000", 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.829 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608104+0000", 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3958e-05 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608113+0000", 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1470000000000007e-06 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608119+0000", 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8320000000000002e-06 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612619+0000", 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004500169 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612639+0000", 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9463e-05 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83215 4.1c e61/14)", 2024-04-19T03:38:22.831 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.632104+0000", 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0015147769999999999, 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004604955, 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632104+0000", 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632104+0000", 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632104+0000", 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632118+0000", 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4042999999999999e-05 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632124+0000", 2024-04-19T03:38:22.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6100000000000002e-06 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632129+0000", 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.87e-06 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83151 4.12 4:4be51a30:::100000001f8.0000000b:head [write 1937408~4096 in=4096b,write 2031616~4096 in=4096b,write 2080768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.608092+0000", 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.025526549999999999, 2024-04-19T03:38:22.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.028669547, 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83151 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608092+0000", 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608092+0000", 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608091+0000", 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608106+0000", 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4442e-05 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608119+0000", 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2879e-05 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.608126+0000", 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5909999999999998e-06 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624157+0000", 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016031251999999999 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624218+0000", 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0943000000000002e-05 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624374+0000", 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512600000000001 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636110+0000", 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01173691 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.838 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83180 4.1c e61/14 4:39b842ef:::100000001f8.00000029:head v 61'1325, mlcod=61'1322)", 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.620175+0000", 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.013444111, 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016661341999999999, 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620175+0000", 2024-04-19T03:38:22.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620175+0000", 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620174+0000", 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620187+0000", 2024-04-19T03:38:22.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2909e-05 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620195+0000", 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2770000000000005e-06 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620199+0000", 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0300000000000004e-06 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.625742+0000", 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055423490000000002 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.625757+0000", 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5367e-05 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83217 4.36 e61/14)", 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.632728+0000", 2024-04-19T03:38:22.842 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00089028200000000005, 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0041624629999999999, 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632728+0000", 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632728+0000", 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632728+0000", 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632743+0000", 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5362999999999998e-05 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632751+0000", 2024-04-19T03:38:22.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5170000000000002e-06 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632757+0000", 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1120000000000001e-06 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83183 4.30 4:0c89e311:::100000001f8.00000017:head [write 1835008~4096 in=4096b,write 1851392~4096 in=4096b,write 2027520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.620352+0000", 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.013266544999999999, 2024-04-19T03:38:22.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016601331, 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83183 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620352+0000", 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620352+0000", 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620351+0000", 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620365+0000", 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3397999999999999e-05 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620376+0000", 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0993e-05 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620384+0000", 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1629999999999996e-06 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632791+0000", 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012406854 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632883+0000", 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1971000000000004e-05 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83218 4.2e e61/14)", 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.633114+0000", 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00050496500000000001, 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039012029999999998, 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.849 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633114+0000", 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633114+0000", 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633113+0000", 2024-04-19T03:38:22.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633128+0000", 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5325e-05 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633139+0000", 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0583e-05 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633146+0000", 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8029999999999999e-06 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83116 4.36 e61/14 4:6fa85f86:::100000001f8.00000013:head v 61'3898, mlcod=61'3896)", 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.597018+0000", 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.036601003, 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.040045341999999998, 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597018+0000", 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597018+0000", 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597017+0000", 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597029+0000", 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1867e-05 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597036+0000", 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7789999999999998e-06 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597041+0000", 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8840000000000002e-06 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597070+0000", 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9785999999999999e-05 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597083+0000", 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2058e-05 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.855 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83152 4.3b e61/14 4:dcc0c15f:::100000001f8.0000001a:head v 61'1302, mlcod=61'1300)", 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.609776+0000", 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.023842539999999999, 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.02734408, 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609776+0000", 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609776+0000", 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609775+0000", 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609791+0000", 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5923999999999999e-05 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609800+0000", 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8729999999999996e-06 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609807+0000", 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4840000000000001e-06 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609845+0000", 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8532000000000003e-05 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609865+0000", 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9874999999999999e-05 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83175 4.36 e61/14)", 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.620535+0000", 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.013083857000000001, 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016638863, 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.859 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620535+0000", 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620535+0000", 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620534+0000", 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620560+0000", 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.514e-05 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620565+0000", 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7790000000000001e-06 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.620569+0000", 2024-04-19T03:38:22.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.36e-06 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83219 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 32768~4096 in=4096b,write 122880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.633312+0000", 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00030686199999999998, 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039123059999999999, 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.862 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83219 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633312+0000", 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633312+0000", 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633311+0000", 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633321+0000", 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6239999999999997e-06 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633329+0000", 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2579999999999995e-06 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633334+0000", 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5160000000000002e-06 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633374+0000", 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9450999999999999e-05 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633455+0000", 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0867999999999999e-05 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.633597+0000", 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014242700000000001 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83117 4.19 e61/14 4:997b7129:::100000001f8.00000000:head v 61'2612, mlcod=61'2610)", 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.597439+0000", 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.036179480999999999, 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.039856939000000001, 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.866 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597439+0000", 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597439+0000", 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597439+0000", 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597453+0000", 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4365999999999999e-05 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597462+0000", 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6500000000000002e-06 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597467+0000", 2024-04-19T03:38:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8019999999999997e-06 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597518+0000", 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0389000000000002e-05 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.597538+0000", 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0078e-05 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83157 4.23 4:c6f90462:::100000001f8.00000037:head [write 4096~4096 in=4096b,write 28672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.609803+0000", 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.023815313000000001, 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027717166000000001, 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83157 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609803+0000", 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609803+0000", 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609802+0000", 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609815+0000", 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2707e-05 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609828+0000", 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2551000000000001e-05 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609837+0000", 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8890000000000008e-06 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609940+0000", 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000103558 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610025+0000", 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4808000000000005e-05 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610178+0000", 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015294500000000001 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.625912+0000", 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015734476000000001 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83223 4.37 4:ef395e89:::100000001f8.00000020:head [write 2920448~4096 in=4096b,write 2985984~4096 in=4096b,write 3010560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.635376+0000", 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9982429, 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022264139999999999, 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83223 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635376+0000", 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635376+0000", 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635374+0000", 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635390+0000", 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5571000000000001e-05 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635400+0000", 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0308e-05 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635408+0000", 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8860000000000004e-06 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635461+0000", 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2364999999999998e-05 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635554+0000", 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2885000000000003e-05 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635716+0000", 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016237900000000001 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83156 4.1c e61/14 4:39b842ef:::100000001f8.00000029:head v 61'1324, mlcod=61'1322)", 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.609912+0000", 2024-04-19T03:38:22.878 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.023706708999999999, 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027771945999999999, 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609912+0000", 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609912+0000", 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609912+0000", 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609927+0000", 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5404e-05 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609934+0000", 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4170000000000003e-06 2024-04-19T03:38:22.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.609941+0000", 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1140000000000002e-06 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.611243+0000", 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013026680000000001 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.611260+0000", 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6500000000000001e-05 2024-04-19T03:38:22.881 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83184 4.33 e61/14 4:cf6d7a6c:::100000001f8.0000000a:head v 61'1267, mlcod=61'1264)", 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.621025+0000", 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.012593244999999999, 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016726101, 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.621025+0000", 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.621025+0000", 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.621025+0000", 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.621038+0000", 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3359e-05 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.621045+0000", 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6560000000000003e-06 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.621049+0000", 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6610000000000002e-06 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626610+0000", 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005561613 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626630+0000", 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9623000000000002e-05 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83224 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2244608~4096 in=4096b,write 2260992~4096 in=4096b,write 2498560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.885 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.635418+0000", 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9982009, 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00240434, 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83224 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635418+0000", 2024-04-19T03:38:22.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635418+0000", 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635417+0000", 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635428+0000", 2024-04-19T03:38:22.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635434+0000", 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3559999999999998e-06 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635440+0000", 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4380000000000003e-06 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636237+0000", 2024-04-19T03:38:22.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00079777299999999999 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636289+0000", 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1771999999999998e-05 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636379+0000", 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0377999999999994e-05 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83158 4.12 4:48ab9bde:::100000001f8.00000015:head [write 3461120~4096 in=4096b,write 3563520~4096 in=4096b,write 3604480~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.610141+0000", 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.023477973999999999, 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027767527, 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83158 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610141+0000", 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610141+0000", 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610140+0000", 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610158+0000", 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7813e-05 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610167+0000", 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3100000000000006e-06 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610178+0000", 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0467e-05 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626228+0000", 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016050561000000001 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626316+0000", 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7404000000000005e-05 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.626697+0000", 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038143399999999999 2024-04-19T03:38:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636137+0000", 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094404369999999994 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83188 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1261568~4096 in=4096b,write 1380352~4096 in=4096b,write 1429504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.622005+0000", 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011613408, 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015997919999999999, 2024-04-19T03:38:22.894 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83188 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622005+0000", 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622005+0000", 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622004+0000", 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622019+0000", 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4528999999999999e-05 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622031+0000", 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2376e-05 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622039+0000", 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6920000000000002e-06 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622073+0000", 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3896999999999997e-05 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622131+0000", 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8437999999999999e-05 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83225 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.635445+0000", 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9981732, 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0026320580000000001, 2024-04-19T03:38:22.898 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83225 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635445+0000", 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635445+0000", 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635445+0000", 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635456+0000", 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1358e-05 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635463+0000", 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0709999999999997e-06 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635469+0000", 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4580000000000001e-06 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83121 4.2c 4:36128e15:::100000001f8.00000008:head [write 1064960~4096 in=4096b,write 1105920~4096 in=4096b,write 1236992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.598464+0000", 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.035154791999999997, 2024-04-19T03:38:22.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.039696423000000002, 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83121 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598464+0000", 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598464+0000", 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598463+0000", 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598509+0000", 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5964999999999998e-05 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598518+0000", 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4069999999999993e-06 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598526+0000", 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2470000000000008e-06 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598744+0000", 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00021820699999999999 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.598828+0000", 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3738000000000004e-05 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83159 4.12 4:4be51a30:::100000001f8.0000000b:head [write 266240~4096 in=4096b,write 319488~4096 in=4096b,write 458752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.610506+0000", 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.023112342000000001, 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027741506999999999, 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.905 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83159 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610506+0000", 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610506+0000", 2024-04-19T03:38:22.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610506+0000", 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610535+0000", 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9130999999999999e-05 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610547+0000", 2024-04-19T03:38:22.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2387e-05 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.610554+0000", 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.703e-06 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629078+0000", 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018523846 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629173+0000", 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5186000000000006e-05 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.629321+0000", 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000147505 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636214+0000", 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068935009999999998 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83189 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 3678208~4096 in=4096b,write 3686400~4096 in=4096b,write 3846144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.622281+0000", 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011337826000000001, 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016071665999999998, 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83189 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622281+0000", 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622281+0000", 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622280+0000", 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622295+0000", 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4717e-05 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622306+0000", 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1157e-05 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622314+0000", 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2449999999999998e-06 2024-04-19T03:38:22.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624345+0000", 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020306870000000002 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624425+0000", 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0246000000000004e-05 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.624590+0000", 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016461899999999999 2024-04-19T03:38:22.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.630758+0000", 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061680290000000002 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83226 4.29 4:94178d8a:::100000001f8.00000006:head [write 1003520~4096 in=4096b,write 1064960~4096 in=4096b,write 1101824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.635474+0000", 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9981446, 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0029740309999999998, 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83226 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635474+0000", 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635474+0000", 2024-04-19T03:38:22.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635474+0000", 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635483+0000", 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8090000000000004e-06 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635490+0000", 2024-04-19T03:38:22.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7270000000000001e-06 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635496+0000", 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6219999999999997e-06 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635539+0000", 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2732999999999999e-05 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635614+0000", 2024-04-19T03:38:22.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5506000000000005e-05 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83187 4.33 e61/14 4:cf6d7a6c:::100000001f8.0000000a:head v 61'1268, mlcod=61'1264)", 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.622543+0000", 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011075463000000001, 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015976924999999999, 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622543+0000", 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622543+0000", 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622543+0000", 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622555+0000", 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2649999999999999e-05 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622565+0000", 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0138e-05 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622573+0000", 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.029e-06 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.631982+0000", 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0094093809999999996 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.632004+0000", 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1594e-05 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83222 4.19 e61/14 4:9a4319fb:::100000001f8.0000002a:head v 61'2615, mlcod=61'2610)", 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.635530+0000", 2024-04-19T03:38:22.921 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9980888, 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0030585880000000001, 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635530+0000", 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635530+0000", 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635530+0000", 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635544+0000", 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4907e-05 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635555+0000", 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0101999999999999e-05 2024-04-19T03:38:22.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635561+0000", 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.19e-06 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636878+0000", 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013172539999999999 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.636895+0000", 2024-04-19T03:38:22.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6779999999999999e-05 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83123 4.c 4:33b8095f:::100000001f8.0000003a:head [write 1486848~4096 in=4096b,write 1499136~4096 in=4096b,write 1544192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.599180+0000", 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.034439136000000002, 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.039481710000000003, 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.925 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83123 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599180+0000", 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599180+0000", 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599179+0000", 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599191+0000", 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2041e-05 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599201+0000", 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9990000000000003e-06 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599208+0000", 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3440000000000003e-06 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599251+0000", 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3136000000000002e-05 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.599341+0000", 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9516000000000001e-05 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:83191 4.1b 4.d7c0abdb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.622986+0000", 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010632388, 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015761560000000001, 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 83191 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622986+0000", 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622986+0000", 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622985+0000", 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.622999+0000", 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3998e-05 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623011+0000", 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1568e-05 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623020+0000", 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.931 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83220 4.6 e61/14)", 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.635566+0000", 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9980521, 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032417050000000001, 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635566+0000", 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635566+0000", 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635566+0000", 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635577+0000", 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1048e-05 2024-04-19T03:38:22.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635583+0000", 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6400000000000002e-06 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635587+0000", 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5820000000000003e-06 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83153 4.36 e61/14 4:6fa85f86:::100000001f8.00000013:head v 61'3900, mlcod=61'3896)", 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.612575+0000", 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021043678, 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.026292704, 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612575+0000", 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612575+0000", 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612575+0000", 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612586+0000", 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0878e-05 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612589+0000", 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7620000000000001e-06 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.612593+0000", 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1190000000000001e-06 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.625566+0000", 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012973114000000001 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.625583+0000", 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7382000000000001e-05 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83190 4.28 e61/14 4:15eeb89b:::100000001f8.00000032:head v 61'2605, mlcod=61'2601)", 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.623078+0000", 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010540311, 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015857238999999999, 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623078+0000", 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623078+0000", 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623078+0000", 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623112+0000", 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3732000000000002e-05 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623121+0000", 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9029999999999999e-06 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.623129+0000", 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0639999999999996e-06 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.625583+0000", 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0024547710000000001 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.625603+0000", 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9862999999999999e-05 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:83221 4.36 e61/14)", 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:22.635600+0000", 2024-04-19T03:38:22.941 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9980192, 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034121400000000001, 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635600+0000", 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635600+0000", 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:22.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635599+0000", 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635610+0000", 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0631999999999999e-05 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635616+0000", 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4899999999999997e-06 2024-04-19T03:38:22.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:22.635621+0000", 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7369999999999997e-06 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 82 2024-04-19T03:38:22.944 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:22.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:22.946 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:22.944+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:23.046 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:23.045+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:23.125 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:23.125 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:23.125 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:23.125 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:23.125 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:23.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:23.183 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:23.181+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:23.248 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:23.247+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:23.331 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:23.331 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:23.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:23.331 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:23.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.331 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.331 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.096149689000001, 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:23.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:23.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:23.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:23.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:23.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.094994355000001, 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.337 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:23.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:23.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:23.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:23.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:23.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.093563459, 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.343 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:23.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:23.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.348 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.092700491, 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.352 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.092267299, 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:23.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:23.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.357 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.090819262, 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:23.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:23.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.090144091000001, 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:23.363 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:23.367 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.088653520999999, 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.371 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.088251413, 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.375 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.088208039, 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:23.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:23.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:23.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.088176124, 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:23.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:23.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.086734825000001, 2024-04-19T03:38:23.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:23.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.086479386000001, 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.085786445, 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.394 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:23.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:23.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:23.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62831 4.36 e58/14 4:6fa85f86:::100000001f8.00000013:head v 58'2938, mlcod=58'2936)", 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 10.084784581999999, 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074231808999999996, 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.399 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243852+0000", 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243867+0000", 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4694e-05 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291730+0000", 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.047863307000000001 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291749+0000", 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9361999999999999e-05 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292182+0000", 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00043303999999999999 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292206+0000", 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3519999999999998e-05 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318066+0000", 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025860409000000001 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318084+0000", 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.806e-05 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.2490481770000006, 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.403 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:23.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.408 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.248354333, 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.409 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:23.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.414 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.2479520320000006, 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:23.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:23.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:23.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.2453481780000004, 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.420 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.2449894730000004, 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:23.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:23.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:23.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:23.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:23.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.431 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:23.431 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:23.431 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:23.433 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:38:23.433 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:23.431+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:23.434 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:23.534 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:23.533+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:23.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:23.634 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:23.633+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:23.644 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:85473 4.14 4:2b28d75f:::100000001f8.00000016:head [write 2969600~8192 in=8192b,write 2985984~4096 in=4096b,write 3059712~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:38:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:23.636796+0000", 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0044441300000000001, 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044830369999999996, 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 85473 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.636796+0000", 2024-04-19T03:38:23.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.636796+0000", 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.636796+0000", 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:23.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.636814+0000", 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8077999999999999e-05 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.636826+0000", 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1986e-05 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.636834+0000", 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4600000000000003e-06 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:23.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.636884+0000", 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0263000000000003e-05 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.636939+0000", 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4827999999999998e-05 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637054+0000", 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114537 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639861+0000", 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028076939999999999 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:85475 4.19 4:997b7129:::100000001f8.00000000:head [write 172032~4096 in=4096b,write 417792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:23.637543+0000", 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0036975340000000002, 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589940000000001, 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:23.649 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 85475 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637543+0000", 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637543+0000", 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637542+0000", 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637555+0000", 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2995e-05 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637577+0000", 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1809000000000001e-05 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637587+0000", 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0485999999999999e-05 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637637+0000", 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9731000000000002e-05 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637722+0000", 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4697999999999994e-05 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637879+0000", 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156964 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640230+0000", 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023511339999999999 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:85478 4.1c 4:39b842ef:::100000001f8.00000029:head [write 864256~4096 in=4096b,write 1871872~4096 in=4096b,write 1896448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:23.639120+0000", 2024-04-19T03:38:23.653 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0021203950000000002, 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002394841, 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 85478 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639120+0000", 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639120+0000", 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639119+0000", 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639146+0000", 2024-04-19T03:38:23.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6475e-05 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639157+0000", 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1369000000000001e-05 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639164+0000", 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4359999999999996e-06 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639210+0000", 2024-04-19T03:38:23.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5166000000000001e-05 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639318+0000", 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010818 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639470+0000", 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015244100000000001 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:85479 4.3 4:c222b65c:::100000001f8.00000021:head [write 3629056~4096 in=4096b,write 4026368~4096 in=4096b,write 4100096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:23.639580+0000", 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001660258, 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020411420000000001, 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 85479 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:23.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639580+0000", 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639580+0000", 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639579+0000", 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639613+0000", 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3646999999999998e-05 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639626+0000", 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2737e-05 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639635+0000", 2024-04-19T03:38:23.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4050000000000006e-06 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639687+0000", 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1795000000000001e-05 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.639745+0000", 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8350000000000002e-05 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:85480 4.37 e62/14 4:ecbf0fb2:::100000001f8.00000038:head v 62'3981, mlcod=62'3979)", 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:23.640464+0000", 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0007762, 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001206401, 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640464+0000", 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640464+0000", 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640464+0000", 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640491+0000", 2024-04-19T03:38:23.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7702e-05 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640502+0000", 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0766e-05 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640509+0000", 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.81e-06 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640559+0000", 2024-04-19T03:38:23.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9697000000000002e-05 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640581+0000", 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2684000000000002e-05 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:85482 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3928064~4096 in=4096b,write 3944448~4096 in=4096b,write 3964928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:23.640930+0000", 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00031003699999999999, 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00080099100000000003, 2024-04-19T03:38:23.665 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 85482 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640930+0000", 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640930+0000", 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640929+0000", 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640943+0000", 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4022000000000001e-05 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640955+0000", 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1025e-05 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.640962+0000", 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.641005+0000", 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2682999999999998e-05 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.641069+0000", 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3540999999999994e-05 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.641226+0000", 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015707500000000001 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:85467 4.6 4:616d4c41:::100000001f8.00000034:head [write 1200128~4096 in=4096b,write 1208320~4096 in=4096b,write 1265664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:23.634098+0000", 2024-04-19T03:38:23.669 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0071423429999999998, 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0077053299999999998, 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 85467 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634098+0000", 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634098+0000", 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634097+0000", 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634113+0000", 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5508000000000001e-05 2024-04-19T03:38:23.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634135+0000", 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1923e-05 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634144+0000", 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8550000000000008e-06 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.635153+0000", 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001009675 2024-04-19T03:38:23.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.635243+0000", 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0264000000000002e-05 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.635450+0000", 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020626100000000001 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.638519+0000", 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030693180000000001 2024-04-19T03:38:23.673 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:85468 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 3993600~4096 in=4096b,write 4116480~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:23.634462+0000", 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0067787250000000002, 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074272829999999998, 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 85468 2024-04-19T03:38:23.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634462+0000", 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634462+0000", 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634461+0000", 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:23.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634498+0000", 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7426999999999999e-05 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634512+0000", 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3427999999999999e-05 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.634520+0000", 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2169999999999994e-06 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.635139+0000", 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061856400000000005 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.635223+0000", 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4398000000000001e-05 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.635403+0000", 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180151 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:23.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:23.637829+0000", 2024-04-19T03:38:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024256740000000001 2024-04-19T03:38:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:23.678 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 8 2024-04-19T03:38:23.678 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:23.679 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:23.735 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:23.734+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:23.802 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:23.827 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:23.827 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:23.827 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:23.827 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:23.830 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:23.831 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:23.837 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:23.835+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:23.901 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:23.901 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:23.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:23.956 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:23.955+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:24.037 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:24.036+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:24.138 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:24.137+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:24.163 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:24.164 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:24.180 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:24.239 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:24.238+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:24.340 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:24.339+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:24.369 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:24.369 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:24.383 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:24.441 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:24.440+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:24.542 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:24.542+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:24.607 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:24.607 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:24.624 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:24.665 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:24.664+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:24.743 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:24.743+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:24.844 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:24.843+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:24.849 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:24.849 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:24.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:24.945 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:24.944+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:25.047 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:25.046+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:25.069 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:25.070 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:25.088 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:25.172 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:25.171+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:25.247 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:25.246+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:25.342 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:25.342 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:25.349 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:25.348+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:25.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:25.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:38:25.450 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:25.448+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:25.551 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:25.550+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:25.614 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:25.614 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:25.632 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:25.677 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:25.676+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:25.753 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:25.752+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:25.820 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:25.820 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:25.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:25.836 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:25.877 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:25.876+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:25.955 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:25.954+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:38:26.030 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:26.049 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:26.049 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:26.055 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:26.056 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:26.054+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:26.056 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:26.056 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:26.056 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:26.059 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:26.059 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:26.065 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:26.156 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:26.155+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:26.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-04-19T03:38:26.260 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:26.257+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.059288377, 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.294 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:26.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.058133043, 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.299 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.304 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.056702146999999, 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.305 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:26.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.310 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.055839178999999, 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:26.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.055405987, 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.319 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.053957949999999, 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:26.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.053282779, 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:26.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:26.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.051792209, 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.329 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:26.333 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.051390101000001, 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:26.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:26.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:26.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.051346727, 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.051314811999999, 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.049873513, 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.346 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:26.351 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.049618074, 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:26.355 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.048925132999999, 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62831 4.36 e58/14 4:6fa85f86:::100000001f8.00000013:head v 58'2938, mlcod=58'2936)", 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.04792327, 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074231808999999996, 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.360 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243852+0000", 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243867+0000", 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4694e-05 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291730+0000", 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.047863307000000001 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291749+0000", 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9361999999999999e-05 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292182+0000", 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00043303999999999999 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292206+0000", 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3519999999999998e-05 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318066+0000", 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025860409000000001 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318084+0000", 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.806e-05 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.364 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.212186865, 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.367 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:26.368 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:26.369 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.211493021000001, 2024-04-19T03:38:26.370 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.371 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.372 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.373 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:26.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.21109072, 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.376 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.381 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.208486865999999, 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:26.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 12.208128160999999, 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.387 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:26.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:26.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:26.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:26.392 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:26.394 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:26.394 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:26.392+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:26.494 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:26.493+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:26.596 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:26.594+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:26.607 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:26.607 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:26.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.607 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4526.0:91881 4.6 e63/14 ondisk, result = 0)", 2024-04-19T03:38:26.607 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.598413+0000", 2024-04-19T03:38:26.607 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0061138779999999997, 2024-04-19T03:38:26.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061376490000000002, 2024-04-19T03:38:26.607 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598413+0000", 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598413+0000", 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598413+0000", 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598417+0000", 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.515e-06 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598427+0000", 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9229999999999997e-06 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598434+0000", 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604477+0000", 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060432929999999999 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604495+0000", 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8068e-05 2024-04-19T03:38:26.610 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91895 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.598625+0000", 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0059019720000000001, 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060175239999999998, 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.611 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91895 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598625+0000", 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598625+0000", 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598624+0000", 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598637+0000", 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2649999999999999e-05 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598646+0000", 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4569999999999994e-06 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598652+0000", 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3970000000000002e-06 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91897 4.24 4:27adda6e:::100000001f8.0000000f:head [write 2293760~4096 in=4096b,write 2531328~4096 in=4096b,write 2576384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.599379+0000", 2024-04-19T03:38:26.614 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0051478560000000001, 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053532959999999996, 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91897 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599379+0000", 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599379+0000", 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599379+0000", 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599406+0000", 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7022999999999999e-05 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599414+0000", 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.926e-06 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599419+0000", 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4489999999999998e-06 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599467+0000", 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8340999999999997e-05 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599590+0000", 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000122323 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.618 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91898 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 3502080~4096 in=4096b,write 3563520~4096 in=4096b,write 3592192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.599791+0000", 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.004736461, 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050334459999999996, 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91898 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599791+0000", 2024-04-19T03:38:26.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599791+0000", 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599790+0000", 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599803+0000", 2024-04-19T03:38:26.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2714999999999999e-05 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599810+0000", 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3440000000000003e-06 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599814+0000", 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3089999999999997e-06 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599851+0000", 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6485000000000001e-05 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.599905+0000", 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4722999999999998e-05 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91899 4.28 4:153ae410:::100000001f8.0000003b:head [write 4018176~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.622 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.600109+0000", 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0044177160000000004, 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048359659999999997, 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91899 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600109+0000", 2024-04-19T03:38:26.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600109+0000", 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600108+0000", 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600120+0000", 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1659e-05 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600131+0000", 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0613e-05 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600138+0000", 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2359999999999998e-06 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600186+0000", 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8164999999999997e-05 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600262+0000", 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6297000000000005e-05 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600403+0000", 2024-04-19T03:38:26.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014057800000000001 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604353+0000", 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039498040000000003 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:91900 4.37 e63/14 4:eff9002a:::100000001f8.00000003:head v 63'4285, mlcod=63'4283)", 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.600616+0000", 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0039109699999999997, 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044320849999999997, 2024-04-19T03:38:26.627 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600616+0000", 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600616+0000", 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600615+0000", 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600631+0000", 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5662999999999999e-05 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600639+0000", 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5040000000000002e-06 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600657+0000", 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7056999999999999e-05 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600743+0000", 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6102999999999999e-05 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600759+0000", 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5985999999999999e-05 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91901 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.600668+0000", 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0038589240000000001, 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044446149999999999, 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91901 2024-04-19T03:38:26.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600668+0000", 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600668+0000", 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600667+0000", 2024-04-19T03:38:26.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600710+0000", 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3081999999999998e-05 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600722+0000", 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1704e-05 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600731+0000", 2024-04-19T03:38:26.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3540000000000006e-06 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91902 4.31 4:8fb8ba0c:::100000001f8.00000024:head [write 3678208~4096 in=4096b,write 3989504~4096 in=4096b,write 4075520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.601202+0000", 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.003324783, 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039733950000000002, 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.634 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91902 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601202+0000", 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601202+0000", 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601201+0000", 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601246+0000", 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4255000000000002e-05 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601259+0000", 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3259e-05 2024-04-19T03:38:26.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601266+0000", 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.605e-06 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601323+0000", 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6895999999999999e-05 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601414+0000", 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0438000000000004e-05 2024-04-19T03:38:26.637 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91903 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 1150976~4096 in=4096b,write 1277952~4096 in=4096b,write 1290240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.601532+0000", 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0029945850000000001, 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037198940000000001, 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.638 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91903 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601532+0000", 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601532+0000", 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601532+0000", 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601546+0000", 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4436e-05 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601556+0000", 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0282000000000001e-05 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601564+0000", 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601610+0000", 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5899000000000002e-05 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601685+0000", 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5437000000000003e-05 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:26.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.601844+0000", 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158488 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91904 4.d 4:b1164065:::100000001f8.00000035:head [write 2662400~8192 in=8192b,write 2719744~4096 in=4096b,write 2916352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.602762+0000", 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001765464, 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025866109999999999, 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.642 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91904 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602762+0000", 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602762+0000", 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602761+0000", 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602777+0000", 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5993000000000001e-05 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602787+0000", 2024-04-19T03:38:26.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0849999999999999e-05 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602796+0000", 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602844+0000", 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8755999999999999e-05 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602929+0000", 2024-04-19T03:38:26.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5105000000000006e-05 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91906 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 2400256~4096 in=4096b,write 2646016~4096 in=4096b,write 2662400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.602810+0000", 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001717285, 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002618928, 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.646 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91906 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602810+0000", 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602810+0000", 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602809+0000", 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602821+0000", 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2135e-05 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602829+0000", 2024-04-19T03:38:26.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2660000000000004e-06 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602836+0000", 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0469999999999996e-06 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603145+0000", 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000309318 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603223+0000", 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7902000000000001e-05 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:91905 4.2f e63/14 4:f59f865b:::100000001f8.00000007:head v 63'1425, mlcod=63'1423)", 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.602967+0000", 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00156021, 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025351639999999999, 2024-04-19T03:38:26.650 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602967+0000", 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602967+0000", 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602966+0000", 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602981+0000", 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4149e-05 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602989+0000", 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9230000000000002e-06 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.602994+0000", 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4620000000000004e-06 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603334+0000", 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00034047500000000002 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603353+0000", 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8943000000000001e-05 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91907 4.3 4:c222b65c:::100000001f8.00000021:head [write 2863104~4096 in=4096b,write 2891776~4096 in=4096b,write 2924544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.603114+0000", 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0014133430000000001, 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024612639999999999, 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91907 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.654 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603114+0000", 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603114+0000", 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603113+0000", 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603127+0000", 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4217e-05 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603138+0000", 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944999999999999e-05 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603146+0000", 2024-04-19T03:38:26.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9570000000000002e-06 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603317+0000", 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017095700000000001 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603402+0000", 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5004000000000001e-05 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91883 4.6 4:616d4c41:::100000001f8.00000034:head [write 1105920~4096 in=4096b,write 1150976~4096 in=4096b,write 1249280~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.592515+0000", 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.012012004999999999, 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013138606000000001, 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91883 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.592515+0000", 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.592515+0000", 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.592514+0000", 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.592536+0000", 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2002e-05 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.592559+0000", 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3088999999999999e-05 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.592571+0000", 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1522000000000001e-05 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598120+0000", 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055490440000000004 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598215+0000", 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5597e-05 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.598397+0000", 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018209199999999999 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604541+0000", 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0061440419999999997 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91908 4.13 4:caef1406:::100000001f8.00000031:head [write 3817472~4096 in=4096b,write 3997696~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.603651+0000", 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00087568300000000004, 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020949829999999999, 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:26.662 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91908 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603651+0000", 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603651+0000", 2024-04-19T03:38:26.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603650+0000", 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603667+0000", 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6543999999999999e-05 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603681+0000", 2024-04-19T03:38:26.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4358e-05 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603689+0000", 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9999999999999996e-06 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603731+0000", 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1607999999999999e-05 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603820+0000", 2024-04-19T03:38:26.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9282000000000003e-05 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91909 4.3 4.3a6d4443 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.603988+0000", 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00053923199999999995, 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001828016, 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91909 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603988+0000", 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603988+0000", 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.603987+0000", 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604001+0000", 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4326e-05 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604011+0000", 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0013000000000001e-05 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604018+0000", 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8719999999999996e-06 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:91910 4.23 e63/14)", 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.604754+0000", 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.999773, 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011169210000000001, 2024-04-19T03:38:26.669 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604754+0000", 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604754+0000", 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604753+0000", 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604769+0000", 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5503e-05 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604779+0000", 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9969999999999993e-06 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604786+0000", 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5490000000000001e-06 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91889 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 204800~4096 in=4096b,write 245760~4096 in=4096b,write 266240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.595284+0000", 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0092432850000000004, 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010644514000000001, 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.672 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91889 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.595284+0000", 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.595284+0000", 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.595283+0000", 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.595298+0000", 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4997999999999999e-05 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.595308+0000", 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0703999999999999e-05 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.595316+0000", 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7069999999999992e-06 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600295+0000", 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049791970000000003 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600370+0000", 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4408999999999999e-05 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.600537+0000", 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016674999999999999 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:91892 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 598016~4096 in=4096b,write 651264~4096 in=4096b,write 819200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:26.596844+0000", 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0076832610000000003, 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0091661750000000004, 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:26.676 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 91892 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.596844+0000", 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.596844+0000", 2024-04-19T03:38:26.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.596843+0000", 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.596857+0000", 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3852999999999999e-05 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.596870+0000", 2024-04-19T03:38:26.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3437e-05 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.596878+0000", 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604622+0000", 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0077437890000000001 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604685+0000", 2024-04-19T03:38:26.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3266e-05 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:26.604818+0000", 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013323100000000001 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 19 2024-04-19T03:38:26.680 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:26.681 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:26.699 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:26.696+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:26.799 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:26.798+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:26.899 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:26.897+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:26.936 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:26.936 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:26.936 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:26.937 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:26.937 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:26.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:27.039 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:27.038+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:27.100 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:27.099+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:27.201 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:27.200+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:27.214 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:27.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:27.215 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:27.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.215 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62826 4.28 4:153ae410:::100000001f8.0000003b:head [write 2859008~4096,write 2879488~4096,write 2994176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.215 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:27.215 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.972404992, 2024-04-19T03:38:27.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082994795999999996, 2024-04-19T03:38:27.215 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.215 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62826 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238468+0000", 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238495+0000", 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6894999999999999e-05 2024-04-19T03:38:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238509+0000", 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4479e-05 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238518+0000", 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5879999999999998e-06 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239736+0000", 2024-04-19T03:38:27.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001217982 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239833+0000", 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7609999999999995e-05 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240012+0000", 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017837300000000001 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241924+0000", 2024-04-19T03:38:27.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019127059999999999 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321356+0000", 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079431515999999994 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321413+0000", 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6657000000000003e-05 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321464+0000", 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1004999999999997e-05 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62827 4.14 4:2b28d75f:::100000001f8.00000016:head [write 2510848~4096,write 2531328~4096,write 2609152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.972007023, 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078975696999999997, 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62827 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.221 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238866+0000", 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238880+0000", 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4592e-05 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238891+0000", 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866000000000001e-05 2024-04-19T03:38:27.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238903+0000", 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1409e-05 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238947+0000", 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4249000000000003e-05 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239039+0000", 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1673000000000001e-05 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239193+0000", 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000154766 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241112+0000", 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001918248 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317726+0000", 2024-04-19T03:38:27.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.076614071000000006 2024-04-19T03:38:27.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317798+0000", 2024-04-19T03:38:27.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2123e-05 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317842+0000", 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4651000000000003e-05 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62828 4.15 4:aada5e43:::100000001f8.00000028:head [write 3923968~4096,write 4173824~4096,write 4182016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:27.227 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.971484652999999, 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080658297000000004, 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62828 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239388+0000", 2024-04-19T03:38:27.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239425+0000", 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239444+0000", 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8615e-05 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239454+0000", 2024-04-19T03:38:27.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7319999999999993e-06 2024-04-19T03:38:27.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239500+0000", 2024-04-19T03:38:27.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6529000000000001e-05 2024-04-19T03:38:27.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239594+0000", 2024-04-19T03:38:27.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3849000000000002e-05 2024-04-19T03:38:27.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239755+0000", 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000160636 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241461+0000", 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001706017 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.319969+0000", 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078508475999999994 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320011+0000", 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1897999999999998e-05 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320047+0000", 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6257999999999997e-05 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62829 4.6 4:616d4c41:::100000001f8.00000034:head [write 278528~4096,write 290816~4096,write 315392~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.971162027, 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080406688000000004, 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62829 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239711+0000", 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239756+0000", 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5117000000000002e-05 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239767+0000", 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239773+0000", 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6749999999999999e-06 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239813+0000", 2024-04-19T03:38:27.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0564e-05 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239873+0000", 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9837000000000003e-05 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240017+0000", 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014359799999999999 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247032+0000", 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070153300000000002 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320024+0000", 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.072991901999999997 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320075+0000", 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1644000000000002e-05 2024-04-19T03:38:27.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320118+0000", 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3016000000000003e-05 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62830 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3342336~4096,write 3416064~4096,write 3444736~12288] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.970320655, 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079711315000000005, 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.241 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62830 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240552+0000", 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240572+0000", 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9324999999999999e-05 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240583+0000", 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1422e-05 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240591+0000", 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9300000000000003e-06 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241899+0000", 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001307938 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241952+0000", 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3220999999999997e-05 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.242053+0000", 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010141000000000001 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247058+0000", 2024-04-19T03:38:27.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050044659999999999 2024-04-19T03:38:27.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320176+0000", 2024-04-19T03:38:27.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.073118060999999998 2024-04-19T03:38:27.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320223+0000", 2024-04-19T03:38:27.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7231000000000002e-05 2024-04-19T03:38:27.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320264+0000", 2024-04-19T03:38:27.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1236000000000003e-05 2024-04-19T03:38:27.248 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.248 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.248 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.248 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62831 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2031616~4096,write 2043904~4096,write 2138112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.248 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:27.248 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.969329885000001, 2024-04-19T03:38:27.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078715436, 2024-04-19T03:38:27.249 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.249 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.249 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.249 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.249 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.249 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62831 2024-04-19T03:38:27.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.249 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:27.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241543+0000", 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241558+0000", 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4491000000000001e-05 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241571+0000", 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3029e-05 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241579+0000", 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2024-04-19T03:38:27.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243598+0000", 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002019337 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243646+0000", 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8183999999999998e-05 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243736+0000", 2024-04-19T03:38:27.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9691999999999994e-05 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248424+0000", 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046880960000000001 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320165+0000", 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071741299999999994 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320218+0000", 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2271000000000001e-05 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320259+0000", 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1777000000000003e-05 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.255 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.967693498999999, 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:27.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:27.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:27.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:27.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:27.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:27.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:27.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:27.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:27.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:27.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.264 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.965072878000001, 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:27.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:27.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:27.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:27.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:27.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:27.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:27.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:27.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:27.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:27.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:27.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:27.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:27.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:27.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:27.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.962629457, 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.273 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.274 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:27.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.274 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:27.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:27.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:27.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:27.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:27.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:27.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:27.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:27.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:27.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:27.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.961861812, 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:27.281 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.288 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62860 4.6 4:63e80496:::100000001f8.0000001e:head [write 3608576~4096,write 3649536~4096,write 4050944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:27.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.956913375999999, 2024-04-19T03:38:27.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082270504999999994, 2024-04-19T03:38:27.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.289 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.289 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.289 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.290 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.290 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62860 2024-04-19T03:38:27.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.290 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:27.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253959+0000", 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253974+0000", 2024-04-19T03:38:27.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4139e-05 2024-04-19T03:38:27.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253993+0000", 2024-04-19T03:38:27.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8955999999999999e-05 2024-04-19T03:38:27.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254001+0000", 2024-04-19T03:38:27.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8130000000000002e-06 2024-04-19T03:38:27.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254042+0000", 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0728e-05 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254096+0000", 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4147000000000002e-05 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254218+0000", 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121736 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256573+0000", 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002355261 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336147+0000", 2024-04-19T03:38:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079574000000000006 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336193+0000", 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5881999999999999e-05 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336231+0000", 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7793999999999998e-05 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.296 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.297 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.297 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62867 4.6 4:616d4c41:::100000001f8.00000034:head [write 3358720~4096,write 3641344~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.297 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:27.297 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.954067516, 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079551001999999996, 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62867 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:27.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:27.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256805+0000", 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256820+0000", 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4856e-05 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256834+0000", 2024-04-19T03:38:27.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.344e-05 2024-04-19T03:38:27.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256843+0000", 2024-04-19T03:38:27.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7829999999999993e-06 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256891+0000", 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7704000000000003e-05 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.257012+0000", 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012072499999999999 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.257176+0000", 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164554 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260920+0000", 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037431470000000001 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336292+0000", 2024-04-19T03:38:27.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.075372163000000006 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336325+0000", 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3182999999999997e-05 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336357+0000", 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2391000000000002e-05 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.951269608, 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:27.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.310 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.948568484999999, 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.312 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.312 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.312 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:27.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.312 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:27.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:27.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:27.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62888 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2416640~4096,write 2445312~4096,write 2744320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.9452464, 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083295955000000005, 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62888 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265662+0000", 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5512000000000002e-05 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265673+0000", 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0429e-05 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265678+0000", 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6779999999999997e-06 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265716+0000", 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7367000000000003e-05 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265773+0000", 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7500000000000002e-05 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265910+0000", 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013703700000000001 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268901+0000", 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029905539999999999 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348859+0000", 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079958414000000005 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348895+0000", 2024-04-19T03:38:27.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5652999999999999e-05 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348923+0000", 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8603999999999999e-05 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62892 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3272704~4096,write 3305472~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.943817081000001, 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.081941512999999994, 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62892 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267055+0000", 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267070+0000", 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4296e-05 2024-04-19T03:38:27.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267083+0000", 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3451e-05 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267092+0000", 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9409999999999996e-06 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267331+0000", 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023835999999999999 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267390+0000", 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9388999999999997e-05 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267500+0000", 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109651 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.269522+0000", 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020223200000000002 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348951+0000", 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079429079999999999 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348979+0000", 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7572e-05 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348998+0000", 2024-04-19T03:38:27.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.969e-05 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62895 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 4104192~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.942628600999999, 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080708229000000006, 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.330 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62895 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268244+0000", 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268263+0000", 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8410000000000002e-05 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268282+0000", 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9177999999999998e-05 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268291+0000", 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6260000000000001e-06 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268330+0000", 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9835000000000001e-05 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268409+0000", 2024-04-19T03:38:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8597000000000007e-05 2024-04-19T03:38:27.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268515+0000", 2024-04-19T03:38:27.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105925 2024-04-19T03:38:27.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.270754+0000", 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022391109999999998 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348876+0000", 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078122081999999995 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348917+0000", 2024-04-19T03:38:27.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.104e-05 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348953+0000", 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6276000000000003e-05 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:27.336 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.080472954999999, 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:27.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:27.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:27.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:27.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:27.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:27.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:27.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:27.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:27.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:27.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:27.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.345 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64817 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3067904~4096,write 3092480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.345 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130822+0000", 2024-04-19T03:38:27.345 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.080052097999999, 2024-04-19T03:38:27.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078473251999999993, 2024-04-19T03:38:27.345 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.345 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.345 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64817 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130822+0000", 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130822+0000", 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130821+0000", 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130835+0000", 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4105e-05 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130917+0000", 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1793999999999996e-05 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130927+0000", 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0273e-05 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.174863+0000", 2024-04-19T03:38:27.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.043935241999999999 2024-04-19T03:38:27.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.174949+0000", 2024-04-19T03:38:27.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6137000000000006e-05 2024-04-19T03:38:27.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.175094+0000", 2024-04-19T03:38:27.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014537900000000001 2024-04-19T03:38:27.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.191295+0000", 2024-04-19T03:38:27.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016200491000000001 2024-04-19T03:38:27.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.209209+0000", 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017914195000000001 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.209252+0000", 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3263000000000002e-05 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.209295+0000", 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2830000000000002e-05 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64911 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 974848~4096,write 1024000~4096,write 1384448~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.050432418, 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080437593000000002, 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:27.353 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:27.354 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.354 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64911 2024-04-19T03:38:27.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.354 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:27.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:27.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:27.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160440+0000", 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160459+0000", 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8419000000000001e-05 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.161129+0000", 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00067022399999999997 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.161145+0000", 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727999999999999e-05 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218134+0000", 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.056989712999999997 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218224+0000", 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9463999999999996e-05 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218410+0000", 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185985 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.231493+0000", 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013083347 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240797+0000", 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0093039620000000007 2024-04-19T03:38:27.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240843+0000", 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6153999999999999e-05 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240879+0000", 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5769999999999998e-05 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:27.360 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:27.360 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:27.362 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:27.362 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:27.360+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:27.463 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:27.462+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:27.553 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:93867 4.33 e63/14 4:cf6d7a6c:::100000001f8.0000000a:head v 63'1444, mlcod=63'1442)", 2024-04-19T03:38:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.547672+0000", 2024-04-19T03:38:27.554 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0035424720000000001, 2024-04-19T03:38:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035652029999999999, 2024-04-19T03:38:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547672+0000", 2024-04-19T03:38:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547672+0000", 2024-04-19T03:38:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547671+0000", 2024-04-19T03:38:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547687+0000", 2024-04-19T03:38:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6178e-05 2024-04-19T03:38:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547697+0000", 2024-04-19T03:38:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7399999999999999e-06 2024-04-19T03:38:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547704+0000", 2024-04-19T03:38:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5089999999999999e-06 2024-04-19T03:38:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547741+0000", 2024-04-19T03:38:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6918000000000001e-05 2024-04-19T03:38:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547760+0000", 2024-04-19T03:38:27.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9579e-05 2024-04-19T03:38:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.563 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:93868 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 1003520~4096 in=4096b,write 1011712~4096 in=4096b,write 1105920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.547805+0000", 2024-04-19T03:38:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0034094920000000001, 2024-04-19T03:38:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035121359999999999, 2024-04-19T03:38:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.564 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 93868 2024-04-19T03:38:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547805+0000", 2024-04-19T03:38:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547805+0000", 2024-04-19T03:38:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547804+0000", 2024-04-19T03:38:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547818+0000", 2024-04-19T03:38:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4229999999999999e-05 2024-04-19T03:38:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547828+0000", 2024-04-19T03:38:27.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0020999999999999e-05 2024-04-19T03:38:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547836+0000", 2024-04-19T03:38:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7489999999999998e-06 2024-04-19T03:38:27.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547876+0000", 2024-04-19T03:38:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0057e-05 2024-04-19T03:38:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.547966+0000", 2024-04-19T03:38:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0358000000000005e-05 2024-04-19T03:38:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.572 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:93870 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.548624+0000", 2024-04-19T03:38:27.573 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0025899149999999999, 2024-04-19T03:38:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002764702, 2024-04-19T03:38:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:27.574 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 93870 2024-04-19T03:38:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.575 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548624+0000", 2024-04-19T03:38:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548624+0000", 2024-04-19T03:38:27.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548624+0000", 2024-04-19T03:38:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548653+0000", 2024-04-19T03:38:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9544999999999999e-05 2024-04-19T03:38:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548662+0000", 2024-04-19T03:38:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4970000000000001e-06 2024-04-19T03:38:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548667+0000", 2024-04-19T03:38:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5929999999999996e-06 2024-04-19T03:38:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:93869 4.36 e63/14 4:6fa85f86:::100000001f8.00000013:head v 63'4415, mlcod=63'4413)", 2024-04-19T03:38:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.548686+0000", 2024-04-19T03:38:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.002528326, 2024-04-19T03:38:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0027618130000000001, 2024-04-19T03:38:27.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548686+0000", 2024-04-19T03:38:27.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.583 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548686+0000", 2024-04-19T03:38:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548686+0000", 2024-04-19T03:38:27.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548698+0000", 2024-04-19T03:38:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2157000000000001e-05 2024-04-19T03:38:27.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548708+0000", 2024-04-19T03:38:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0292000000000001e-05 2024-04-19T03:38:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548714+0000", 2024-04-19T03:38:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9290000000000003e-06 2024-04-19T03:38:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548740+0000", 2024-04-19T03:38:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5582999999999999e-05 2024-04-19T03:38:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.548752+0000", 2024-04-19T03:38:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1997000000000001e-05 2024-04-19T03:38:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:93872 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.549363+0000", 2024-04-19T03:38:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0018510530000000001, 2024-04-19T03:38:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021456140000000001, 2024-04-19T03:38:27.590 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 93872 2024-04-19T03:38:27.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.549363+0000", 2024-04-19T03:38:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.549363+0000", 2024-04-19T03:38:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.549363+0000", 2024-04-19T03:38:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.549375+0000", 2024-04-19T03:38:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2785e-05 2024-04-19T03:38:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.549385+0000", 2024-04-19T03:38:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3370000000000006e-06 2024-04-19T03:38:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.596 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.549394+0000", 2024-04-19T03:38:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1330000000000005e-06 2024-04-19T03:38:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:93875 4.28 e63/14 4:15eeb89b:::100000001f8.00000032:head v 63'2928, mlcod=63'2924)", 2024-04-19T03:38:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.550798+0000", 2024-04-19T03:38:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00041661299999999998, 2024-04-19T03:38:27.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00077055299999999999, 2024-04-19T03:38:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.550798+0000", 2024-04-19T03:38:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.550798+0000", 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.550797+0000", 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.550811+0000", 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4127e-05 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.550819+0000", 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5619999999999998e-06 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.550825+0000", 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6470000000000003e-06 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.551277+0000", 2024-04-19T03:38:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00045211999999999997 2024-04-19T03:38:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.551289+0000", 2024-04-19T03:38:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2252999999999999e-05 2024-04-19T03:38:27.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:93848 4.38 4:1d13bf87:::100000001f8.00000030:head [write 1568768~4096 in=4096b,write 1581056~4096 in=4096b,write 1724416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.539060+0000", 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.012154549000000001, 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012581370999999999, 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:27.604 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 93848 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.539060+0000", 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.539060+0000", 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.539059+0000", 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.539070+0000", 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0550000000000001e-05 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.539077+0000", 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4250000000000001e-06 2024-04-19T03:38:27.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.539083+0000", 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5899999999999998e-06 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.539132+0000", 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9468999999999997e-05 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.539216+0000", 2024-04-19T03:38:27.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4083000000000001e-05 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:93850 4.28 e63/14 4:15eeb89b:::100000001f8.00000032:head v 63'2926, mlcod=63'2924)", 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.540162+0000", 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011052403000000001, 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011550583999999999, 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.540162+0000", 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.540162+0000", 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.540161+0000", 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.540180+0000", 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8505e-05 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.540191+0000", 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0718e-05 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.540197+0000", 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3559999999999998e-06 2024-04-19T03:38:27.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.540594+0000", 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000396804 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.540610+0000", 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6509999999999999e-05 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:93856 4.15 e63/14 4:aada5e43:::100000001f8.00000028:head v 63'1482, mlcod=63'1480)", 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.542928+0000", 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0082860869999999993, 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0088435900000000001, 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.542928+0000", 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.542928+0000", 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.542928+0000", 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.542940+0000", 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1911e-05 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.542960+0000", 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0273000000000001e-05 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.542966+0000", 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6670000000000001e-06 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.542997+0000", 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.133e-05 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543015+0000", 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7793000000000001e-05 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:93857 4.19 e63/14 4:997b7129:::100000001f8.00000000:head v 63'2941, mlcod=63'2939)", 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.543374+0000", 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.007840316, 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0084582800000000003, 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.615 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543374+0000", 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543374+0000", 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543374+0000", 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543389+0000", 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5610000000000001e-05 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543396+0000", 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0709999999999997e-06 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543402+0000", 2024-04-19T03:38:27.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6540000000000004e-06 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543441+0000", 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8628999999999999e-05 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543460+0000", 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9785000000000001e-05 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:93859 4.38 4:1d13bf87:::100000001f8.00000030:head [write 466944~4096 in=4096b,write 561152~4096 in=4096b,write 671744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.543697+0000", 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.007517007, 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082072889999999996, 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 93859 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543697+0000", 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543697+0000", 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543697+0000", 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543708+0000", 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1467999999999999e-05 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543717+0000", 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9590000000000001e-06 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543724+0000", 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8210000000000004e-06 2024-04-19T03:38:27.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543763+0000", 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9348999999999999e-05 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.544160+0000", 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00039711 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:93858 4.6 e63/14 4:62d56fc8:::100000001f8.0000001c:head v 63'5858, mlcod=63'5856)", 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.543857+0000", 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.007357349, 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0081240050000000001, 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543857+0000", 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543857+0000", 2024-04-19T03:38:27.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543856+0000", 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543869+0000", 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2313000000000001e-05 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543877+0000", 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8329999999999994e-06 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543883+0000", 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0959999999999997e-06 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543952+0000", 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9351999999999996e-05 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.543971+0000", 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9494999999999999e-05 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:93860 4.28 e63/14 4:15eeb89b:::100000001f8.00000032:head v 63'2927, mlcod=63'2924)", 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.544569+0000", 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0066456730000000004, 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0074703829999999997, 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.626 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.544569+0000", 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.544569+0000", 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.544568+0000", 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.544578+0000", 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0030999999999999e-05 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.544588+0000", 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7280000000000007e-06 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.544595+0000", 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1130000000000003e-06 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.544628+0000", 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3238000000000003e-05 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.544648+0000", 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0259999999999999e-05 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:93862 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1077248~4096 in=4096b,write 1150976~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.545289+0000", 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0059251879999999996, 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0068249290000000004, 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 93862 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545289+0000", 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545289+0000", 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545288+0000", 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545299+0000", 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0030000000000001e-05 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545307+0000", 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5059999999999995e-06 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545313+0000", 2024-04-19T03:38:27.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5400000000000003e-06 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545344+0000", 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1270999999999999e-05 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545395+0000", 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0998000000000002e-05 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.551998+0000", 2024-04-19T03:38:27.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066029019999999999 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.552047+0000", 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8780999999999999e-05 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.552124+0000", 2024-04-19T03:38:27.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7478000000000006e-05 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:93863 4.2f 4:f59f865b:::100000001f8.00000007:head [write 172032~8192 in=8192b,write 253952~4096 in=4096b,write 315392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.545629+0000", 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0055853129999999997, 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0065846139999999999, 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:27.635 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 93863 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545629+0000", 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545629+0000", 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545628+0000", 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545643+0000", 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4737e-05 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545654+0000", 2024-04-19T03:38:27.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0511e-05 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.545660+0000", 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4450000000000001e-06 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.546387+0000", 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00072747999999999997 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.546465+0000", 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7946000000000002e-05 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.546556+0000", 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0171000000000001e-05 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.551355+0000", 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047991680000000004 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:93864 4.38 4:1fc350da:::100000001f8.0000002f:head [write 3162112~4096 in=4096b,write 3170304~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:27.546080+0000", 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.005134128, 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0062296210000000003, 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 93864 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:27.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.546080+0000", 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.546080+0000", 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.546080+0000", 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.546101+0000", 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1409000000000001e-05 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.546109+0000", 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7729999999999999e-06 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.546121+0000", 2024-04-19T03:38:27.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2541000000000001e-05 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.551299+0000", 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051772959999999996 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:27.551387+0000", 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8521000000000002e-05 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 16 2024-04-19T03:38:27.644 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:27.645 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:27.645+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:27.646 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:27.745 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:27.745+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:27.846 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:27.845+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:27.873 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:27.873 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:27.873 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:27.873 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:27.874 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:27.890 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:27.947 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:27.946+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:27.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:38:28.048 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:28.047+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:28.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:28.108 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.873421094999999, 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.109 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:28.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:28.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.872265761, 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.114 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:28.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:28.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:28.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:28.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:28.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:28.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.870834864999999, 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:28.120 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:28.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.869971896999999, 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:28.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:28.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:28.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:28.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:28.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.869538705, 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:28.135 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.868090668000001, 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:28.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.867415497, 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.865924927, 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.145 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:28.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:28.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:28.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.865522819000001, 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.149 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:28.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.153 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.865479445, 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.865447530000001, 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.161 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.864006230999999, 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:28.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:28.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:28.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:28.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.863750791999999, 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:28.167 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:28.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:28.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:28.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.863057851000001, 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:28.171 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:28.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:28.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:28.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62831 4.36 e58/14 4:6fa85f86:::100000001f8.00000013:head v 58'2938, mlcod=58'2936)", 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.862055988, 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074231808999999996, 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243852+0000", 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243867+0000", 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4694e-05 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291730+0000", 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.047863307000000001 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291749+0000", 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9361999999999999e-05 2024-04-19T03:38:28.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292182+0000", 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00043303999999999999 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292206+0000", 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3519999999999998e-05 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318066+0000", 2024-04-19T03:38:28.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025860409000000001 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318084+0000", 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.806e-05 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.026319582999999, 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:28.180 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:28.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:28.185 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.025625739000001, 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:28.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:28.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:28.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.025223437999999, 2024-04-19T03:38:28.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:28.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:28.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.022619583999999, 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.022260878999999, 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:28.202 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.203 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:28.207 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:28.209 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:28.210 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:28.208+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:28.269 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:28.310 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:28.310 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:28.311 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:28.311 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:28.312 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:28.310+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:28.314 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:28.314 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:28.411 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:28.410+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:28.437 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:28.437 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:28.456 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:28.540 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:28.540+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:28.614 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:28.614+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:28.712 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:28.712 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:28.717 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:28.714+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:28.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:28.817 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:28.815+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:28.916 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:28.916+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:28.974 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:28.974 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:28.991 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:29.032 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:29.032+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:29.119 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:29.118+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:29.167 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:29.167 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:29.180 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:29.227 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:29.226+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:29.292 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:38:29.321 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:29.320+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:29.362 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:29.363 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:29.377 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:29.421 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:29.421+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:29.522 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:29.521+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:29.603 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:29.604 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:29.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:29.662 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:29.662+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:29.724 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:29.723+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:29.825 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:29.824+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:29.840 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:29.840 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:29.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:29.926 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:29.925+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:30.027 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:30.027+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:30.096 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:30.096 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:30.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:30.127 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:30.127+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:30.228 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:30.228+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:30.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:30.329 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:30.329+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:30.369 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:30.369 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:30.387 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:30.430 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:30.430+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:30.518 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:30.531 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:30.530+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:30.544 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:30.545 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:30.549 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:30.549 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:30.588 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100299 4.6 e64/14 4:616d4c41:::100000001f8.00000034:head v 64'6240, mlcod=64'6231)", 2024-04-19T03:38:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.553731+0000", 2024-04-19T03:38:30.588 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.025554541, 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025581801000000001, 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553731+0000", 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553731+0000", 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553730+0000", 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553741+0000", 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0773e-05 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553745+0000", 2024-04-19T03:38:30.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.805e-06 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553748+0000", 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9409999999999999e-06 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554571+0000", 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00082291199999999997 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554587+0000", 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6240999999999999e-05 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100348 4.14 e64/14 4:2b28d75f:::100000001f8.00000016:head v 64'1534, mlcod=64'1530)", 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.563971+0000", 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.015314516, 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015424314, 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.592 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.563971+0000", 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.563971+0000", 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.563970+0000", 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.593 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.563984+0000", 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3949e-05 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.563993+0000", 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2739999999999996e-06 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564000+0000", 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7630000000000003e-06 2024-04-19T03:38:30.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564441+0000", 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00044097500000000003 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564454+0000", 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3219e-05 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.595 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100381 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1155072~4096 in=4096b,write 1310720~4096 in=4096b,write 1331200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.574892+0000", 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0043927990000000002, 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045840910000000002, 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100381 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.596 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574892+0000", 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574892+0000", 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574891+0000", 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574902+0000", 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1005999999999999e-05 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574913+0000", 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0977e-05 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574919+0000", 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6949999999999997e-06 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574966+0000", 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7119000000000001e-05 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575063+0000", 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6671999999999999e-05 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575221+0000", 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015831999999999999 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.599 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100349 4.15 e64/14 4:aada5e43:::100000001f8.00000028:head v 64'1579, mlcod=64'1577)", 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.564280+0000", 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.015005241000000001, 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015284311, 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564280+0000", 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564280+0000", 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564279+0000", 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564292+0000", 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2972e-05 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564304+0000", 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2130000000000001e-05 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564311+0000", 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4019999999999999e-06 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564349+0000", 2024-04-19T03:38:30.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8266999999999998e-05 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564369+0000", 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9947999999999999e-05 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100369 4.36 e64/14 4:6da220e6:::100000001f8.0000003f:head v 64'4701, mlcod=64'4695)", 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.575007+0000", 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0042782319999999999, 2024-04-19T03:38:30.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046292920000000001, 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575007+0000", 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575007+0000", 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575006+0000", 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575024+0000", 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8037e-05 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575037+0000", 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2588999999999999e-05 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575044+0000", 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577103+0000", 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020595090000000002 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577115+0000", 2024-04-19T03:38:30.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1701e-05 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100351 4.29 4:94178d8a:::100000001f8.00000006:head [write 1355776~4096 in=4096b,write 1536000~4096 in=4096b,write 1769472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.564278+0000", 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.01500724, 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015433250000000001, 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100351 2024-04-19T03:38:30.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564278+0000", 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564278+0000", 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564277+0000", 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564289+0000", 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2136999999999999e-05 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564307+0000", 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8167000000000001e-05 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564316+0000", 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5450000000000003e-06 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564361+0000", 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.545e-05 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564464+0000", 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000102556 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.610 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100383 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.575456+0000", 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0038292220000000002, 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0043290439999999998, 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100383 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575456+0000", 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575456+0000", 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575455+0000", 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575472+0000", 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6801999999999999e-05 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575484+0000", 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2140000000000001e-05 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575491+0000", 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100317 4.28 e64/14 4:153ae410:::100000001f8.0000003b:head v 64'3115, mlcod=64'3112)", 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.553845+0000", 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.025440463, 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025995832999999999, 2024-04-19T03:38:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553845+0000", 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553845+0000", 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553844+0000", 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553864+0000", 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9718999999999999e-05 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553872+0000", 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.439e-06 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553878+0000", 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0889999999999996e-06 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554117+0000", 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023828799999999999 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554135+0000", 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8502e-05 2024-04-19T03:38:30.617 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100352 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.564489+0000", 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.014796549000000001, 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015409516, 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.618 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100352 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564489+0000", 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564489+0000", 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564488+0000", 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564499+0000", 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1695999999999999e-05 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564509+0000", 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6919999999999997e-06 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.564516+0000", 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1210000000000001e-06 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100384 4.35 4:af28909f:::100000001f8.0000001b:head [write 2375680~4096 in=4096b,write 2387968~4096 in=4096b,write 2576384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.575794+0000", 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0034909429999999998, 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0041666960000000001, 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.621 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100384 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575794+0000", 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575794+0000", 2024-04-19T03:38:30.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575793+0000", 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575806+0000", 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2147000000000001e-05 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575816+0000", 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0495e-05 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575822+0000", 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0889999999999996e-06 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575859+0000", 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6860000000000003e-05 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.624 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575937+0000", 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7721999999999999e-05 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100315 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2502656~8192 in=8192b,write 3362816~4096 in=4096b,write 3522560~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.554972+0000", 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.02431262, 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025060635000000001, 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.625 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100315 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554972+0000", 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554972+0000", 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554971+0000", 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554990+0000", 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8896e-05 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555001+0000", 2024-04-19T03:38:30.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0835e-05 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555008+0000", 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2910000000000002e-06 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556929+0000", 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001920368 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557023+0000", 2024-04-19T03:38:30.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3908999999999998e-05 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100350 4.33 e64/14 4:cf6d7a6c:::100000001f8.0000000a:head v 64'1548, mlcod=64'1546)", 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.565005+0000", 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.014280505000000001, 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015094466000000001, 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565005+0000", 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565005+0000", 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565004+0000", 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565043+0000", 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9443000000000002e-05 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565051+0000", 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1269999999999997e-06 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565059+0000", 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0879999999999995e-06 2024-04-19T03:38:30.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576974+0000", 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011915255 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576995+0000", 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1243e-05 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.632 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100385 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 643072~4096 in=4096b,write 708608~4096 in=4096b,write 761856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.576628+0000", 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0026568389999999998, 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003536057, 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100385 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.633 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576628+0000", 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576628+0000", 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576627+0000", 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576641+0000", 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3142999999999999e-05 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576651+0000", 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0723000000000001e-05 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576659+0000", 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9079999999999995e-06 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578925+0000", 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022661249999999999 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579008+0000", 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2496000000000004e-05 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579161+0000", 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015343900000000001 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.636 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100316 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 200704~4096 in=4096b,write 348160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.555016+0000", 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.024268596999999999, 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025225577999999999, 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100316 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555016+0000", 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555016+0000", 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555016+0000", 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555025+0000", 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.986e-06 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555031+0000", 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.268e-06 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555036+0000", 2024-04-19T03:38:30.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6840000000000004e-06 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579254+0000", 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024218052 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579418+0000", 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000163666 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100354 4.2c 4:36128e15:::100000001f8.00000008:head [write 2695168~4096 in=4096b,write 2850816~4096 in=4096b,write 2875392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.565058+0000", 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.014226585999999999, 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015253453, 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100354 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.641 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565058+0000", 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565058+0000", 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565058+0000", 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565069+0000", 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0947999999999999e-05 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565085+0000", 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.611e-05 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565092+0000", 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8519999999999998e-06 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565449+0000", 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00035721899999999998 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565499+0000", 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9959000000000001e-05 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100389 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.577551+0000", 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.001734232, 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028286890000000001, 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100389 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577551+0000", 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577551+0000", 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577550+0000", 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577563+0000", 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3275000000000001e-05 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577575+0000", 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1657999999999999e-05 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577582+0000", 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5460000000000003e-06 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.647 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100323 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 1253376~4096 in=4096b,write 1294336~4096 in=4096b,write 1515520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.555665+0000", 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.023619952999999999, 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024772200000000001, 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100323 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555665+0000", 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555665+0000", 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555664+0000", 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555675+0000", 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0874e-05 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555685+0000", 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4599999999999992e-06 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555691+0000", 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4060000000000002e-06 2024-04-19T03:38:30.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555754+0000", 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2947000000000006e-05 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.555834+0000", 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0159000000000003e-05 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100355 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1597440~4096 in=4096b,write 1720320~4096 in=4096b,write 1921024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.651 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.565334+0000", 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.013950779999999999, 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015171432, 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100355 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565334+0000", 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565334+0000", 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565334+0000", 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565342+0000", 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9209999999999992e-06 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565348+0000", 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2349999999999996e-06 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565353+0000", 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5870000000000003e-06 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566107+0000", 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00075427100000000004 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566202+0000", 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100392 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.578578+0000", 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00070694699999999998, 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019899330000000002, 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.655 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100392 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578578+0000", 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578578+0000", 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578577+0000", 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578589+0000", 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2136e-05 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578601+0000", 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1381e-05 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578608+0000", 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1799999999999999e-06 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.658 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100324 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 2162688~4096 in=4096b,write 2281472~4096 in=4096b,write 2363392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.556814+0000", 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.022471358, 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023810362000000002, 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100324 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556814+0000", 2024-04-19T03:38:30.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556814+0000", 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556813+0000", 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556829+0000", 2024-04-19T03:38:30.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6545000000000002e-05 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556841+0000", 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.208e-05 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556847+0000", 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4060000000000004e-06 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579459+0000", 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022612152999999999 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579541+0000", 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2066999999999999e-05 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579698+0000", 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015640200000000001 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.662 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100357 4.a 4:50194ce5:::100000001f8.00000027:head [write 2662400~4096 in=4096b,write 3170304~4096 in=4096b,write 3178496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.565902+0000", 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.013383486999999999, 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014795416, 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100357 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565902+0000", 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565902+0000", 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565901+0000", 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565911+0000", 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0664e-05 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565925+0000", 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3173000000000001e-05 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565934+0000", 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.397e-06 2024-04-19T03:38:30.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.565972+0000", 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8343000000000002e-05 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566029+0000", 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6820000000000001e-05 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100393 4.2c 4:36128e15:::100000001f8.00000008:head [write 1847296~4096 in=4096b,write 1978368~4096 in=4096b,write 2154496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.578872+0000", 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00041319499999999999, 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001892166, 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100393 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578872+0000", 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578872+0000", 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578871+0000", 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578886+0000", 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4754e-05 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578895+0000", 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2420000000000006e-06 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.578902+0000", 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7519999999999999e-06 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579984+0000", 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0010824389999999999 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580068+0000", 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3356000000000006e-05 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100325 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.670 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.556852+0000", 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.022433114000000001, 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023976292999999999, 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100325 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556852+0000", 2024-04-19T03:38:30.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556852+0000", 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556852+0000", 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556865+0000", 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3129000000000001e-05 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556870+0000", 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.074e-06 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.556875+0000", 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100326 4.36 e64/14 4:6fa85f86:::100000001f8.00000013:head v 64'4699, mlcod=64'4695)", 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.566267+0000", 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.013018221, 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014616964, 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566267+0000", 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566267+0000", 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566266+0000", 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566312+0000", 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5457000000000002e-05 2024-04-19T03:38:30.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566322+0000", 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0523000000000001e-05 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566328+0000", 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2809999999999997e-06 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566366+0000", 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8010999999999999e-05 2024-04-19T03:38:30.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566386+0000", 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9235000000000001e-05 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100395 4.a 4:50194ce5:::100000001f8.00000027:head [write 1122304~4096 in=4096b,write 1130496~4096 in=4096b,write 1490944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.579643+0000", 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9996419, 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001311876, 2024-04-19T03:38:30.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100395 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579643+0000", 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579643+0000", 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579642+0000", 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579655+0000", 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2662e-05 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579664+0000", 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3959999999999995e-06 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579671+0000", 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9909999999999996e-06 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580795+0000", 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011232480000000001 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580879+0000", 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4810999999999998e-05 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100329 4.11 4:893be98d:::100000001f8.00000001:head [write 2203648~4096 in=4096b,write 2486272~4096 in=4096b,write 2613248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.557835+0000", 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021449618, 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023190606999999998, 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.681 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100329 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557835+0000", 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557835+0000", 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557835+0000", 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557847+0000", 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2179e-05 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557857+0000", 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0352e-05 2024-04-19T03:38:30.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557870+0000", 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3292000000000001e-05 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558376+0000", 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00050609299999999999 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558455+0000", 2024-04-19T03:38:30.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8411000000000005e-05 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100359 4.2c 4:36128e15:::100000001f8.00000008:head [write 3162112~4096 in=4096b,write 3186688~4096 in=4096b,write 3366912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.566479+0000", 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.012805585, 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014613009, 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100359 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566479+0000", 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566479+0000", 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566479+0000", 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566494+0000", 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5108e-05 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566505+0000", 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0926e-05 2024-04-19T03:38:30.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566512+0000", 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8889999999999996e-06 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568193+0000", 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016813329999999999 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568307+0000", 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000114288 2024-04-19T03:38:30.688 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100396 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.579876+0000", 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9994092, 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012779359999999999, 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.689 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100396 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579876+0000", 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579876+0000", 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579875+0000", 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579910+0000", 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5083999999999998e-05 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579920+0000", 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0166000000000001e-05 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579927+0000", 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5440000000000004e-06 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100319 4.14 e64/14 4:2b28d75f:::100000001f8.00000016:head v 64'1532, mlcod=64'1530)", 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.557969+0000", 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021315992999999998, 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.02323745, 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557969+0000", 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557969+0000", 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557968+0000", 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557983+0000", 2024-04-19T03:38:30.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5460000000000001e-05 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.557993+0000", 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7759999999999992e-06 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558000+0000", 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7440000000000001e-06 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558036+0000", 2024-04-19T03:38:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5907e-05 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558057+0000", 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0679999999999999e-05 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100358 4.14 e64/14 4:2b28d75f:::100000001f8.00000016:head v 64'1535, mlcod=64'1530)", 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.566881+0000", 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.012404119, 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01438272, 2024-04-19T03:38:30.695 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566881+0000", 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566881+0000", 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566880+0000", 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566893+0000", 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2822e-05 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566903+0000", 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3540000000000006e-06 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.566909+0000", 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4439999999999996e-06 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567146+0000", 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023732500000000001 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567158+0000", 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1532000000000001e-05 2024-04-19T03:38:30.698 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100399 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.580799+0000", 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9984856, 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00053024300000000001, 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.699 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100399 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580799+0000", 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580799+0000", 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580798+0000", 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580860+0000", 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1258000000000002e-05 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580869+0000", 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2539999999999998e-06 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580876+0000", 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8260000000000004e-06 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100301 4.6 e64/14 4:635f8cb4:::100000001f8.0000003c:head v 64'6241, mlcod=64'6235)", 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.558012+0000", 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021273558000000001, 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023370354999999999, 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.702 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558012+0000", 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558012+0000", 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558011+0000", 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558024+0000", 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2651e-05 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558030+0000", 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9379999999999997e-06 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558034+0000", 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5249999999999999e-06 2024-04-19T03:38:30.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558065+0000", 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1115000000000003e-05 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558089+0000", 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3487999999999999e-05 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100328 4.6 e64/14 4:635f8cb4:::100000001f8.0000003c:head v 64'6243, mlcod=64'6235)", 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.567705+0000", 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011580369, 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0137342, 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567705+0000", 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567705+0000", 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567704+0000", 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567714+0000", 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0257e-05 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567724+0000", 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3880000000000006e-06 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567729+0000", 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1730000000000003e-06 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567765+0000", 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5958999999999999e-05 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567784+0000", 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9228999999999998e-05 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100379 4.36 e64/14 4:6c9c34b1:::100000001f8.00000010:head v 64'4702, mlcod=64'4695)", 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.581139+0000", 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9981461, 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00035632200000000001, 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581139+0000", 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581139+0000", 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581138+0000", 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581156+0000", 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7152000000000001e-05 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581165+0000", 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1099999999999992e-06 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581171+0000", 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8190000000000003e-06 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581205+0000", 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3606000000000003e-05 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581222+0000", 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6915999999999999e-05 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.712 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100298 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3874816~4096 in=4096b,write 3887104~4096 in=4096b,write 4014080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.545240+0000", 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.034045510000000001, 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.036318162000000001, 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100298 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.713 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.545240+0000", 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.545240+0000", 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.545238+0000", 2024-04-19T03:38:30.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.545252+0000", 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3874e-05 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.545264+0000", 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1857e-05 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.545272+0000", 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4139999999999994e-06 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560171+0000", 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014898771 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560254+0000", 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2795999999999998e-05 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560408+0000", 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153616 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576872+0000", 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01646394 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100318 4.28 e64/14 4:15eeb89b:::100000001f8.00000032:head v 64'3116, mlcod=64'3112)", 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.558043+0000", 2024-04-19T03:38:30.717 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021242278999999999, 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023591542, 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558043+0000", 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558043+0000", 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558043+0000", 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558054+0000", 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1082e-05 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558059+0000", 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.366e-06 2024-04-19T03:38:30.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558063+0000", 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1529999999999999e-06 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575163+0000", 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017100046000000001 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575184+0000", 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1205000000000001e-05 2024-04-19T03:38:30.720 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100363 4.11 4:893be98d:::100000001f8.00000001:head [write 2662400~4096 in=4096b,write 2781184~4096 in=4096b,write 2920448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.567844+0000", 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.011440998000000001, 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013852865000000001, 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100363 2024-04-19T03:38:30.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567844+0000", 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567844+0000", 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567844+0000", 2024-04-19T03:38:30.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567852+0000", 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3999999999999992e-06 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567859+0000", 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9190000000000002e-06 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.567863+0000", 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4020000000000004e-06 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569084+0000", 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001220657 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569177+0000", 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2857999999999998e-05 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100382 4.6 e64/14 4:62d56fc8:::100000001f8.0000001c:head v 64'6246, mlcod=64'6235)", 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.581181+0000", 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9981036, 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00058094500000000003, 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581181+0000", 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581181+0000", 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581181+0000", 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581191+0000", 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.005e-05 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581197+0000", 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5720000000000002e-06 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581201+0000", 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0940000000000001e-06 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581230+0000", 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8932999999999999e-05 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581248+0000", 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8576999999999998e-05 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100300 4.37 4:eff9002a:::100000001f8.00000003:head [write 843776~4096 in=4096b,write 856064~4096 in=4096b,write 901120~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.546191+0000", 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.033093641, 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.035640167, 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.728 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100300 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546191+0000", 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546191+0000", 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546191+0000", 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546204+0000", 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2979999999999999e-05 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546214+0000", 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0257e-05 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546222+0000", 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2879999999999993e-06 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576896+0000", 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030674107999999999 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.576984+0000", 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7505999999999999e-05 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577145+0000", 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000161631 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100322 4.14 e64/14 4:2b28d75f:::100000001f8.00000016:head v 64'1533, mlcod=64'1530)", 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.558068+0000", 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021217566, 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023844818, 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.732 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558068+0000", 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558068+0000", 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558067+0000", 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:30.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558081+0000", 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3434e-05 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558086+0000", 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4020000000000001e-06 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558091+0000", 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.498e-06 2024-04-19T03:38:30.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559382+0000", 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012914280000000001 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559401+0000", 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8729e-05 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.735 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100364 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.568189+0000", 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.01109629, 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013792295, 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100364 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568189+0000", 2024-04-19T03:38:30.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568189+0000", 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568188+0000", 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568213+0000", 2024-04-19T03:38:30.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4539999999999999e-05 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568220+0000", 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2080000000000003e-06 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568224+0000", 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8670000000000004e-06 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100304 4.36 e64/14 4:6c9c34b1:::100000001f8.00000010:head v 64'4698, mlcod=64'4695)", 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.558098+0000", 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021186815000000001, 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023949024999999999, 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558098+0000", 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558098+0000", 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558098+0000", 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558110+0000", 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2140999999999999e-05 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558116+0000", 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4310000000000002e-06 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558120+0000", 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3839999999999999e-06 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559104+0000", 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00098397400000000009 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559123+0000", 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8644e-05 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100398 4.28 e64/14)", 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.581997+0000", 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9972878, 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011267199999999999, 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581997+0000", 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581997+0000", 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.581997+0000", 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582019+0000", 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1962000000000001e-05 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582025+0000", 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.46e-06 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582037+0000", 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1260000000000001e-05 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.744 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100327 4.1c e64/14 4:39b842ef:::100000001f8.00000029:head v 64'1582, mlcod=64'1580)", 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.558124+0000", 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.021160925000000001, 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.024038757000000001, 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558124+0000", 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558124+0000", 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558124+0000", 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558134+0000", 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0478e-05 2024-04-19T03:38:30.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558140+0000", 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1170000000000003e-06 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558144+0000", 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3830000000000002e-06 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560368+0000", 2024-04-19T03:38:30.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022243739999999999 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560386+0000", 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7367000000000002e-05 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100365 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1888256~4096 in=4096b,write 1912832~4096 in=4096b,write 1961984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.568640+0000", 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010645191, 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013597806, 2024-04-19T03:38:30.748 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100365 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568640+0000", 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568640+0000", 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568639+0000", 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568663+0000", 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.4179e-05 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568672+0000", 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.568678+0000", 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0739999999999998e-06 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.571862+0000", 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031841899999999999 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.571960+0000", 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7410000000000004e-05 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100400 4.14 e64/14)", 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.582054+0000", 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.997231, 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000252544, 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.752 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582054+0000", 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582054+0000", 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582054+0000", 2024-04-19T03:38:30.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582065+0000", 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.133e-05 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582071+0000", 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6080000000000003e-06 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582075+0000", 2024-04-19T03:38:30.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3109999999999999e-06 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100402 4.1b 4.d7c0abdb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.582121+0000", 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9971642, 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023654399999999999, 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.755 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100402 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582121+0000", 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582121+0000", 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582121+0000", 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582133+0000", 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2962999999999999e-05 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582140+0000", 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5780000000000004e-06 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582145+0000", 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.921e-06 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100297 4.28 e64/14 4:15eeb89b:::100000001f8.00000032:head v 64'3114, mlcod=64'3109)", 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.546925+0000", 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.032360461, 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.035492812999999998, 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546925+0000", 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546925+0000", 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546924+0000", 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546938+0000", 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3694e-05 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546952+0000", 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3735e-05 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546957+0000", 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0579999999999997e-06 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546997+0000", 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9928999999999997e-05 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.547014+0000", 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7013000000000001e-05 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100403 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 65536~4096 in=4096b,write 90112~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.582150+0000", 2024-04-19T03:38:30.761 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9971347, 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00033877100000000003, 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100403 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582150+0000", 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582150+0000", 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582150+0000", 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582159+0000", 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6789999999999994e-06 2024-04-19T03:38:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582164+0000", 2024-04-19T03:38:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2519999999999999e-06 2024-04-19T03:38:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582168+0000", 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3669999999999999e-06 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582209+0000", 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0599000000000002e-05 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582280+0000", 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0710000000000006e-05 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582420+0000", 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014092900000000001 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100285 4.36 e64/14 4:6fa85f86:::100000001f8.00000013:head v 64'4697, mlcod=64'4694)", 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.546966+0000", 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.032319211, 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.035602188999999999, 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.767 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546966+0000", 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546966+0000", 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546966+0000", 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546977+0000", 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1566000000000001e-05 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546983+0000", 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6799999999999998e-06 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546988+0000", 2024-04-19T03:38:30.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9699999999999998e-06 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549307+0000", 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023194959999999999 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549325+0000", 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7221999999999999e-05 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100294 4.6 e64/14 4:616d4c41:::100000001f8.00000034:head v 64'6238, mlcod=64'6231)", 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.546992+0000", 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.032292942999999998, 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.03564353, 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546992+0000", 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546992+0000", 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.546992+0000", 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.547003+0000", 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0712e-05 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.547008+0000", 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5690000000000004e-06 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.547013+0000", 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6e-06 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549360+0000", 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023469950000000002 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549376+0000", 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6229e-05 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100332 4.19 e64/14 4:9a4319fb:::100000001f8.0000002a:head v 64'3161, mlcod=64'3159)", 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.559143+0000", 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020142213999999999, 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023551246000000001, 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.774 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559143+0000", 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559143+0000", 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559142+0000", 2024-04-19T03:38:30.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559158+0000", 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5605999999999999e-05 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559166+0000", 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.371e-06 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559173+0000", 2024-04-19T03:38:30.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7510000000000002e-06 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561026+0000", 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00185293 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561043+0000", 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6815000000000001e-05 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100366 4.28 e64/14 4:15eeb89b:::100000001f8.00000032:head v 64'3117, mlcod=64'3112)", 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.569359+0000", 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0099256090000000002, 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013390557000000001, 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569359+0000", 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569359+0000", 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569359+0000", 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569372+0000", 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2746e-05 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569378+0000", 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6540000000000004e-06 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569382+0000", 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.092e-06 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577263+0000", 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078812420000000001 2024-04-19T03:38:30.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.577281+0000", 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8374000000000001e-05 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100302 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 3280896~4096 in=4096b,write 3411968~4096 in=4096b,write 3514368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.548524+0000", 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.030760613999999999, 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.034287508000000001, 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100302 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548524+0000", 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548524+0000", 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548518+0000", 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999933 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548537+0000", 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9307999999999999e-05 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548774+0000", 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00023696500000000001 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548784+0000", 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8810000000000008e-06 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548825+0000", 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0676999999999997e-05 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548908+0000", 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3696999999999995e-05 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549077+0000", 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016908599999999999 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.553778+0000", 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047007610000000003 2024-04-19T03:38:30.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100330 4.3f e64/14 4:fde182c5:::100000001f8.00000039:head v 64'1541, mlcod=64'1539)", 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.559183+0000", 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.020101807999999999, 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023704392000000001, 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559183+0000", 2024-04-19T03:38:30.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559183+0000", 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559183+0000", 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559193+0000", 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0478e-05 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559199+0000", 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559204+0000", 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.673e-06 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560045+0000", 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00084074200000000001 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560063+0000", 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8332e-05 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100367 4.23 4:c6f90462:::100000001f8.00000037:head [write 1642496~4096 in=4096b,write 1724416~4096 in=4096b,write 2359296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.569434+0000", 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0098509200000000009, 2024-04-19T03:38:30.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013526420000000001, 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100367 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569434+0000", 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569434+0000", 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569434+0000", 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569448+0000", 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4188999999999999e-05 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569456+0000", 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0339999999999997e-06 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.569463+0000", 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0060000000000003e-06 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579210+0000", 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0097467979999999992 2024-04-19T03:38:30.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579290+0000", 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579409+0000", 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000119231 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100303 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 0~4096 in=4096b,write 20480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.793 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.548795+0000", 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.030490064000000001, 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.034244963000000003, 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100303 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548795+0000", 2024-04-19T03:38:30.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548795+0000", 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548794+0000", 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548809+0000", 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5038999999999999e-05 2024-04-19T03:38:30.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548818+0000", 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0849999999999997e-06 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548824+0000", 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3459999999999999e-06 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549051+0000", 2024-04-19T03:38:30.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00022670399999999999 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549160+0000", 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000109889 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100334 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 1593344~4096 in=4096b,write 1683456~4096 in=4096b,write 2002944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.559364+0000", 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019921307999999999, 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023750125, 2024-04-19T03:38:30.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100334 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559364+0000", 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559364+0000", 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559363+0000", 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559379+0000", 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6073999999999999e-05 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.799 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559389+0000", 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9040000000000004e-06 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559396+0000", 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2690000000000002e-06 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559440+0000", 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4376999999999999e-05 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561286+0000", 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00184564 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100305 4.30 4:0c89e311:::100000001f8.00000017:head [write 3207168~4096 in=4096b,write 3235840~4096 in=4096b,write 3293184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.548834+0000", 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.030451111999999999, 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.034354032999999999, 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.801 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100305 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548834+0000", 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.802 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548834+0000", 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548834+0000", 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548845+0000", 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1012000000000001e-05 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.803 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548852+0000", 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2520000000000002e-06 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.548857+0000", 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4759999999999997e-06 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549809+0000", 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00095156199999999998 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.804 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549884+0000", 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5216999999999995e-05 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100333 4.3b e64/14 4:dcc0c15f:::100000001f8.0000001a:head v 64'1588, mlcod=64'1586)", 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.559548+0000", 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019737033000000001, 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023777291999999998, 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.805 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559548+0000", 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559548+0000", 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559547+0000", 2024-04-19T03:38:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559559+0000", 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.182e-05 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559568+0000", 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5129999999999996e-06 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559574+0000", 2024-04-19T03:38:30.807 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3119999999999999e-06 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560392+0000", 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00081819599999999998 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560411+0000", 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8331000000000001e-05 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100368 4.1c e64/14 4:39b842ef:::100000001f8.00000029:head v 64'1583, mlcod=64'1580)", 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.570157+0000", 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0091283040000000003, 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013226241, 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.570157+0000", 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.809 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.570157+0000", 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.570156+0000", 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.570180+0000", 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3377e-05 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.810 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.570186+0000", 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7509999999999997e-06 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.570189+0000", 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3859999999999999e-06 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575108+0000", 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0049191069999999998 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.811 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575125+0000", 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7354e-05 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100295 4.6 e64/14 4:62d56fc8:::100000001f8.0000001c:head v 64'6239, mlcod=64'6231)", 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.549754+0000", 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.029530639000000001, 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.033694911000000001, 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.812 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549754+0000", 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549754+0000", 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549754+0000", 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549781+0000", 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7542000000000002e-05 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549790+0000", 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1509999999999993e-06 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.549797+0000", 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2580000000000001e-06 2024-04-19T03:38:30.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.552026+0000", 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022297240000000002 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.552045+0000", 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8799000000000001e-05 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.815 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100336 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.559785+0000", 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019500358999999998, 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023729508999999999, 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100336 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.816 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559785+0000", 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559785+0000", 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559784+0000", 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.817 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559797+0000", 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3171e-05 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559807+0000", 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6160000000000008e-06 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.559814+0000", 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9870000000000002e-06 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.818 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100371 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.571044+0000", 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0082413599999999997, 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012528437999999999, 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100371 2024-04-19T03:38:30.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.571044+0000", 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.571044+0000", 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.571043+0000", 2024-04-19T03:38:30.820 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.571070+0000", 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6784e-05 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.571077+0000", 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5349999999999999e-06 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.571083+0000", 2024-04-19T03:38:30.821 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7599999999999999e-06 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100337 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 2539520~4096 in=4096b,write 2564096~4096 in=4096b,write 2580480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.560041+0000", 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019243886000000002, 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.023592047000000001, 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.822 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100337 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560041+0000", 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560041+0000", 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.823 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560040+0000", 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560054+0000", 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3947999999999999e-05 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560064+0000", 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8749999999999995e-06 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.824 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560071+0000", 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1029999999999996e-06 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560116+0000", 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4515999999999999e-05 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.560194+0000", 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7816000000000002e-05 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100374 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.572210+0000", 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0070752769999999996, 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011488231, 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100374 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572210+0000", 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572210+0000", 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572209+0000", 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.827 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572237+0000", 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8252999999999999e-05 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572244+0000", 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3380000000000001e-06 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572248+0000", 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.765e-06 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.828 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100306 4.29 4:94178d8a:::100000001f8.00000006:head [write 1552384~4096 in=4096b,write 1564672~4096 in=4096b,write 1572864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.551431+0000", 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.027853669000000001, 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032323092999999997, 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100306 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.829 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551431+0000", 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551431+0000", 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551430+0000", 2024-04-19T03:38:30.830 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551447+0000", 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6653000000000001e-05 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551461+0000", 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4085e-05 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551470+0000", 2024-04-19T03:38:30.831 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5610000000000004e-06 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551520+0000", 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9419999999999998e-05 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551582+0000", 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1993000000000001e-05 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100307 4.6 e64/14 4:62d56fc8:::100000001f8.0000001c:head v 64'6242, mlcod=64'6235)", 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.561818+0000", 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.017467361000000001, 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022000941999999999, 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561818+0000", 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.833 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561818+0000", 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561817+0000", 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561826+0000", 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8380000000000008e-06 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.834 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562305+0000", 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047886599999999999 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562313+0000", 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6020000000000002e-06 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562351+0000", 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8609000000000003e-05 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562369+0000", 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8104000000000001e-05 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100376 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.572902+0000", 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0063835410000000004, 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010973032000000001, 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.836 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100376 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572902+0000", 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572902+0000", 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572901+0000", 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572912+0000", 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.115e-05 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572923+0000", 2024-04-19T03:38:30.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1029000000000001e-05 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.572930+0000", 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9140000000000002e-06 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100308 4.37 4:eff9002a:::100000001f8.00000003:head [write 61440~4096 in=4096b,write 77824~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.551484+0000", 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.027800587000000002, 2024-04-19T03:38:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032447783000000001, 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100308 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551484+0000", 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.840 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551484+0000", 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551484+0000", 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551497+0000", 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.347e-05 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551507+0000", 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2189999999999993e-06 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551513+0000", 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5710000000000003e-06 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582323+0000", 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.030810325999999999 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582405+0000", 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1784000000000002e-05 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.582550+0000", 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014520099999999999 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100338 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2019328~4096 in=4096b,write 2449408~4096 in=4096b,write 2809856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.843 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.561792+0000", 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.017493258000000001, 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022222768, 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100338 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561792+0000", 2024-04-19T03:38:30.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561792+0000", 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561791+0000", 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.561803+0000", 2024-04-19T03:38:30.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1914e-05 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562343+0000", 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000540151 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562351+0000", 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7330000000000003e-06 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562663+0000", 2024-04-19T03:38:30.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00031269799999999998 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562718+0000", 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4691000000000002e-05 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562811+0000", 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2828e-05 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.580841+0000", 2024-04-19T03:38:30.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018029567 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100353 4.2e e64/14 4:75be0f36:::100000001f8.0000003d:head v 64'1589, mlcod=64'1587)", 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.573134+0000", 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0061508960000000003, 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010961097, 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573134+0000", 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573134+0000", 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573134+0000", 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573163+0000", 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9155000000000001e-05 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573169+0000", 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9109999999999998e-06 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573173+0000", 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8929999999999998e-06 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573217+0000", 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3729000000000001e-05 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573237+0000", 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0288999999999998e-05 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100309 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 606208~4096 in=4096b,write 622592~4096 in=4096b,write 1003520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.851 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.551520+0000", 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.027764797000000001, 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032640545999999999, 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100309 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551520+0000", 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551520+0000", 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551520+0000", 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551536+0000", 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.577e-05 2024-04-19T03:38:30.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551543+0000", 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6750000000000002e-06 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551550+0000", 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1199999999999996e-06 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551689+0000", 2024-04-19T03:38:30.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013855000000000001 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551823+0000", 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013370799999999999 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100339 4.23 4:c6f90462:::100000001f8.00000037:head [write 1736704~8192 in=8192b,write 2076672~4096 in=4096b,write 2248704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.562362+0000", 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.016923455, 2024-04-19T03:38:30.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.02187093, 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100339 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562362+0000", 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562362+0000", 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562361+0000", 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562378+0000", 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6799999999999998e-05 2024-04-19T03:38:30.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562386+0000", 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0739999999999993e-06 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562392+0000", 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7180000000000001e-06 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562580+0000", 2024-04-19T03:38:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000188758 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562654+0000", 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3474999999999997e-05 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562790+0000", 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013567000000000001 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579181+0000", 2024-04-19T03:38:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.016391418000000001 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100341 4.6 e64/14 4:62d56fc8:::100000001f8.0000001c:head v 64'6244, mlcod=64'6235)", 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.573179+0000", 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.006106513, 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011138844, 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573179+0000", 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573179+0000", 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573178+0000", 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573186+0000", 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573189+0000", 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.23e-06 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573192+0000", 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.475e-06 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573226+0000", 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573241+0000", 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4695000000000001e-05 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100310 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1277952~4096 in=4096b,write 1540096~4096 in=4096b,write 1585152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.551561+0000", 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.027723978, 2024-04-19T03:38:30.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032798728999999999, 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100310 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551561+0000", 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551561+0000", 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551561+0000", 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551573+0000", 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2014999999999999e-05 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551579+0000", 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7390000000000002e-06 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551585+0000", 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7790000000000001e-06 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551620+0000", 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:38:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551704+0000", 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3183000000000006e-05 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100340 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.562400+0000", 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.016884874000000001, 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022035198999999998, 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.867 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100340 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562400+0000", 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562400+0000", 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562400+0000", 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562411+0000", 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1413000000000001e-05 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562418+0000", 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.46e-06 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562423+0000", 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4430000000000002e-06 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100360 4.36 e64/14 4:6fa85f86:::100000001f8.00000013:head v 64'4700, mlcod=64'4695)", 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.573194+0000", 2024-04-19T03:38:30.870 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0060907849999999996, 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011280587999999999, 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573194+0000", 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573194+0000", 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573194+0000", 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573201+0000", 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2169999999999997e-06 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573204+0000", 2024-04-19T03:38:30.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.932e-06 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573207+0000", 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2919999999999998e-06 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574443+0000", 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012367330000000001 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574462+0000", 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8206000000000002e-05 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100312 4.38 4:1fc350da:::100000001f8.0000002f:head [write 2793472~4096 in=4096b,write 2809856~4096 in=4096b,write 2953216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.551592+0000", 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.027692677999999998, 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032930551000000002, 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100312 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551592+0000", 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551592+0000", 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551592+0000", 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551602+0000", 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9580000000000002e-06 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551608+0000", 2024-04-19T03:38:30.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4629999999999998e-06 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551613+0000", 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9830000000000004e-06 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554128+0000", 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025143660000000001 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.554207+0000", 2024-04-19T03:38:30.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8866e-05 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100342 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.562428+0000", 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.016856650000000001, 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022143518000000001, 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.878 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100342 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562428+0000", 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562428+0000", 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562428+0000", 2024-04-19T03:38:30.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562439+0000", 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0509000000000001e-05 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562446+0000", 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0759999999999997e-06 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562452+0000", 2024-04-19T03:38:30.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1299999999999998e-06 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100377 4.19 e64/14 4:997b7129:::100000001f8.00000000:head v 64'3162, mlcod=64'3159)", 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.573645+0000", 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0056400549999999997, 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010976095999999999, 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573645+0000", 2024-04-19T03:38:30.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573645+0000", 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573644+0000", 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573655+0000", 2024-04-19T03:38:30.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0712e-05 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573665+0000", 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5650000000000007e-06 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573670+0000", 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0239999999999997e-06 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575157+0000", 2024-04-19T03:38:30.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001487211 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.575174+0000", 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7034999999999999e-05 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100313 4.12 4:48ab9bde:::100000001f8.00000015:head [write 1179648~4096 in=4096b,write 1277952~4096 in=4096b,write 1421312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.551872+0000", 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.027412655000000001, 2024-04-19T03:38:30.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.032800722999999997, 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100313 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551872+0000", 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551872+0000", 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551872+0000", 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551886+0000", 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4072e-05 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551896+0000", 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0319999999999999e-05 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551903+0000", 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3390000000000004e-06 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.551973+0000", 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9293000000000002e-05 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.552052+0000", 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8986999999999994e-05 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.552200+0000", 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014883799999999999 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.558354+0000", 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061540630000000004 2024-04-19T03:38:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100343 4.38 4.e1fdc8b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.562456+0000", 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.016828981999999999, 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022288998000000001, 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100343 2024-04-19T03:38:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562456+0000", 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562456+0000", 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562456+0000", 2024-04-19T03:38:30.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562466+0000", 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0386e-05 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562472+0000", 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3289999999999999e-06 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562477+0000", 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9609999999999996e-06 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100362 4.6 e64/14 4:616d4c41:::100000001f8.00000034:head v 64'6245, mlcod=64'6235)", 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.573979+0000", 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0053062780000000002, 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010836109999999999, 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573979+0000", 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573979+0000", 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.573978+0000", 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574014+0000", 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5695999999999998e-05 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574020+0000", 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4149999999999998e-06 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574023+0000", 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9580000000000001e-06 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574842+0000", 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00081848299999999995 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574869+0000", 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6993000000000001e-05 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:100344 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:30.895 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.562483+0000", 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.016802431999999999, 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022399603000000001, 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 100344 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562483+0000", 2024-04-19T03:38:30.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562483+0000", 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562482+0000", 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562491+0000", 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0380000000000005e-06 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562497+0000", 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8150000000000002e-06 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.562502+0000", 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0830000000000003e-06 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.898 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:100378 4.28 e64/14 4:153ae410:::100000001f8.0000003b:head v 64'3118, mlcod=64'3112)", 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:30.574027+0000", 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0052580739999999997, 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010931033999999999, 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574027+0000", 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574027+0000", 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574027+0000", 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574045+0000", 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8459000000000001e-05 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:30.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574051+0000", 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.5979999999999996e-06 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.574054+0000", 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.824e-06 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579356+0000", 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005302612 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:30.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:30.579376+0000", 2024-04-19T03:38:30.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466e-05 2024-04-19T03:38:30.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.902 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:30.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:30.902 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:30.902 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 86 2024-04-19T03:38:30.902 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:30.904 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:30.904 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:30.903+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:31.004 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:31.004+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:31.106 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:31.104+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:31.124 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:31.125 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:31.125 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:31.125 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:31.125 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:31.140 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:31.206 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:31.205+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:31.308 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:31.306+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:31.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.136098057000002, 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.374 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:31.375 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.376 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:31.377 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.134942723000002, 2024-04-19T03:38:31.379 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.380 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.381 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.382 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:31.383 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:31.384 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.133511827, 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.385 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.386 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:31.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.132648859, 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.132215667000001, 2024-04-19T03:38:31.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:31.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.130767630000001, 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:31.400 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:31.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:31.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:31.405 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.130092459, 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:31.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:31.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:31.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.128601888999999, 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:31.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:31.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:31.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:31.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.128199780999999, 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.128156406999999, 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:31.418 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:31.422 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.128124492000001, 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:31.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:31.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.126683193000002, 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.126427754000002, 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:31.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.435 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.125734813000001, 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:31.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:31.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.440 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62831 4.36 e58/14 4:6fa85f86:::100000001f8.00000013:head v 58'2938, mlcod=58'2936)", 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 18.124732949999999, 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074231808999999996, 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243852+0000", 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243867+0000", 2024-04-19T03:38:31.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4694e-05 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291730+0000", 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.047863307000000001 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291749+0000", 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9361999999999999e-05 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292182+0000", 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00043303999999999999 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292206+0000", 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3519999999999998e-05 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318066+0000", 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025860409000000001 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318084+0000", 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.806e-05 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.288996545, 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.445 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:31.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.288302700999999, 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.451 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:31.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:31.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.287900400000002, 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:31.457 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:31.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:31.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:31.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.285296546000001, 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.463 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:31.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:31.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:31.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:31.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:31.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:31.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:31.469 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 17.284937841000001, 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:31.470 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:31.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:31.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:31.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.475 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:31.476 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:31.476 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:31.477 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:31.476+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:31.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:31.578 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:31.577+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:31.684 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:31.680+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:31.712 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:31.712 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:31.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.712 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102810 4.f e64/14 4:f2a80dfe:::100000001f8.00000019:head v 64'4807, mlcod=64'4802)", 2024-04-19T03:38:31.712 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.677102+0000", 2024-04-19T03:38:31.712 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.030589412, 2024-04-19T03:38:31.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.030624215, 2024-04-19T03:38:31.712 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.712 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.677102+0000", 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.677102+0000", 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.677102+0000", 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.677116+0000", 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3679000000000001e-05 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.677122+0000", 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5390000000000004e-06 2024-04-19T03:38:31.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.677128+0000", 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4589999999999997e-06 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697947+0000", 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020819495 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697971+0000", 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4193999999999999e-05 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102853 4.f e64/14)", 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.695460+0000", 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.012231999, 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012397973, 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.716 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.695460+0000", 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.695460+0000", 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.695460+0000", 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.695479+0000", 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9252000000000001e-05 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.695486+0000", 2024-04-19T03:38:31.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9829999999999999e-06 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.695491+0000", 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4489999999999998e-06 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102825 4.6 4:616d4c41:::100000001f8.00000034:head [write 3366912~4096 in=4096b,write 3522560~4096 in=4096b,write 3608576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.678884+0000", 2024-04-19T03:38:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.028808027, 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.029011238000000002, 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102825 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.678884+0000", 2024-04-19T03:38:31.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.678884+0000", 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.678883+0000", 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.678898+0000", 2024-04-19T03:38:31.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5777000000000002e-05 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.678912+0000", 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3725e-05 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.678920+0000", 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8909999999999995e-06 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701933+0000", 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023012616 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702011+0000", 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8041999999999996e-05 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702169+0000", 2024-04-19T03:38:31.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000157906 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102872 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.697460+0000", 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.010231769999999999, 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010481872999999999, 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102872 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697460+0000", 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697460+0000", 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697459+0000", 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697476+0000", 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6460000000000002e-05 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697488+0000", 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2765999999999999e-05 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697497+0000", 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4989999999999994e-06 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102854 4.f e64/14)", 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.697520+0000", 2024-04-19T03:38:31.727 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.010171411, 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010453853000000001, 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697520+0000", 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697520+0000", 2024-04-19T03:38:31.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697520+0000", 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697535+0000", 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4654999999999999e-05 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697544+0000", 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8379999999999997e-06 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.697552+0000", 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5800000000000003e-06 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102828 4.2f e64/14 4:f59f865b:::100000001f8.00000007:head v 64'1588, mlcod=64'1584)", 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.681100+0000", 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.026592106000000001, 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026903686999999999, 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681100+0000", 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681100+0000", 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681099+0000", 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681120+0000", 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0217999999999999e-05 2024-04-19T03:38:31.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681128+0000", 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8799999999999997e-06 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681137+0000", 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1019999999999997e-06 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700296+0000", 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019159239000000002 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700315+0000", 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9341e-05 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102832 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.681208+0000", 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.026484191000000001, 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.026830677000000001, 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.735 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102832 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681208+0000", 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681208+0000", 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681206+0000", 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681222+0000", 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5790999999999998e-05 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681237+0000", 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4528999999999999e-05 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.681246+0000", 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1980000000000007e-06 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102873 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.698679+0000", 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0090127100000000002, 2024-04-19T03:38:31.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0093994679999999994, 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102873 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.698679+0000", 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.698679+0000", 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.698678+0000", 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.698694+0000", 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5767999999999999e-05 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.698705+0000", 2024-04-19T03:38:31.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1334e-05 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.698713+0000", 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1629999999999996e-06 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.070841387000000006, 2024-04-19T03:38:31.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071262102999999993, 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:31.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102874 4.2d e64/14 4:b4aa06e9:::100000001f8.0000001d:head v 64'3223, mlcod=64'3221)", 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.699543+0000", 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0081491549999999999, 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0086222769999999994, 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699543+0000", 2024-04-19T03:38:31.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699543+0000", 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699542+0000", 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699560+0000", 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8196e-05 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699571+0000", 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1087000000000001e-05 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699578+0000", 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3710000000000002e-06 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699617+0000", 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8702999999999999e-05 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699697+0000", 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0223999999999996e-05 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102834 4.f e64/14 4:f26fdfa9:::100000001f8.00000002:head v 64'4808, mlcod=64'4802)", 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.684357+0000", 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.023334516999999999, 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023887420999999999, 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684357+0000", 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684357+0000", 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684357+0000", 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684376+0000", 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.891e-05 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684388+0000", 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2628e-05 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684396+0000", 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7479999999999993e-06 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701573+0000", 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017176670000000002 2024-04-19T03:38:31.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701592+0000", 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9789e-05 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102875 4.1c 4:39b842ef:::100000001f8.00000029:head [write 1998848~4096 in=4096b,write 2207744~4096 in=4096b,write 2281472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.699563+0000", 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0081290159999999993, 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0087665690000000001, 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.752 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102875 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699563+0000", 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699563+0000", 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699562+0000", 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699575+0000", 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3436e-05 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699587+0000", 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1469e-05 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699595+0000", 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8099999999999998e-06 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699670+0000", 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5018000000000006e-05 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699761+0000", 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1583999999999996e-05 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.699908+0000", 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000146654 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704013+0000", 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041048550000000001 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.756 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102833 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 3063808~4096 in=4096b,write 3149824~4096 in=4096b,write 3190784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.684385+0000", 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.023306687, 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024050544, 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102833 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.757 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684385+0000", 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684385+0000", 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684384+0000", 2024-04-19T03:38:31.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684402+0000", 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8025000000000001e-05 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684418+0000", 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6163000000000001e-05 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684429+0000", 2024-04-19T03:38:31.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0464e-05 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701924+0000", 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017495288000000001 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702014+0000", 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0146000000000001e-05 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702179+0000", 2024-04-19T03:38:31.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016525599999999999 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102856 4.f e64/14)", 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.700314+0000", 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0073782379999999996, 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0082051309999999992, 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.761 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700314+0000", 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700314+0000", 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700313+0000", 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700328+0000", 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5107e-05 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700336+0000", 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700341+0000", 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2140000000000004e-06 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102836 4.e 4:73e84e43:::100000001f8.00000004:head [write 2707456~4096 in=4096b,write 2838528~4096 in=4096b,write 2846720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.684439+0000", 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.023253030000000001, 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.024145476999999999, 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.764 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102836 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684439+0000", 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684439+0000", 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684438+0000", 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684459+0000", 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1104e-05 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684472+0000", 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2971e-05 2024-04-19T03:38:31.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.684480+0000", 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5410000000000003e-06 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706136+0000", 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021656235999999999 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706186+0000", 2024-04-19T03:38:31.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0235999999999998e-05 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102857 4.2f e64/14)", 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.700527+0000", 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0071647760000000003, 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0081234740000000003, 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700527+0000", 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700527+0000", 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700526+0000", 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700539+0000", 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2347000000000001e-05 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700545+0000", 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6590000000000001e-06 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.700550+0000", 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5190000000000003e-06 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.770 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102877 4.12 e64/14 4:48ab9bde:::100000001f8.00000015:head v 64'3268, mlcod=64'3266)", 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.701110+0000", 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0065816420000000004, 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075953740000000002, 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701110+0000", 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701110+0000", 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701110+0000", 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967296 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701123+0000", 2024-04-19T03:38:31.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3389e-05 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701130+0000", 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3149999999999997e-06 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701139+0000", 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4059999999999994e-06 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701188+0000", 2024-04-19T03:38:31.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9035000000000001e-05 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701201+0000", 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2566e-05 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102835 4.f e64/14 4:f2a80dfe:::100000001f8.00000019:head v 64'4809, mlcod=64'4802)", 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.686613+0000", 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.021079226999999999, 2024-04-19T03:38:31.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022155314999999998, 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686613+0000", 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686613+0000", 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686612+0000", 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686625+0000", 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3101e-05 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686632+0000", 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5010000000000001e-06 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686636+0000", 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.591e-06 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704535+0000", 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017899024999999999 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704572+0000", 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7081e-05 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.777 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102878 4.15 4:aada5e43:::100000001f8.00000028:head [write 1081344~4096 in=4096b,write 1179648~4096 in=4096b,write 1277952~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.701102+0000", 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0065896749999999997, 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0077327159999999997, 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102878 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.778 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701102+0000", 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701102+0000", 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701101+0000", 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701128+0000", 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6585e-05 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701141+0000", 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2964e-05 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701150+0000", 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.986e-06 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702854+0000", 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001704063 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702916+0000", 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1945000000000004e-05 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.703018+0000", 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101864 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.781 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102843 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2846720~4096 in=4096b,write 3072000~4096 in=4096b,write 3190784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.686725+0000", 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.020966618999999999, 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022190529000000001, 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102843 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.782 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686725+0000", 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686725+0000", 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686724+0000", 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686740+0000", 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5838e-05 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686755+0000", 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5111e-05 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.686764+0000", 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3959999999999995e-06 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707481+0000", 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020716739000000001 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707534+0000", 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3018e-05 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707632+0000", 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7712000000000002e-05 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102880 4.d 4:b1164065:::100000001f8.00000035:head [write 3330048~8192 in=8192b,write 3440640~4096 in=4096b,write 3452928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.702349+0000", 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0053431800000000003, 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0066694959999999996, 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102880 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702349+0000", 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702349+0000", 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702348+0000", 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702366+0000", 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8218000000000001e-05 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702379+0000", 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.342e-05 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.702388+0000", 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.901e-06 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704339+0000", 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019511260000000001 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704412+0000", 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2883e-05 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102851 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.687536+0000", 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.020155685999999999, 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021556110999999999, 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102851 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.687536+0000", 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.687536+0000", 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.687535+0000", 2024-04-19T03:38:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.687551+0000", 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5574e-05 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.687564+0000", 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3318e-05 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.687573+0000", 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0289999999999994e-06 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102859 4.2f e64/14)", 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.703585+0000", 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0041065249999999998, 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005572324, 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.703585+0000", 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.703585+0000", 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.703585+0000", 2024-04-19T03:38:31.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.703618+0000", 2024-04-19T03:38:31.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3457000000000002e-05 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.703628+0000", 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5070000000000006e-06 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.703633+0000", 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.711e-06 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.798 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102844 4.2f e64/14 4:f59f865b:::100000001f8.00000007:head v 64'1589, mlcod=64'1584)", 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.689863+0000", 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.017829042, 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019351791, 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689863+0000", 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689863+0000", 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689862+0000", 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689874+0000", 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2085e-05 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689883+0000", 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8920000000000006e-06 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689889+0000", 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.609e-06 2024-04-19T03:38:31.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704495+0000", 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014606272999999999 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704526+0000", 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1078000000000003e-05 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102885 4.13 4:cbf33e86:::100000001f8.00000026:head [write 1617920~4096 in=4096b,write 1630208~4096 in=4096b,write 1720320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.704673+0000", 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0030191110000000001, 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004629317, 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102885 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704673+0000", 2024-04-19T03:38:31.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704673+0000", 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704672+0000", 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704687+0000", 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5642e-05 2024-04-19T03:38:31.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704700+0000", 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2707999999999999e-05 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704708+0000", 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0029999999999994e-06 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704757+0000", 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9308000000000003e-05 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704828+0000", 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0786999999999998e-05 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102841 4.f e64/14 4:f0d983b2:::100000001f8.0000001f:head v 64'4810, mlcod=64'4802)", 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.689894+0000", 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.01779824, 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019493805999999999, 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.806 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689894+0000", 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689894+0000", 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689893+0000", 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689903+0000", 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6039999999999999e-06 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689908+0000", 2024-04-19T03:38:31.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0640000000000001e-06 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.689911+0000", 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9229999999999998e-06 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707138+0000", 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017226696 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707159+0000", 2024-04-19T03:38:31.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0856000000000002e-05 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102883 4.2d e64/14 4:b7099a35:::100000001f8.0000000e:head v 64'3224, mlcod=64'3221)", 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.704819+0000", 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.002872842, 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046335580000000003, 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704819+0000", 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704819+0000", 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704818+0000", 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704857+0000", 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8266999999999998e-05 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704867+0000", 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0299000000000001e-05 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704873+0000", 2024-04-19T03:38:31.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5239999999999997e-06 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704909+0000", 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5864000000000001e-05 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.704929+0000", 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9707e-05 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102887 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.705666+0000", 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.002025457, 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038664070000000001, 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102887 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.814 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.705666+0000", 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.705666+0000", 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.705666+0000", 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.705680+0000", 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4341e-05 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.705693+0000", 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3256e-05 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.705702+0000", 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8950000000000004e-06 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102888 4.32 4:4f726a0c:::100000001f8.00000012:head [write 28672~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.706033+0000", 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001658475, 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035690399999999999, 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.817 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102888 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706033+0000", 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706033+0000", 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706033+0000", 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706044+0000", 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1763000000000001e-05 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706058+0000", 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3991e-05 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706067+0000", 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4710000000000007e-06 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706120+0000", 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2713000000000002e-05 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.706202+0000", 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2483000000000003e-05 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102809 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.674342+0000", 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.033349590999999998, 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.035347569000000002, 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.821 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102809 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.674342+0000", 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.674342+0000", 2024-04-19T03:38:31.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.674341+0000", 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.674355+0000", 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.381e-05 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.674366+0000", 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.116e-05 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.674372+0000", 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9689999999999999e-06 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102890 4.12 e64/14 4:4be51a30:::100000001f8.0000000b:head v 64'3269, mlcod=64'3266)", 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.707183+0000", 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00050850799999999996, 2024-04-19T03:38:31.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002575356, 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707183+0000", 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707183+0000", 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707183+0000", 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707198+0000", 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5739999999999998e-05 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707612+0000", 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00041382399999999997 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707625+0000", 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2424e-05 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707674+0000", 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9098999999999999e-05 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707695+0000", 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1654e-05 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102864 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.693155+0000", 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.014537222000000001, 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016689532, 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102864 2024-04-19T03:38:31.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.693155+0000", 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.693155+0000", 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.693153+0000", 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.693168+0000", 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776e-05 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.693180+0000", 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2012e-05 2024-04-19T03:38:31.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.693188+0000", 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1960000000000008e-06 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4526.0:102833 4.2e e64/14)", 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.707690+0000", 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.2230000000000001e-06, 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022233629999999999, 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.831 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707690+0000", 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707690+0000", 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707689+0000", 2024-04-19T03:38:31.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707693+0000", 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2989999999999998e-06 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707703+0000", 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7599999999999997e-06 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707709+0000", 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0419999999999999e-06 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:102868 4.37 e64/14)", 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.707741+0000", 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9999509, 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002269662, 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707741+0000", 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707741+0000", 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707740+0000", 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707755+0000", 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4219000000000001e-05 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707765+0000", 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9820000000000003e-06 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.707771+0000", 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4540000000000004e-06 2024-04-19T03:38:31.836 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102819 4.6 4:616d4c41:::100000001f8.00000034:head [write 872448~4096 in=4096b,write 884736~4096 in=4096b,write 1171456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.676378+0000", 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.031313549000000003, 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.033700032999999997, 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:31.837 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102819 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.676378+0000", 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.676378+0000", 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.676377+0000", 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.676394+0000", 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6946999999999999e-05 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.676409+0000", 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4585e-05 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.676418+0000", 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7590000000000003e-06 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.698223+0000", 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021805287999999999 2024-04-19T03:38:31.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.698331+0000", 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010765200000000001 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.698537+0000", 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206508 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.701889+0000", 2024-04-19T03:38:31.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003352121 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102894 4.34 4:2d2c9530:::100000001f8.00000036:head [write 3309568~4096 in=4096b,write 3338240~4096 in=4096b,write 3391488~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.708090+0000", 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9996014, 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020883659999999999, 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102894 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708090+0000", 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708090+0000", 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708089+0000", 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708105+0000", 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5418e-05 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708119+0000", 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3912e-05 2024-04-19T03:38:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708127+0000", 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8939999999999993e-06 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708180+0000", 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3338999999999999e-05 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708296+0000", 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000115868 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102895 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.708407+0000", 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9992847, 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018408840000000001, 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:31.846 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102895 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708407+0000", 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708407+0000", 2024-04-19T03:38:31.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708406+0000", 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708418+0000", 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1902000000000001e-05 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708428+0000", 2024-04-19T03:38:31.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6979999999999993e-06 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708435+0000", 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7580000000000003e-06 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102896 4.25 4:a76ff001:::100000001f8.0000002b:head [write 2170880~4096 in=4096b,write 2330624~4096 in=4096b,write 2441216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.708962+0000", 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9987302, 2024-04-19T03:38:31.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001344952, 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102896 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708962+0000", 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708962+0000", 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708961+0000", 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708973+0000", 2024-04-19T03:38:31.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1684e-05 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708984+0000", 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0832999999999999e-05 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.708990+0000", 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2129999999999996e-06 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.709042+0000", 2024-04-19T03:38:31.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1931999999999997e-05 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.709134+0000", 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2304000000000003e-05 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 38 2024-04-19T03:38:31.853 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:31.855 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:31.855 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:31.854+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:31.955 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:31.954+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:32.056 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:32.055+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:32.106 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:32.106 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:32.106 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:32.106 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:32.106 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:32.122 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:32.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-04-19T03:38:32.156 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:32.155+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:32.258 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:32.257+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:32.302 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:38:32.359 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:32.358+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:32.371 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:32.371 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:32.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:32.371 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:32.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62826 4.28 4:153ae410:::100000001f8.0000003b:head [write 2859008~4096,write 2879488~4096,write 2994176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.129352968999999, 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082994795999999996, 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62826 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238469+0000", 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238468+0000", 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238495+0000", 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6894999999999999e-05 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238509+0000", 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4479e-05 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238518+0000", 2024-04-19T03:38:32.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5879999999999998e-06 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239736+0000", 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001217982 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239833+0000", 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7609999999999995e-05 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240012+0000", 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017837300000000001 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241924+0000", 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019127059999999999 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321356+0000", 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079431515999999994 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321413+0000", 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6657000000000003e-05 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.321464+0000", 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1004999999999997e-05 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62827 4.14 4:2b28d75f:::100000001f8.00000016:head [write 2510848~4096,write 2531328~4096,write 2609152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.377 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.128955000000001, 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078975696999999997, 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62827 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:32.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238867+0000", 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238866+0000", 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238880+0000", 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4592e-05 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238891+0000", 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866000000000001e-05 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238903+0000", 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1409e-05 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.238947+0000", 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4249000000000003e-05 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239039+0000", 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1673000000000001e-05 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239193+0000", 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000154766 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241112+0000", 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001918248 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317726+0000", 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.076614071000000006 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317798+0000", 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2123e-05 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.317842+0000", 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4651000000000003e-05 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62828 4.15 4:aada5e43:::100000001f8.00000028:head [write 3923968~4096,write 4173824~4096,write 4182016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.128432629999999, 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080658297000000004, 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.383 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62828 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239389+0000", 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239388+0000", 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239425+0000", 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239444+0000", 2024-04-19T03:38:32.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8615e-05 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239454+0000", 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7319999999999993e-06 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239500+0000", 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6529000000000001e-05 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239594+0000", 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3849000000000002e-05 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239755+0000", 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000160636 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241461+0000", 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001706017 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.319969+0000", 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078508475999999994 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320011+0000", 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1897999999999998e-05 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320047+0000", 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6257999999999997e-05 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.388 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62829 4.6 4:616d4c41:::100000001f8.00000034:head [write 278528~4096,write 290816~4096,write 315392~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.128110004, 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080406688000000004, 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62829 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.389 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239712+0000", 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239711+0000", 2024-04-19T03:38:32.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239756+0000", 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5117000000000002e-05 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239767+0000", 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239773+0000", 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6749999999999999e-06 2024-04-19T03:38:32.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239813+0000", 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0564e-05 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.239873+0000", 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9837000000000003e-05 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240017+0000", 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014359799999999999 2024-04-19T03:38:32.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247032+0000", 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070153300000000002 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320024+0000", 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.072991901999999997 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320075+0000", 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1644000000000002e-05 2024-04-19T03:38:32.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320118+0000", 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3016000000000003e-05 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62830 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3342336~4096,write 3416064~4096,write 3444736~12288] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.127268632, 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079711315000000005, 2024-04-19T03:38:32.394 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62830 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240553+0000", 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240552+0000", 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240572+0000", 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9324999999999999e-05 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240583+0000", 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1422e-05 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.240591+0000", 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9300000000000003e-06 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241899+0000", 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001307938 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241952+0000", 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3220999999999997e-05 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.242053+0000", 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010141000000000001 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247058+0000", 2024-04-19T03:38:32.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050044659999999999 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320176+0000", 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.073118060999999998 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320223+0000", 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7231000000000002e-05 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320264+0000", 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1236000000000003e-05 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62831 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2031616~4096,write 2043904~4096,write 2138112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.126277861999998, 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078715436, 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.400 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62831 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241544+0000", 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241543+0000", 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241558+0000", 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4491000000000001e-05 2024-04-19T03:38:32.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241571+0000", 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3029e-05 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.241579+0000", 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243598+0000", 2024-04-19T03:38:32.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002019337 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243646+0000", 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8183999999999998e-05 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243736+0000", 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9691999999999994e-05 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248424+0000", 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046880960000000001 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320165+0000", 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071741299999999994 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320218+0000", 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2271000000000001e-05 2024-04-19T03:38:32.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.320259+0000", 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1777000000000003e-05 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.124641476000001, 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:32.406 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:32.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:32.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.122020854999999, 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.414 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:32.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.119577434, 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.118809789, 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.425 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:32.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62860 4.6 4:63e80496:::100000001f8.0000001e:head [write 3608576~4096,write 3649536~4096,write 4050944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.113861353000001, 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082270504999999994, 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62860 2024-04-19T03:38:32.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253960+0000", 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253959+0000", 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253974+0000", 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4139e-05 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.253993+0000", 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8955999999999999e-05 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254001+0000", 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8130000000000002e-06 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254042+0000", 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0728e-05 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254096+0000", 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4147000000000002e-05 2024-04-19T03:38:32.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.254218+0000", 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121736 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256573+0000", 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002355261 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336147+0000", 2024-04-19T03:38:32.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079574000000000006 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336193+0000", 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5881999999999999e-05 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336231+0000", 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7793999999999998e-05 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62867 4.6 4:616d4c41:::100000001f8.00000034:head [write 3358720~4096,write 3641344~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.111015493, 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079551001999999996, 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62867 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256806+0000", 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256805+0000", 2024-04-19T03:38:32.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256820+0000", 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4856e-05 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256834+0000", 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.344e-05 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256843+0000", 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7829999999999993e-06 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.256891+0000", 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7704000000000003e-05 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.257012+0000", 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012072499999999999 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.257176+0000", 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164554 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260920+0000", 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037431470000000001 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336292+0000", 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.075372163000000006 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336325+0000", 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3182999999999997e-05 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336357+0000", 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2391000000000002e-05 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.108217584999998, 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.443 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.448 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.105516462000001, 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:32.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62888 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2416640~4096,write 2445312~4096,write 2744320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.102194377, 2024-04-19T03:38:32.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083295955000000005, 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62888 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265627+0000", 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265662+0000", 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5512000000000002e-05 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265673+0000", 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0429e-05 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265678+0000", 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6779999999999997e-06 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265716+0000", 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7367000000000003e-05 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265773+0000", 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7500000000000002e-05 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265910+0000", 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013703700000000001 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268901+0000", 2024-04-19T03:38:32.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029905539999999999 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348859+0000", 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079958414000000005 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348895+0000", 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5652999999999999e-05 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348923+0000", 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8603999999999999e-05 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62892 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3272704~4096,write 3305472~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.100765058, 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.081941512999999994, 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.460 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62892 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267057+0000", 2024-04-19T03:38:32.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267055+0000", 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267070+0000", 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4296e-05 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267083+0000", 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3451e-05 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267092+0000", 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9409999999999996e-06 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267331+0000", 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023835999999999999 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267390+0000", 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9388999999999997e-05 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.267500+0000", 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109651 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.269522+0000", 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020223200000000002 2024-04-19T03:38:32.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348951+0000", 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079429079999999999 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348979+0000", 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7572e-05 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348998+0000", 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.969e-05 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62895 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 4104192~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.099576578000001, 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080708229000000006, 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62895 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268245+0000", 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268244+0000", 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268263+0000", 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8410000000000002e-05 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268282+0000", 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9177999999999998e-05 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268291+0000", 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6260000000000001e-06 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268330+0000", 2024-04-19T03:38:32.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9835000000000001e-05 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268409+0000", 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8597000000000007e-05 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.268515+0000", 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105925 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.270754+0000", 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022391109999999998 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348876+0000", 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.078122081999999995 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348917+0000", 2024-04-19T03:38:32.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.104e-05 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348953+0000", 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6276000000000003e-05 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.237420931999999, 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:32.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:32.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:32.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:32.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:32.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.477 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64911 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 974848~4096,write 1024000~4096,write 1384448~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.207380395000001, 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.080437593000000002, 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64911 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160441+0000", 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160440+0000", 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.160459+0000", 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8419000000000001e-05 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.161129+0000", 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00067022399999999997 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.161145+0000", 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727999999999999e-05 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218134+0000", 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.056989712999999997 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218224+0000", 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9463999999999996e-05 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.218410+0000", 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185985 2024-04-19T03:38:32.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.231493+0000", 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013083347 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240797+0000", 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0093039620000000007 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240843+0000", 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6153999999999999e-05 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.240879+0000", 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5769999999999998e-05 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4:fde182c5:::100000001f8.00000039:head [write 57344~4096,write 999424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.73097131199999998, 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100832459, 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.484 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:32.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726148+0000", 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089264587000000006 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726232+0000", 2024-04-19T03:38:32.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4432999999999996e-05 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726387+0000", 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015492899999999999 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.730073+0000", 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036859179999999998 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737597+0000", 2024-04-19T03:38:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075243239999999998 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737645+0000", 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7920999999999997e-05 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737683+0000", 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7849999999999998e-05 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:32.489 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:32.490 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:32.491 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:32.492 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:32.490+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:32.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:32.591 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:32.591+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:32.681 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:104939 4.6 e65/14 4:62d56fc8:::100000001f8.0000001c:head v 65'6519, mlcod=65'6516)", 2024-04-19T03:38:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.674782+0000", 2024-04-19T03:38:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0045331149999999999, 2024-04-19T03:38:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045582289999999996, 2024-04-19T03:38:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.681 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.674782+0000", 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.674782+0000", 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.674782+0000", 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.674830+0000", 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7824999999999997e-05 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.674839+0000", 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0059999999999998e-06 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.674845+0000", 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2020000000000001e-06 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675748+0000", 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00090360899999999999 2024-04-19T03:38:32.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675767+0000", 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9159000000000001e-05 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:104946 4.37 4:eff9002a:::100000001f8.00000003:head [write 3719168~4096 in=4096b,write 3768320~4096 in=4096b,write 3796992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.675197+0000", 2024-04-19T03:38:32.685 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0041185550000000003, 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042273229999999998, 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 104946 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675197+0000", 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675197+0000", 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675196+0000", 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675208+0000", 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2249000000000001e-05 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675219+0000", 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.078e-05 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675224+0000", 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.1499999999999998e-06 2024-04-19T03:38:32.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675260+0000", 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6019999999999997e-05 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675341+0000", 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0484999999999999e-05 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.675485+0000", 2024-04-19T03:38:32.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014455699999999999 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:104950 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 1503232~4096 in=4096b,write 1581056~4096 in=4096b,write 1601536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.676966+0000", 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00234979, 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0025551200000000001, 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:32.690 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 104950 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.676966+0000", 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.676966+0000", 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.676965+0000", 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.676976+0000", 2024-04-19T03:38:32.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1693e-05 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.676987+0000", 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0917999999999999e-05 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.676995+0000", 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4749999999999996e-06 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677037+0000", 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2194000000000003e-05 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677090+0000", 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3112999999999998e-05 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:104944 4.6 e65/14 4:62d56fc8:::100000001f8.0000001c:head v 65'6520, mlcod=65'6516)", 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.677192+0000", 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.002123125, 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0024167500000000001, 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677192+0000", 2024-04-19T03:38:32.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677192+0000", 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677192+0000", 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677212+0000", 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0454000000000001e-05 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677220+0000", 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0080000000000002e-06 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677227+0000", 2024-04-19T03:38:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4200000000000004e-06 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677807+0000", 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00058039599999999995 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677825+0000", 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8249000000000001e-05 2024-04-19T03:38:32.698 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:104952 4.12 4:48ab9bde:::100000001f8.00000015:head [write 1212416~4096 in=4096b,write 1560576~4096 in=4096b,write 1691648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.677430+0000", 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0018858080000000001, 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022507349999999998, 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:32.699 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 104952 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677430+0000", 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677430+0000", 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677429+0000", 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677451+0000", 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2061000000000001e-05 2024-04-19T03:38:32.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677460+0000", 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.1819999999999995e-06 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677467+0000", 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0890000000000002e-06 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677511+0000", 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3435e-05 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677584+0000", 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3688000000000003e-05 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:32.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.677717+0000", 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013245800000000001 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:104953 4.3f e65/14 4:fde182c5:::100000001f8.00000039:head v 65'1596, mlcod=65'1594)", 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.678123+0000", 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.001191882, 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016313149999999999, 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.704 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.678123+0000", 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.678123+0000", 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.678123+0000", 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.678137+0000", 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4421e-05 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.678146+0000", 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9870000000000005e-06 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.678153+0000", 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7129999999999999e-06 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.678176+0000", 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3388e-05 2024-04-19T03:38:32.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.678193+0000", 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:104954 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 1323008~4096 in=4096b,write 1982464~4096 in=4096b,write 2068480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.679148+0000", 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.000166961, 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00067743999999999996, 2024-04-19T03:38:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 104954 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679148+0000", 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679148+0000", 2024-04-19T03:38:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679147+0000", 2024-04-19T03:38:32.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679161+0000", 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3413e-05 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679171+0000", 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0317e-05 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679178+0000", 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2289999999999997e-06 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679220+0000", 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1702000000000002e-05 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679306+0000", 2024-04-19T03:38:32.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6242000000000005e-05 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679457+0000", 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015101599999999999 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.714 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:104955 4.11 4:893be98d:::100000001f8.00000001:head [write 1474560~4096 in=4096b,write 1560576~4096 in=4096b,write 1712128~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.679190+0000", 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00012513300000000001, 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00071168200000000005, 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 104955 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679190+0000", 2024-04-19T03:38:32.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679190+0000", 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679190+0000", 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679200+0000", 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0499000000000001e-05 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679207+0000", 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0380000000000002e-06 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679212+0000", 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8749999999999999e-06 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679310+0000", 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8028000000000004e-05 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679387+0000", 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7053999999999998e-05 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:104956 4.35 4:af28909f:::100000001f8.0000001b:head [write 3551232~12288 in=12288b,write 3579904~4096 in=4096b,write 3612672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.679224+0000", 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.0855999999999999e-05, 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000754957, 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 104956 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.719 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679224+0000", 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679224+0000", 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679224+0000", 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679236+0000", 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1674999999999999e-05 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679242+0000", 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679247+0000", 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679312+0000", 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5164000000000002e-05 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679395+0000", 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3275999999999993e-05 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:104945 4.6 e65/14)", 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.679692+0000", 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9996233, 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034926500000000002, 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679692+0000", 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679692+0000", 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679692+0000", 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679709+0000", 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7544e-05 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679728+0000", 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9174999999999999e-05 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679735+0000", 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5710000000000003e-06 2024-04-19T03:38:32.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:104948 4.36 e65/14)", 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.679742+0000", 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9995732, 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034287500000000003, 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679742+0000", 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679742+0000", 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679742+0000", 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679757+0000", 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5685999999999999e-05 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679765+0000", 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4560000000000003e-06 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.679769+0000", 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2370000000000003e-06 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.728 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:104957 4.19 e65/14)", 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:32.680059+0000", 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9992566, 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1316000000000006e-05, 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "reached pg", 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.680059+0000", 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.680059+0000", 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.680058+0000", 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.680072+0000", 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.343e-05 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.680084+0000", 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2038999999999999e-05 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.680089+0000", 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6860000000000003e-06 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:32.680125+0000", 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5153e-05 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:32.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:32.732 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:32.732 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 12 2024-04-19T03:38:32.732 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:32.733 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:32.734 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:32.733+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:32.753 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:32.778 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:32.778 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:32.779 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:32.779 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:32.782 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:32.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:32.834 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:32.833+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:32.935 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:32.935+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:32.936 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:32.936 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:32.951 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:33.040 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:33.039+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:33.137 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:33.137+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:33.163 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:33.163 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:33.178 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:33.238 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:33.238+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:33.339 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:33.339+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:33.415 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:33.415 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:33.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:33.440 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:33.439+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:33.541 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:33.540+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:33.643 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:33.643+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:33.678 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:33.678 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:33.697 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:33.781 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:33.781+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:33.845 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:33.843+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:33.944 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:33.944+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:33.955 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:33.955 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:33.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:34.046 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:34.046+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:34.147 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:34.147+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:34.154 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:34.154 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:34.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:34.250 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:34.249+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:34.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:38:34.351 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:34.350+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:34.359 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:34.359 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:34.371 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:34.452 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:34.452+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:34.554 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:34.552+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:34.606 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:34.606 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:34.611 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:34.656 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:34.656+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:34.759 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:34.755+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:34.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:34.829 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:34.829 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:34.846 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:34.887 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:34.887+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:34.956 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:34.956+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:34.974 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:34.999 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:34.999 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:35.000 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:35.000 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:35.003 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:35.003 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:35.058 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:35.056+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:35.115 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:35.115 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:35.115 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:35.115 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:35.115 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:35.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:35.158 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:35.157+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:35.258 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:35.257+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:35.359 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:35.358+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:35.379 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:38:35.386 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:35.386 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:35.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.140074026000001, 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:35.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:35.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.137453404999999, 2024-04-19T03:38:35.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:35.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.135009984, 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.398 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:35.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:35.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.134242339, 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.404 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:35.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.123650134999998, 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.409 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:35.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:35.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:35.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.120949012000001, 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.252853481999999, 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4:fde182c5:::100000001f8.00000039:head [write 57344~4096,write 999424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:35.425 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.7464038620000002, 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100832459, 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:35.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:35.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726148+0000", 2024-04-19T03:38:35.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089264587000000006 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726232+0000", 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4432999999999996e-05 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726387+0000", 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015492899999999999 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.730073+0000", 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036859179999999998 2024-04-19T03:38:35.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737597+0000", 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075243239999999998 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737645+0000", 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7920999999999997e-05 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737683+0000", 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7849999999999998e-05 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110110 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2383872~4096,write 2453504~4096,write 2482176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.40172292199999998, 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093470530999999996, 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.431 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110110 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981530+0000", 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981548+0000", 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.827e-05 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981562+0000", 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3745e-05 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981572+0000", 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9210000000000004e-06 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045614+0000", 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064041782000000005 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045699+0000", 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4690000000000004e-05 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045898+0000", 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019934600000000001 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054237+0000", 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083394360000000004 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074935+0000", 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020697898999999999 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074966+0000", 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0806999999999998e-05 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075002+0000", 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5879e-05 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110111 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2441216~4096,write 2551808~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.436 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.40167131700000003, 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093517948000000004, 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110111 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981582+0000", 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981596+0000", 2024-04-19T03:38:35.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3873000000000001e-05 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981604+0000", 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8420000000000005e-06 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981611+0000", 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0879999999999997e-06 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053316+0000", 2024-04-19T03:38:35.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071704618999999997 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053403+0000", 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6757999999999998e-05 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053574+0000", 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017118400000000001 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.057921+0000", 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043469090000000004 2024-04-19T03:38:35.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075014+0000", 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017093168999999998 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075063+0000", 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9208e-05 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075101+0000", 2024-04-19T03:38:35.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7808999999999997e-05 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110132 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2691072~4096,write 2813952~4096,write 2932736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.39554745800000002, 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093537876000000006, 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.442 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110132 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987706+0000", 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987718+0000", 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987729+0000", 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1590000000000001e-05 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987738+0000", 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4780000000000008e-06 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054265+0000", 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066526945000000004 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054370+0000", 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105499 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054556+0000", 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185761 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058085+0000", 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003529089 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081142+0000", 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023057281999999998 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081197+0000", 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4978000000000001e-05 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081245+0000", 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7345999999999997e-05 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110152 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1605632~4096,write 1675264~4096,write 1921024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.38819467699999999, 2024-04-19T03:38:35.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.094148551999999996, 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110152 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995059+0000", 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995075+0000", 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6583e-05 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995086+0000", 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995108+0000", 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1087999999999999e-05 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058217+0000", 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.063109928999999995 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058309+0000", 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1687999999999994e-05 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058434+0000", 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012497800000000001 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.068998+0000", 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010564053 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089103+0000", 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020104899999999998 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089158+0000", 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4880000000000003e-05 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089208+0000", 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0241000000000002e-05 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110160 4.27 4:e68799fb:::100000001f8.00000018:head [write 2277376~4096,write 2322432~4096,write 2445312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.38571869399999997, 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.10998324299999999, 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110160 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.453 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:35.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:35.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997535+0000", 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997549+0000", 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4514e-05 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997561+0000", 2024-04-19T03:38:35.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1701e-05 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997569+0000", 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7610000000000007e-06 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095749+0000", 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.098180607000000003 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095831+0000", 2024-04-19T03:38:35.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1689999999999999e-05 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107325+0000", 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011493512000000001 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107444+0000", 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011904 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107519+0000", 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5278999999999995e-05 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110172 4.36 4:6fa85f86:::100000001f8.00000013:head [write 663552~4096,write 688128~4096,write 921600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.37881733699999998, 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084877683999999995, 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.458 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110172 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004436+0000", 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004456+0000", 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0098999999999998e-05 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004470+0000", 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4117999999999999e-05 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004480+0000", 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9809999999999998e-06 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063606+0000", 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059126074000000001 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063696+0000", 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0105999999999994e-05 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063813+0000", 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116574 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075044+0000", 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011231507999999999 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089219+0000", 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014175304999999999 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089265+0000", 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5853999999999998e-05 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089315+0000", 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9366999999999997e-05 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110174 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3280896~4096,write 3293184~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:35.463 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.37872783700000001, 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084998899000000003, 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110174 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004539+0000", 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3473e-05 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004550+0000", 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0438999999999999e-05 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004558+0000", 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0139999999999998e-06 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069043+0000", 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064484737 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069127+0000", 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3905000000000004e-05 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069337+0000", 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000210471 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081133+0000", 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011795684000000001 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089438+0000", 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083048649999999998 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089484+0000", 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6832999999999997e-05 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089525+0000", 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1026000000000003e-05 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.468 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110212 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3047424~8192,write 3063808~4096,write 3076096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.36536408799999998, 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093266469000000005, 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110212 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017889+0000", 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017905+0000", 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5617e-05 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017915+0000", 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0215e-05 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017923+0000", 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6990000000000003e-06 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097726+0000", 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079803221999999993 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097839+0000", 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112575 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.098019+0000", 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180392 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111092+0000", 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013072587 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111104+0000", 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.236e-05 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111134+0000", 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9513999999999999e-05 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111157+0000", 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3156999999999999e-05 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110221 4.36 4:6da220e6:::100000001f8.0000003f:head [write 4096~4096,write 24576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.474 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.36169663400000002, 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084587624, 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110221 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021557+0000", 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021581+0000", 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4346999999999999e-05 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021594+0000", 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2602999999999999e-05 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021602+0000", 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078747+0000", 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.057145174999999999 2024-04-19T03:38:35.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078838+0000", 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0402999999999995e-05 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078969+0000", 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013092900000000001 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084690+0000", 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057209870000000003 2024-04-19T03:38:35.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106035+0000", 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021345425000000001 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106092+0000", 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6842999999999998e-05 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106145+0000", 2024-04-19T03:38:35.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3536999999999999e-05 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110231 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2793472~4096,write 2838528~4096,write 3112960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.35745047200000002, 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083514087000000001, 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.480 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110231 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025803+0000", 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025813+0000", 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6220000000000004e-06 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025820+0000", 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5509999999999996e-06 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025825+0000", 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3029999999999999e-06 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084726+0000", 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058900606000000001 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084812+0000", 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6182999999999998e-05 2024-04-19T03:38:35.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084984+0000", 2024-04-19T03:38:35.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017231700000000001 2024-04-19T03:38:35.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089351+0000", 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043671459999999997 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109218+0000", 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019866681000000001 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109263+0000", 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5621000000000002e-05 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109318+0000", 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4435999999999999e-05 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110234 4.6 4:616d4c41:::100000001f8.00000034:head [write 3207168~8192,write 3223552~4096,write 3342336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.35609690900000002, 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085527898000000005, 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.487 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110234 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027172+0000", 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5939000000000001e-05 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027184+0000", 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1139e-05 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027191+0000", 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089455+0000", 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.062263753999999998 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089534+0000", 2024-04-19T03:38:35.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8744000000000004e-05 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089690+0000", 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156203 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102714+0000", 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013023798 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112600+0000", 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0098863189999999993 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112649+0000", 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8986000000000002e-05 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112685+0000", 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6251000000000002e-05 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110414 4.36 4:6fa85f86:::100000001f8.00000013:head [write 348160~4096,write 409600~4096,write 438272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.28025612700000002, 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085383260000000002, 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110414 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102997+0000", 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103011+0000", 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4224e-05 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103023+0000", 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2024e-05 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103032+0000", 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6049999999999998e-06 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164051+0000", 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.06101939 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164139+0000", 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7497999999999995e-05 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164269+0000", 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013044700000000001 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:35.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.177794+0000", 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013525099 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188243+0000", 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010448834000000001 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188329+0000", 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6120999999999998e-05 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:35.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188381+0000", 2024-04-19T03:38:35.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2030000000000002e-05 2024-04-19T03:38:35.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.498 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:35.498 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:35.498 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:35.499 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:35.498+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:35.500 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:35.600 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:35.599+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:35.695 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:35.695 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:35.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.695 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111609 4.37 4:ef395e89:::100000001f8.00000020:head [write 3284992~4096 in=4096b,write 3317760~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.695 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.677269+0000", 2024-04-19T03:38:35.696 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.014266897000000001, 2024-04-19T03:38:35.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014296156000000001, 2024-04-19T03:38:35.696 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.696 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:35.696 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.696 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.697 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.697 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111609 2024-04-19T03:38:35.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.697 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.677269+0000", 2024-04-19T03:38:35.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.677269+0000", 2024-04-19T03:38:35.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.677268+0000", 2024-04-19T03:38:35.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.677297+0000", 2024-04-19T03:38:35.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8476e-05 2024-04-19T03:38:35.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.677309+0000", 2024-04-19T03:38:35.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2473999999999999e-05 2024-04-19T03:38:35.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.677316+0000", 2024-04-19T03:38:35.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0659999999999998e-06 2024-04-19T03:38:35.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.683009+0000", 2024-04-19T03:38:35.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0056928730000000002 2024-04-19T03:38:35.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.683079+0000", 2024-04-19T03:38:35.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9875000000000004e-05 2024-04-19T03:38:35.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:35.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.683212+0000", 2024-04-19T03:38:35.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133158 2024-04-19T03:38:35.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.704 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:111611 4.28 e66/14 4:15eeb89b:::100000001f8.00000032:head v 66'3481, mlcod=66'3478)", 2024-04-19T03:38:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.678980+0000", 2024-04-19T03:38:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.012555701000000001, 2024-04-19T03:38:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.012693505000000001, 2024-04-19T03:38:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.678980+0000", 2024-04-19T03:38:35.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.678980+0000", 2024-04-19T03:38:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.678980+0000", 2024-04-19T03:38:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.678992+0000", 2024-04-19T03:38:35.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2619000000000001e-05 2024-04-19T03:38:35.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.679001+0000", 2024-04-19T03:38:35.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5839999999999995e-06 2024-04-19T03:38:35.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.679049+0000", 2024-04-19T03:38:35.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8055e-05 2024-04-19T03:38:35.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.680803+0000", 2024-04-19T03:38:35.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017539980000000001 2024-04-19T03:38:35.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.680823+0000", 2024-04-19T03:38:35.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9545999999999999e-05 2024-04-19T03:38:35.710 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.710 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.711 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.711 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111616 4.38 4:1d13bf87:::100000001f8.00000030:head [write 196608~4096 in=4096b,write 212992~4096 in=4096b,write 352256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.711 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.681791+0000", 2024-04-19T03:38:35.711 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0097454020000000002, 2024-04-19T03:38:35.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099682350000000006, 2024-04-19T03:38:35.711 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.712 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.712 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.712 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.712 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.712 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111616 2024-04-19T03:38:35.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.712 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.681791+0000", 2024-04-19T03:38:35.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.681791+0000", 2024-04-19T03:38:35.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.681789+0000", 2024-04-19T03:38:35.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-19T03:38:35.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.681803+0000", 2024-04-19T03:38:35.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4371e-05 2024-04-19T03:38:35.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.681813+0000", 2024-04-19T03:38:35.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7079999999999992e-06 2024-04-19T03:38:35.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.681819+0000", 2024-04-19T03:38:35.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8030000000000002e-06 2024-04-19T03:38:35.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.688014+0000", 2024-04-19T03:38:35.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061954920000000004 2024-04-19T03:38:35.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.688092+0000", 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8236000000000001e-05 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111618 4.11 4:8b544b63:::100000001f8.0000002c:head [write 2482176~4096 in=4096b,write 2871296~4096 in=4096b,write 2928640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.682539+0000", 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0089972679999999992, 2024-04-19T03:38:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0093012679999999997, 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111618 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682539+0000", 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682539+0000", 2024-04-19T03:38:35.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682538+0000", 2024-04-19T03:38:35.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682553+0000", 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5373999999999999e-05 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682565+0000", 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1229999999999999e-05 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682571+0000", 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6449999999999999e-06 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682614+0000", 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3254999999999998e-05 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682702+0000", 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8016999999999994e-05 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.721 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:111617 4.3f e66/14 4:fde182c5:::100000001f8.00000039:head v 66'1698, mlcod=66'1696)", 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.682550+0000", 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0089864760000000002, 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0093527679999999992, 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682550+0000", 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682550+0000", 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682549+0000", 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682564+0000", 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4969e-05 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682574+0000", 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.9879999999999999e-06 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.682581+0000", 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2089999999999999e-06 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.683201+0000", 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00062010899999999998 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.683220+0000", 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8726e-05 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111621 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 3219456~4096 in=4096b,write 3506176~4096 in=4096b,write 3588096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.684589+0000", 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0069472570000000001, 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007366877, 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111621 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.684589+0000", 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.684589+0000", 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.684588+0000", 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.684601+0000", 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3266e-05 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.684612+0000", 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0645999999999999e-05 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.684620+0000", 2024-04-19T03:38:35.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8140000000000001e-06 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.684672+0000", 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2614999999999997e-05 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.684762+0000", 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9337000000000002e-05 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.684910+0000", 2024-04-19T03:38:35.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014845099999999999 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.688834+0000", 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039242749999999996 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111556 4.38 4:1d13bf87:::100000001f8.00000030:head [write 2691072~4096 in=4096b,write 2740224~4096 in=4096b,write 2838528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.655975+0000", 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.035560832000000001, 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.036034125, 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111556 2024-04-19T03:38:35.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.655975+0000", 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.655975+0000", 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.655974+0000", 2024-04-19T03:38:35.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.655984+0000", 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4020000000000008e-06 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.655992+0000", 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1189999999999997e-06 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.656003+0000", 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0817e-05 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.668796+0000", 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01279364 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.668880+0000", 2024-04-19T03:38:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3125000000000001e-05 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111624 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 1839104~4096 in=4096b,write 2142208~4096 in=4096b,write 2195456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.685741+0000", 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0057953409999999999, 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0063202429999999997, 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.735 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111624 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685741+0000", 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685741+0000", 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685740+0000", 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685755+0000", 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4939999999999999e-05 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685763+0000", 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4630000000000001e-06 2024-04-19T03:38:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685769+0000", 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6910000000000002e-06 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.686087+0000", 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00031795 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.686173+0000", 2024-04-19T03:38:35.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5933000000000005e-05 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:111623 4.15 e66/14 4:aada5e43:::100000001f8.00000028:head v 66'1755, mlcod=66'1753)", 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.685783+0000", 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0057530749999999999, 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006351677, 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685783+0000", 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685783+0000", 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685783+0000", 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685793+0000", 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0874e-05 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685799+0000", 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3020000000000002e-06 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.685803+0000", 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9009999999999996e-06 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.686272+0000", 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00046926100000000001 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.686291+0000", 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9539e-05 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111627 4.37 4:ef395e89:::100000001f8.00000020:head [write 901120~4096 in=4096b,write 1445888~4096 in=4096b,write 1728512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.687125+0000", 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0044108929999999999, 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0050937789999999997, 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111627 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687125+0000", 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687125+0000", 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687125+0000", 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687136+0000", 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1124000000000001e-05 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687145+0000", 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.499e-06 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687153+0000", 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5240000000000003e-06 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687354+0000", 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000201678 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687465+0000", 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011113200000000001 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:35.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687624+0000", 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000158696 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111628 4.11 4:8b544b63:::100000001f8.0000002c:head [write 2457600~4096 in=4096b,write 3514368~4096 in=4096b,write 3584000~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.687502+0000", 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0040342099999999999, 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0047952480000000002, 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.747 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111628 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687502+0000", 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687502+0000", 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687501+0000", 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687513+0000", 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1368e-05 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687522+0000", 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4639999999999995e-06 2024-04-19T03:38:35.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687529+0000", 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9269999999999999e-06 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687567+0000", 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8473999999999998e-05 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.687645+0000", 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7511999999999999e-05 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111597 4.38 4:1dcf718c:::100000001f8.00000022:head [write 3018752~4096 in=4096b,write 3051520~4096 in=4096b,write 3096576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.672072+0000", 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.019463591999999998, 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020297328999999999, 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.751 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111597 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.672072+0000", 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.672072+0000", 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.672072+0000", 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.672082+0000", 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0587e-05 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.672091+0000", 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.672097+0000", 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5019999999999998e-06 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.676704+0000", 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046062730000000001 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.676789+0000", 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5797999999999994e-05 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:111629 4.3f e66/14 4:fde182c5:::100000001f8.00000039:head v 66'1699, mlcod=66'1696)", 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.688983+0000", 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0025525880000000002, 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034531480000000001, 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.688983+0000", 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.688983+0000", 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.688983+0000", 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.688994+0000", 2024-04-19T03:38:35.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1409999999999999e-05 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689001+0000", 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.426e-06 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689005+0000", 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6179999999999997e-06 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690235+0000", 2024-04-19T03:38:35.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012293639999999999 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690251+0000", 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6909e-05 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111632 4.38 4:1fc350da:::100000001f8.0000002f:head [write 1130496~4096 in=4096b,write 1302528~4096 in=4096b,write 1359872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.689048+0000", 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.002488143, 2024-04-19T03:38:35.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0034498860000000001, 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111632 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689048+0000", 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689048+0000", 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689047+0000", 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689057+0000", 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.6809999999999993e-06 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689066+0000", 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8370000000000003e-06 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689072+0000", 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4230000000000002e-06 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690809+0000", 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00173661 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690856+0000", 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7698999999999999e-05 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111633 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 1003520~4096 in=4096b,write 1064960~4096 in=4096b,write 1286144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.689484+0000", 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.002052393, 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003094224, 2024-04-19T03:38:35.762 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111633 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689484+0000", 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689484+0000", 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689483+0000", 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689496+0000", 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3251000000000001e-05 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689506+0000", 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0328e-05 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689514+0000", 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4549999999999998e-06 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689598+0000", 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3622999999999995e-05 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689692+0000", 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4052e-05 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.689840+0000", 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014837300000000001 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111567 4.38 4:1dcf718c:::100000001f8.00000022:head [write 200704~8192 in=8192b,write 212992~4096 in=4096b,write 233472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.766 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.659641+0000", 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.031894654000000001, 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.033017654, 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111567 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.659641+0000", 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.659641+0000", 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.659640+0000", 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.659659+0000", 2024-04-19T03:38:35.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8731000000000001e-05 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.659670+0000", 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1155000000000001e-05 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.659678+0000", 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3590000000000002e-06 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.673447+0000", 2024-04-19T03:38:35.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.013769164 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.673531+0000", 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4468000000000005e-05 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111634 4.35 4:af28909f:::100000001f8.0000001b:head [write 1605632~8192 in=8192b,write 1622016~4096 in=4096b,write 1642496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.690116+0000", 2024-04-19T03:38:35.770 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.001420454, 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002609934, 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111634 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690116+0000", 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690116+0000", 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690115+0000", 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690131+0000", 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6076e-05 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690143+0000", 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2498e-05 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690152+0000", 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3650000000000004e-06 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690409+0000", 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00025776999999999999 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.690491+0000", 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1402000000000004e-05 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.774 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111602 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3112960~4096 in=4096b,write 3358720~4096 in=4096b,write 3395584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.674360+0000", 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.017175721000000001, 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018432160999999999, 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111602 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674360+0000", 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674360+0000", 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674359+0000", 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674371+0000", 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1999e-05 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674381+0000", 2024-04-19T03:38:35.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7799999999999995e-06 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674388+0000", 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9e-06 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674426+0000", 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8290000000000001e-05 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674499+0000", 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2745999999999998e-05 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111635 4.23 4:c6f90462:::100000001f8.00000037:head [write 1851392~4096 in=4096b,write 1974272~4096 in=4096b,write 2080768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.691663+0000", 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9998732, 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011965389999999999, 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.779 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111635 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.691663+0000", 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.691663+0000", 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.691662+0000", 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.691673+0000", 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0473e-05 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.691681+0000", 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8709999999999997e-06 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.691686+0000", 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.691729+0000", 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3404e-05 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.691823+0000", 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3324000000000003e-05 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692010+0000", 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00018692700000000001 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.783 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111603 4.38 4:1d13bf87:::100000001f8.00000030:head [write 1228800~8192 in=8192b,write 1691648~4096 in=4096b,write 1703936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.674688+0000", 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.016848075000000001, 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.018248164000000001, 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111603 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674688+0000", 2024-04-19T03:38:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674688+0000", 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674687+0000", 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674706+0000", 2024-04-19T03:38:35.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8518000000000001e-05 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674715+0000", 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7429999999999997e-06 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.674723+0000", 2024-04-19T03:38:35.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3209999999999999e-06 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.680815+0000", 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.006092681 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.680904+0000", 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8358999999999999e-05 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.787 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111636 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2760704~4096 in=4096b,write 2928640~4096 in=4096b,write 3182592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.692160+0000", 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9993758, 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00086200399999999998, 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.788 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111636 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692160+0000", 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692160+0000", 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692160+0000", 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692179+0000", 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9468999999999999e-05 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692188+0000", 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0829999999999993e-06 2024-04-19T03:38:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692193+0000", 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0180000000000001e-06 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692218+0000", 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5113000000000002e-05 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692268+0000", 2024-04-19T03:38:35.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9143e-05 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:111604 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1335296~4096 in=4096b,write 1363968~4096 in=4096b,write 1499136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.675229+0000", 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.016307168, 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.017860971999999999, 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 111604 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.675229+0000", 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.793 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.675229+0000", 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.675228+0000", 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.675245+0000", 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6704000000000001e-05 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.794 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.675256+0000", 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0920999999999999e-05 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.675263+0000", 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.815e-06 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.683145+0000", 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078826910000000007 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.795 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.683228+0000", 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2509000000000006e-05 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(client.4526.0:111609 4.37 e66/14)", 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.692501+0000", 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9990354, 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00062727799999999999, 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692501+0000", 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692501+0000", 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692500+0000", 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692505+0000", 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8720000000000001e-06 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692514+0000", 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.8959999999999992e-06 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.798 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692521+0000", 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8020000000000003e-06 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop_reply(client.4526.0:111627 4.37 e66/14)", 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:35.692527+0000", 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4294967295.9990091, 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00063390799999999998, 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.799 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692527+0000", 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692527+0000", 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692527+0000", 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.800 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692529+0000", 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5119999999999998e-06 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692536+0000", 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9970000000000001e-06 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:35.692541+0000", 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5959999999999997e-06 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.801 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:35.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.802 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:35.802 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:35.802 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 24 2024-04-19T03:38:35.802 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:35.803 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:35.804 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:35.803+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:35.905 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:35.904+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:36.006 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:36.006+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:36.031 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:36.031 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:36.031 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:36.045 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:36.108 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:36.105+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:36.208 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:36.207+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:36.235 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 23.000658726000001, 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.236 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.999503392000001, 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.241 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:36.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.998072495999999, 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.247 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:36.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:36.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:36.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.997209527999999, 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:36.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:36.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:36.256 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.996776336, 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:36.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.995328299000001, 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.262 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:36.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:36.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:36.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.994653127999999, 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.993162558000002, 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.272 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:36.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.992760449999999, 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:36.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.992717076000002, 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:36.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.285 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.992685161000001, 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.991243862000001, 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.290 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:36.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:36.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:36.296 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.990988423000001, 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:36.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.300 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.990295482000001, 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:36.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:36.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.305 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:36.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62831 4.36 e58/14 4:6fa85f86:::100000001f8.00000013:head v 58'2938, mlcod=58'2936)", 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.989293619000001, 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074231808999999996, 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243853+0000", 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243852+0000", 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.243867+0000", 2024-04-19T03:38:36.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4694e-05 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291730+0000", 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.047863307000000001 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.291749+0000", 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9361999999999999e-05 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292182+0000", 2024-04-19T03:38:36.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00043303999999999999 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.292206+0000", 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3519999999999998e-05 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318066+0000", 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.025860409000000001 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318084+0000", 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.806e-05 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.153557213999999, 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.312 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:36.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:36.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:36.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:36.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:36.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:36.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.152863369999999, 2024-04-19T03:38:36.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:36.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:36.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.152461069000001, 2024-04-19T03:38:36.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:36.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:36.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.330 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.149857215000001, 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:36.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:36.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:36.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.149498510000001, 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.337 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:36.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:36.342 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:36.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:36.345 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:36.343+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:36.444 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:36.443+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:36.546 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:36.545+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:36.570 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.570 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113469 4.6 4:63e80496:::100000001f8.0000001e:head [write 4067328~4096 in=4096b,write 4104192~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.560399+0000", 2024-04-19T03:38:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0072865869999999998, 2024-04-19T03:38:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073145320000000003, 2024-04-19T03:38:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113469 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560399+0000", 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560399+0000", 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560399+0000", 2024-04-19T03:38:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560412+0000", 2024-04-19T03:38:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3572e-05 2024-04-19T03:38:36.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560423+0000", 2024-04-19T03:38:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0818999999999999e-05 2024-04-19T03:38:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560431+0000", 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561674+0000", 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012426430000000001 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561778+0000", 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103863 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561950+0000", 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017211900000000001 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113470 4.13 4:cbf33e86:::100000001f8.00000026:head [write 749568~4096 in=4096b,write 786432~4096 in=4096b,write 811008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.560439+0000", 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0072466020000000004, 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073833370000000002, 2024-04-19T03:38:36.576 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113470 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560439+0000", 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560439+0000", 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560439+0000", 2024-04-19T03:38:36.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560453+0000", 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4343e-05 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560461+0000", 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8129999999999996e-06 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560467+0000", 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0179999999999998e-06 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562259+0000", 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001791616 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562415+0000", 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156465 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113473 4.6 4:616d4c41:::100000001f8.00000034:head [write 937984~4096 in=4096b,write 1097728~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.561583+0000", 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0061029409999999997, 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0063347849999999999, 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113473 2024-04-19T03:38:36.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561583+0000", 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561583+0000", 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561582+0000", 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561595+0000", 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3441000000000001e-05 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561625+0000", 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9084000000000001e-05 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561634+0000", 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7580000000000004e-06 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564943+0000", 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033090279999999999 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565012+0000", 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.881e-05 2024-04-19T03:38:36.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565153+0000", 2024-04-19T03:38:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014080000000000001 2024-04-19T03:38:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:113475 4.37 e66/14 4:ecbf0fb2:::100000001f8.00000038:head v 66'5325, mlcod=66'5320)", 2024-04-19T03:38:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.562827+0000", 2024-04-19T03:38:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0048586970000000004, 2024-04-19T03:38:36.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052020850000000004, 2024-04-19T03:38:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562827+0000", 2024-04-19T03:38:36.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562827+0000", 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562827+0000", 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562842+0000", 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5074e-05 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562849+0000", 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5120000000000002e-06 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562855+0000", 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5180000000000004e-06 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562945+0000", 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0272000000000006e-05 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562969+0000", 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3788e-05 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:113474 4.23 e66/14 4:c6f90462:::100000001f8.00000037:head v 66'1759, mlcod=66'1757)", 2024-04-19T03:38:36.590 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.562930+0000", 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0047556270000000001, 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051745100000000002, 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562930+0000", 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562930+0000", 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562930+0000", 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562957+0000", 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7668999999999999e-05 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562972+0000", 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4178e-05 2024-04-19T03:38:36.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562978+0000", 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.365e-06 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.563746+0000", 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076847000000000005 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.563765+0000", 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8261e-05 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.593 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:113478 4.12 e66/14 4:48ab9bde:::100000001f8.00000015:head v 66'3591, mlcod=66'3588)", 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.564435+0000", 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.003250752, 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037276470000000002, 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:36.594 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564435+0000", 2024-04-19T03:38:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564435+0000", 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564434+0000", 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564449+0000", 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4299e-05 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564460+0000", 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1080000000000001e-05 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564468+0000", 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0539999999999995e-06 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564598+0000", 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013052499999999999 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564618+0000", 2024-04-19T03:38:36.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9806999999999999e-05 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113480 4.6 4:616d4c41:::100000001f8.00000034:head [write 368640~4096 in=4096b,write 524288~4096 in=4096b,write 655360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.564656+0000", 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0030299419999999999, 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035492620000000001, 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.598 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113480 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564656+0000", 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564656+0000", 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564655+0000", 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564669+0000", 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4554e-05 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564681+0000", 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1385e-05 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.564690+0000", 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2399999999999996e-06 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567537+0000", 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028472739999999999 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567619+0000", 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1589999999999996e-05 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567786+0000", 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167434 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:113477 4.f e66/14 4:f2a80dfe:::100000001f8.00000019:head v 66'5317, mlcod=66'5315)", 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.565747+0000", 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001939077, 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025165809999999999, 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.602 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565747+0000", 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565747+0000", 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565746+0000", 2024-04-19T03:38:36.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565763+0000", 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6586999999999999e-05 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565776+0000", 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3363000000000001e-05 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565784+0000", 2024-04-19T03:38:36.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5109999999999997e-06 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565825+0000", 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1736999999999997e-05 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565846+0000", 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0412999999999999e-05 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:113479 4.37 e66/14 4:ecbf0fb2:::100000001f8.00000038:head v 66'5326, mlcod=66'5322)", 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.565802+0000", 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0018837439999999999, 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025159750000000002, 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565802+0000", 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565802+0000", 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565802+0000", 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565813+0000", 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1157e-05 2024-04-19T03:38:36.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565820+0000", 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1629999999999999e-06 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565826+0000", 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0179999999999998e-06 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565858+0000", 2024-04-19T03:38:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2131000000000001e-05 2024-04-19T03:38:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.565879+0000", 2024-04-19T03:38:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0967000000000001e-05 2024-04-19T03:38:36.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.610 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113485 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 1851392~4096 in=4096b,write 1945600~4096 in=4096b,write 2109440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.567078+0000", 2024-04-19T03:38:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00060794199999999999, 2024-04-19T03:38:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001280219, 2024-04-19T03:38:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:36.611 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113485 2024-04-19T03:38:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567078+0000", 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567078+0000", 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567077+0000", 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567091+0000", 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4093999999999999e-05 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567104+0000", 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3142000000000001e-05 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567114+0000", 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3230000000000004e-06 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567168+0000", 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4413000000000002e-05 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567323+0000", 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015529699999999999 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113486 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.567502+0000", 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00018384200000000001, 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089644300000000002, 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113486 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567502+0000", 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567502+0000", 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567501+0000", 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567515+0000", 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3738e-05 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567527+0000", 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1712999999999999e-05 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567537+0000", 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0294e-05 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.618 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113487 4.d 4:b1164065:::100000001f8.00000035:head [write 2416640~4096 in=4096b,write 2437120~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.567860+0000", 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9998264, 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060655300000000002, 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113487 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.619 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567860+0000", 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567860+0000", 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567859+0000", 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567879+0000", 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0182000000000001e-05 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567890+0000", 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1195e-05 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567898+0000", 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0439999999999996e-06 2024-04-19T03:38:36.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567947+0000", 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9378000000000001e-05 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568030+0000", 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2968999999999998e-05 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4526.0:113469 4.6 e66/14)", 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.567940+0000", 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9997454, 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00059382800000000002, 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567940+0000", 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567940+0000", 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567940+0000", 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567945+0000", 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9980000000000003e-06 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567955+0000", 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9629999999999993e-06 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567962+0000", 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2239999999999998e-06 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113488 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.568288+0000", 2024-04-19T03:38:36.625 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9993982, 2024-04-19T03:38:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000276614, 2024-04-19T03:38:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113488 2024-04-19T03:38:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.626 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568288+0000", 2024-04-19T03:38:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568288+0000", 2024-04-19T03:38:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568287+0000", 2024-04-19T03:38:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568301+0000", 2024-04-19T03:38:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4226999999999999e-05 2024-04-19T03:38:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568313+0000", 2024-04-19T03:38:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1586999999999999e-05 2024-04-19T03:38:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568323+0000", 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0166000000000001e-05 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:113484 4.37 e66/14)", 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.568424+0000", 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9992623, 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017362200000000001, 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568424+0000", 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568424+0000", 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568423+0000", 2024-04-19T03:38:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568442+0000", 2024-04-19T03:38:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8864000000000001e-05 2024-04-19T03:38:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568452+0000", 2024-04-19T03:38:36.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7499999999999998e-06 2024-04-19T03:38:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568459+0000", 2024-04-19T03:38:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.075e-06 2024-04-19T03:38:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.635 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:113482 4.f e66/14)", 2024-04-19T03:38:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.568466+0000", 2024-04-19T03:38:36.636 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9992199, 2024-04-19T03:38:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000164122, 2024-04-19T03:38:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568466+0000", 2024-04-19T03:38:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568466+0000", 2024-04-19T03:38:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568466+0000", 2024-04-19T03:38:36.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568480+0000", 2024-04-19T03:38:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3784999999999999e-05 2024-04-19T03:38:36.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568487+0000", 2024-04-19T03:38:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2840000000000001e-06 2024-04-19T03:38:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568492+0000", 2024-04-19T03:38:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6169999999999998e-06 2024-04-19T03:38:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113463 4.6 4:616d4c41:::100000001f8.00000034:head [write 90112~4096 in=4096b,write 110592~4096 in=4096b,write 167936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.557204+0000", 2024-04-19T03:38:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0104817, 2024-04-19T03:38:36.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011459522, 2024-04-19T03:38:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113463 2024-04-19T03:38:36.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.557204+0000", 2024-04-19T03:38:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.557204+0000", 2024-04-19T03:38:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.557203+0000", 2024-04-19T03:38:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.557240+0000", 2024-04-19T03:38:36.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7135999999999998e-05 2024-04-19T03:38:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.557253+0000", 2024-04-19T03:38:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2808e-05 2024-04-19T03:38:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.557261+0000", 2024-04-19T03:38:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6000000000000001e-06 2024-04-19T03:38:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.557326+0000", 2024-04-19T03:38:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4740999999999996e-05 2024-04-19T03:38:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.557406+0000", 2024-04-19T03:38:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0085000000000003e-05 2024-04-19T03:38:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.557577+0000", 2024-04-19T03:38:36.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017115500000000001 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.567511+0000", 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099339849999999993 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:113465 4.37 e66/14 4:ecbf0fb2:::100000001f8.00000038:head v 66'5324, mlcod=66'5320)", 2024-04-19T03:38:36.651 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.558249+0000", 2024-04-19T03:38:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0094374300000000001, 2024-04-19T03:38:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010463666999999999, 2024-04-19T03:38:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558249+0000", 2024-04-19T03:38:36.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558249+0000", 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558248+0000", 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558262+0000", 2024-04-19T03:38:36.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4260000000000001e-05 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558283+0000", 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1053e-05 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558291+0000", 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.238e-06 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560285+0000", 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019942950000000001 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.560306+0000", 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1537000000000001e-05 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:113466 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 1036288~4096 in=4096b,write 1056768~4096 in=4096b,write 1564672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:36.558384+0000", 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0093016000000000001, 2024-04-19T03:38:36.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010366448, 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 113466 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558384+0000", 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558384+0000", 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558383+0000", 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558398+0000", 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4630999999999999e-05 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558409+0000", 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0576e-05 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.558418+0000", 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0259999999999996e-06 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561875+0000", 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003457487 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.561948+0000", 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3399000000000007e-05 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.562098+0000", 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014955799999999999 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:36.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:36.568036+0000", 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059382109999999997 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 19 2024-04-19T03:38:36.660 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:36.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:36.662 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:36.661+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:36.762 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:36.761+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:36.862 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:36.862+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:36.934 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:36.934 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:36.934 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:36.935 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:36.935 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:36.953 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:36.994 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:36.994+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:37.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:37.065 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:37.064+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:37.166 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:37.165+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:37.198 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:37.209 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:37.209 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:37.222 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:37.226 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:37.226 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:37.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:37.273 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:37.272+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:37.370 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:37.369+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:37.412 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:37.412 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:37.426 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:37.470 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:37.469+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:37.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:38:37.575 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:37.574+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:37.666 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:37.666 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:37.672 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:37.672+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:37.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:37.773 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:37.772+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:37.876 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:37.875+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:37.929 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:37.930 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:37.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:37.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~129s 2024-04-19T03:38:37.978 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:37.975+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:38.080 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:38.079+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:38.155 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:38.156 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:38.173 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:38.217 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:38.215+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:38.277 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:38.276+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:38.379 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:38.378+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:38.390 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:38:38.437 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:38.437 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:38.449 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:38.492 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:38.490+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:38.581 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:38.580+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:38.681 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:38.680+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:38.713 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:38.713 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:38.723 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:38.784 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:38.783+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:38.882 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:38.881+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:38.914 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:38.914 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:38.929 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:38.983 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:38.983+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:39.085 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:39.085+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:39.154 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:39.154 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:39.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:39.185 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:39.185+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:39.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:39.286 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:39.285+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:39.356 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:39.357 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:39.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:39.414 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:39.413+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:39.428 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:39.453 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:39.458 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:39.458 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:39.488 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:39.488+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:39.588 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:39.588+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:39.605 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120243 4.d 4:b1164065:::100000001f8.00000035:head [write 3543040~4096 in=4096b,write 3846144~4096 in=4096b,write 4165632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.594434+0000", 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0089323500000000004, 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0089683290000000006, 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120243 2024-04-19T03:38:39.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594434+0000", 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594434+0000", 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594433+0000", 2024-04-19T03:38:39.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594453+0000", 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0202000000000001e-05 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594466+0000", 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.277e-05 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594475+0000", 2024-04-19T03:38:39.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999993e-06 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594521+0000", 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6431999999999999e-05 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594585+0000", 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3480999999999997e-05 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.609 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120244 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 684032~4096 in=4096b,write 942080~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.594832+0000", 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0085337079999999992, 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0086657230000000002, 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.610 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.611 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.611 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120244 2024-04-19T03:38:39.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.611 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594832+0000", 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594832+0000", 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594831+0000", 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594845+0000", 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3813e-05 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594859+0000", 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3555e-05 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594866+0000", 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7139999999999993e-06 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594901+0000", 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4484999999999999e-05 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.594971+0000", 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0574999999999994e-05 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:39.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603491+0000", 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085191610000000008 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120245 4.13 4:caef1406:::100000001f8.00000031:head [write 4067328~4096 in=4096b,write 4104192~4096 in=4096b,write 4165632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.595176+0000", 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0081905629999999997, 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0084245489999999999, 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120245 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.595176+0000", 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.595176+0000", 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.595175+0000", 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.595187+0000", 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2485e-05 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.595197+0000", 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7680000000000003e-06 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.595205+0000", 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7109999999999995e-06 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.595330+0000", 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012574299999999999 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.595418+0000", 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7843000000000006e-05 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603345+0000", 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079265740000000005 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120252 4.22 4:47e99c31:::100000001f8.00000025:head [write 1499136~4096 in=4096b,write 1572864~4096 in=4096b,write 1662976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.619 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.598570+0000", 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0047957349999999998, 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051299830000000003, 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120252 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598570+0000", 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598570+0000", 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598570+0000", 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598583+0000", 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.345e-05 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598592+0000", 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2430000000000005e-06 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598598+0000", 2024-04-19T03:38:39.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3820000000000001e-06 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598645+0000", 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7289000000000001e-05 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598743+0000", 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7757999999999995e-05 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120254 4.3 4:c222b65c:::100000001f8.00000021:head [write 126976~4096 in=4096b,write 139264~4096 in=4096b,write 413696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.598944+0000", 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0044219150000000002, 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048630440000000004, 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120254 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598944+0000", 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598944+0000", 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598943+0000", 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598957+0000", 2024-04-19T03:38:39.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3672999999999999e-05 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598967+0000", 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0198e-05 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.598975+0000", 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8660000000000006e-06 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.599018+0000", 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3223999999999998e-05 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.599103+0000", 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5143999999999997e-05 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120255 4.13 4:caef1406:::100000001f8.00000031:head [write 2707456~4096 in=4096b,write 2850816~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.600168+0000", 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.003198532, 2024-04-19T03:38:39.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038198609999999999, 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120255 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600168+0000", 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600168+0000", 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600167+0000", 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600182+0000", 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5472e-05 2024-04-19T03:38:39.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600195+0000", 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3013999999999999e-05 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600205+0000", 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0047999999999999e-05 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600425+0000", 2024-04-19T03:38:39.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00022019800000000001 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600536+0000", 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110994 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120256 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 2568192~4096 in=4096b,write 2625536~4096 in=4096b,write 2736128~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.600214+0000", 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0031521959999999999, 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038410300000000001, 2024-04-19T03:38:39.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120256 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600214+0000", 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600214+0000", 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600213+0000", 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600229+0000", 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5372000000000001e-05 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600237+0000", 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3329999999999997e-06 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600245+0000", 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7810000000000005e-06 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600997+0000", 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00075225200000000002 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.601098+0000", 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101569 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:120258 4.2d e67/14 4:b7099a35:::100000001f8.0000000e:head v 67'3781, mlcod=67'3779)", 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.600657+0000", 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.002708958, 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034669980000000002, 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.635 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600657+0000", 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600657+0000", 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600656+0000", 2024-04-19T03:38:39.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600671+0000", 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4916000000000001e-05 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600681+0000", 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8660000000000001e-06 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600689+0000", 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4909999999999999e-06 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600922+0000", 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023314899999999999 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600945+0000", 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2920000000000001e-05 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.638 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120259 4.19 4:997b7129:::100000001f8.00000000:head [write 2772992~4096 in=4096b,write 2940928~4096 in=4096b,write 2990080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.600899+0000", 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0024672650000000002, 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003265034, 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120259 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.639 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600899+0000", 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600899+0000", 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600898+0000", 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600912+0000", 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3518e-05 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600923+0000", 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1048e-05 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600931+0000", 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8820000000000007e-06 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.601071+0000", 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000139627 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.601151+0000", 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9699999999999999e-05 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.601357+0000", 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00020621300000000001 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120260 4.2a 4:57147dc3:::100000001f8.00000011:head [write 1118208~4096 in=4096b,write 1232896~4096 in=4096b,write 1372160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.600946+0000", 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0024202820000000002, 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032634249999999999, 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.643 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120260 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600946+0000", 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600946+0000", 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600945+0000", 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600956+0000", 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0382e-05 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600964+0000", 2024-04-19T03:38:39.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5189999999999992e-06 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.600971+0000", 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6200000000000001e-06 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.601097+0000", 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126592 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.601178+0000", 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0474000000000002e-05 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120230 4.6 4:63e80496:::100000001f8.0000001e:head [write 163840~4096 in=4096b,write 180224~4096 in=4096b,write 196608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.588293+0000", 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.015073161, 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.015957824999999998, 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:39.647 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120230 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.588293+0000", 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.588293+0000", 2024-04-19T03:38:39.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.588292+0000", 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.588308+0000", 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5477000000000001e-05 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.588318+0000", 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0570999999999999e-05 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.588326+0000", 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4900000000000003e-06 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.595947+0000", 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076215800000000002 2024-04-19T03:38:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.596037+0000", 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9734000000000005e-05 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.596244+0000", 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000206496 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.601223+0000", 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0049789930000000001 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.651 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120261 4.22 4:47e99c31:::100000001f8.00000025:head [write 86016~8192 in=8192b,write 122880~4096 in=4096b,write 356352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.602896+0000", 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00047025600000000001, 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001442378, 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120261 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.652 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602896+0000", 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602896+0000", 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602895+0000", 2024-04-19T03:38:39.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602914+0000", 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9324999999999999e-05 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602925+0000", 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0593e-05 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602933+0000", 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4649999999999994e-06 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602980+0000", 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7416999999999997e-05 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603080+0000", 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9443000000000003e-05 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120262 4.15 4:aada5e43:::100000001f8.00000028:head [write 4050944~4096 in=4096b,write 4120576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.602947+0000", 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00041932299999999998, 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014857130000000001, 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120262 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602947+0000", 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602947+0000", 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602946+0000", 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:39.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602958+0000", 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1956e-05 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602966+0000", 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2309999999999996e-06 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.602973+0000", 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8210000000000004e-06 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603595+0000", 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062140299999999997 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603684+0000", 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9118999999999998e-05 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603833+0000", 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000149653 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:120263 4.37 e67/14 4:ecbf0fb2:::100000001f8.00000038:head v 67'5666, mlcod=67'5664)", 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.603034+0000", 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.000331632, 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014852750000000001, 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.660 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603034+0000", 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603034+0000", 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603034+0000", 2024-04-19T03:38:39.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603049+0000", 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5139e-05 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603058+0000", 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1870000000000003e-06 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603065+0000", 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603131+0000", 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5542000000000004e-05 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603151+0000", 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0551e-05 2024-04-19T03:38:39.663 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop_reply(client.4526.0:120230 4.6 e67/14)", 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.603080+0000", 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00028621899999999999, 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015164270000000001, 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603080+0000", 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603080+0000", 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603079+0000", 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:39.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603083+0000", 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0879999999999999e-06 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603089+0000", 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.798e-06 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603094+0000", 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1359999999999996e-06 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120264 4.28 4:153ae410:::100000001f8.0000003b:head [write 2846720~4096 in=4096b,write 2924544~4096 in=4096b,write 3096576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.603523+0000", 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9998426, 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011398770000000001, 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:39.667 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120264 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603523+0000", 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603523+0000", 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603522+0000", 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603539+0000", 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6778000000000001e-05 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603550+0000", 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603558+0000", 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7970000000000001e-06 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603805+0000", 2024-04-19T03:38:39.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024737799999999998 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.603864+0000", 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8869000000000002e-05 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.604030+0000", 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000166255 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.671 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:120265 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:39.604032+0000", 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4294967295.9993343, 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072554599999999998, 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 120265 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.604032+0000", 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.604032+0000", 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.604031+0000", 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.604045+0000", 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4564e-05 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.604056+0000", 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:39.604064+0000", 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0830000000000004e-06 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.674 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:39.675 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 17 2024-04-19T03:38:39.675 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:39.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:39.717 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:39.717+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:39.790 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:39.790+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:39.891 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:39.890+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:39.925 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:39.925 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:39.925 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:39.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:39.992 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:39.991+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:40.092 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:40.092+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:40.193 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:40.192+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:40.209 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.962724793, 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.210 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:40.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:40.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:40.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.960104172000001, 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:40.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:40.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.957660750999999, 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.221 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:40.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:40.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.956893105999999, 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.227 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:40.232 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.946300902000001, 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:40.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:40.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:40.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.943599778999999, 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.238 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:40.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:40.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:40.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:40.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:40.244 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.244 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.244 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.244 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:40.244 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:40.244 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.075504249000002, 2024-04-19T03:38:40.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4:fde182c5:::100000001f8.00000039:head [write 57344~4096,write 999424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.569054629, 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100832459, 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726148+0000", 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089264587000000006 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726232+0000", 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4432999999999996e-05 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726387+0000", 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015492899999999999 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.730073+0000", 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036859179999999998 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737597+0000", 2024-04-19T03:38:40.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075243239999999998 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737645+0000", 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7920999999999997e-05 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737683+0000", 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7849999999999998e-05 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110110 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2383872~4096,write 2453504~4096,write 2482176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2243736890000001, 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093470530999999996, 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110110 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.257 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981530+0000", 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:40.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981548+0000", 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.827e-05 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981562+0000", 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3745e-05 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981572+0000", 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9210000000000004e-06 2024-04-19T03:38:40.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045614+0000", 2024-04-19T03:38:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064041782000000005 2024-04-19T03:38:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045699+0000", 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4690000000000004e-05 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045898+0000", 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019934600000000001 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054237+0000", 2024-04-19T03:38:40.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083394360000000004 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074935+0000", 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020697898999999999 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074966+0000", 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0806999999999998e-05 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075002+0000", 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5879e-05 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110111 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2441216~4096,write 2551808~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2243220839999998, 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093517948000000004, 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.263 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110111 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981582+0000", 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981596+0000", 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3873000000000001e-05 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981604+0000", 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8420000000000005e-06 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981611+0000", 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0879999999999997e-06 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053316+0000", 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071704618999999997 2024-04-19T03:38:40.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053403+0000", 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6757999999999998e-05 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053574+0000", 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017118400000000001 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.057921+0000", 2024-04-19T03:38:40.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043469090000000004 2024-04-19T03:38:40.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075014+0000", 2024-04-19T03:38:40.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017093168999999998 2024-04-19T03:38:40.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075063+0000", 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9208e-05 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075101+0000", 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7808999999999997e-05 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110132 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2691072~4096,write 2813952~4096,write 2932736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.269 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2181982250000001, 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093537876000000006, 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110132 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987706+0000", 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987718+0000", 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987729+0000", 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1590000000000001e-05 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987738+0000", 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4780000000000008e-06 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054265+0000", 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066526945000000004 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054370+0000", 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105499 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054556+0000", 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185761 2024-04-19T03:38:40.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058085+0000", 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003529089 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081142+0000", 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023057281999999998 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081197+0000", 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4978000000000001e-05 2024-04-19T03:38:40.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081245+0000", 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7345999999999997e-05 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110152 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1605632~4096,write 1675264~4096,write 1921024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2108454440000003, 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.094148551999999996, 2024-04-19T03:38:40.275 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110152 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995059+0000", 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995075+0000", 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6583e-05 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995086+0000", 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995108+0000", 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1087999999999999e-05 2024-04-19T03:38:40.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058217+0000", 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.063109928999999995 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058309+0000", 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1687999999999994e-05 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058434+0000", 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012497800000000001 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.068998+0000", 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010564053 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089103+0000", 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020104899999999998 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089158+0000", 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4880000000000003e-05 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089208+0000", 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0241000000000002e-05 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110160 4.27 4:e68799fb:::100000001f8.00000018:head [write 2277376~4096,write 2322432~4096,write 2445312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:40.281 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2083694610000002, 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.10998324299999999, 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110160 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:40.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997535+0000", 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997549+0000", 2024-04-19T03:38:40.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4514e-05 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997561+0000", 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1701e-05 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997569+0000", 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7610000000000007e-06 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095749+0000", 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.098180607000000003 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095831+0000", 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1689999999999999e-05 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107325+0000", 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011493512000000001 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107444+0000", 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011904 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107519+0000", 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5278999999999995e-05 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.286 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110172 4.36 4:6fa85f86:::100000001f8.00000013:head [write 663552~4096,write 688128~4096,write 921600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2014681039999999, 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084877683999999995, 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110172 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004436+0000", 2024-04-19T03:38:40.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004456+0000", 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0098999999999998e-05 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004470+0000", 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4117999999999999e-05 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004480+0000", 2024-04-19T03:38:40.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9809999999999998e-06 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063606+0000", 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059126074000000001 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063696+0000", 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0105999999999994e-05 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063813+0000", 2024-04-19T03:38:40.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116574 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075044+0000", 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011231507999999999 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089219+0000", 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014175304999999999 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089265+0000", 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5853999999999998e-05 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089315+0000", 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9366999999999997e-05 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110174 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3280896~4096,write 3293184~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2013786040000003, 2024-04-19T03:38:40.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084998899000000003, 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110174 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004539+0000", 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3473e-05 2024-04-19T03:38:40.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004550+0000", 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0438999999999999e-05 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004558+0000", 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0139999999999998e-06 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069043+0000", 2024-04-19T03:38:40.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064484737 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069127+0000", 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3905000000000004e-05 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069337+0000", 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000210471 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081133+0000", 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011795684000000001 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089438+0000", 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083048649999999998 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089484+0000", 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6832999999999997e-05 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089525+0000", 2024-04-19T03:38:40.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1026000000000003e-05 2024-04-19T03:38:40.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.298 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.298 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110212 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3047424~8192,write 3063808~4096,write 3076096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.298 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:40.299 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1880148549999996, 2024-04-19T03:38:40.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093266469000000005, 2024-04-19T03:38:40.299 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.299 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.299 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.299 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.299 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110212 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:40.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017889+0000", 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017905+0000", 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5617e-05 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017915+0000", 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0215e-05 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017923+0000", 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6990000000000003e-06 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097726+0000", 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079803221999999993 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097839+0000", 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112575 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.098019+0000", 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180392 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111092+0000", 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013072587 2024-04-19T03:38:40.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111104+0000", 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.236e-05 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111134+0000", 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9513999999999999e-05 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111157+0000", 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3156999999999999e-05 2024-04-19T03:38:40.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110221 4.36 4:6da220e6:::100000001f8.0000003f:head [write 4096~4096,write 24576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1843474010000001, 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084587624, 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110221 2024-04-19T03:38:40.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021557+0000", 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021581+0000", 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4346999999999999e-05 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021594+0000", 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2602999999999999e-05 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021602+0000", 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078747+0000", 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.057145174999999999 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078838+0000", 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0402999999999995e-05 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078969+0000", 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013092900000000001 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084690+0000", 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057209870000000003 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106035+0000", 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021345425000000001 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106092+0000", 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6842999999999998e-05 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106145+0000", 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3536999999999999e-05 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110231 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2793472~4096,write 2838528~4096,write 3112960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1801012389999999, 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083514087000000001, 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110231 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025803+0000", 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025813+0000", 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6220000000000004e-06 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025820+0000", 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5509999999999996e-06 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025825+0000", 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3029999999999999e-06 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084726+0000", 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058900606000000001 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084812+0000", 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6182999999999998e-05 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084984+0000", 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017231700000000001 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089351+0000", 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043671459999999997 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109218+0000", 2024-04-19T03:38:40.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019866681000000001 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109263+0000", 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5621000000000002e-05 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109318+0000", 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4435999999999999e-05 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110234 4.6 4:616d4c41:::100000001f8.00000034:head [write 3207168~8192,write 3223552~4096,write 3342336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1787476760000004, 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085527898000000005, 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110234 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027172+0000", 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5939000000000001e-05 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027184+0000", 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1139e-05 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027191+0000", 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:38:40.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089455+0000", 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.062263753999999998 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089534+0000", 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8744000000000004e-05 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089690+0000", 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156203 2024-04-19T03:38:40.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102714+0000", 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013023798 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112600+0000", 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0098863189999999993 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112649+0000", 2024-04-19T03:38:40.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8986000000000002e-05 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112685+0000", 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6251000000000002e-05 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110414 4.36 4:6fa85f86:::100000001f8.00000013:head [write 348160~4096,write 409600~4096,write 438272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1029068940000002, 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085383260000000002, 2024-04-19T03:38:40.322 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110414 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102997+0000", 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103011+0000", 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4224e-05 2024-04-19T03:38:40.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103023+0000", 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2024e-05 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103032+0000", 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6049999999999998e-06 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164051+0000", 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.06101939 2024-04-19T03:38:40.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164139+0000", 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7497999999999995e-05 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164269+0000", 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013044700000000001 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.177794+0000", 2024-04-19T03:38:40.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013525099 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188243+0000", 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010448834000000001 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188329+0000", 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6120999999999998e-05 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:40.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188381+0000", 2024-04-19T03:38:40.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2030000000000002e-05 2024-04-19T03:38:40.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.328 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:40.328 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:40.328 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:40.330 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:40.330 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:40.329+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:40.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:38:40.429 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:40.429+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:40.509 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:40.509 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:40.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.509 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122129 4.38 4:1fc350da:::100000001f8.0000002f:head [write 3825664~4096 in=4096b,write 3948544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.509 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.497407+0000", 2024-04-19T03:38:40.509 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.007784371, 2024-04-19T03:38:40.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0078156960000000004, 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122129 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497407+0000", 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497407+0000", 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497406+0000", 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497417+0000", 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.145e-05 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497427+0000", 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4669999999999993e-06 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497434+0000", 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9580000000000001e-06 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497468+0000", 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3844999999999999e-05 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497546+0000", 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8171999999999996e-05 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122132 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1814528~4096 in=4096b,write 1863680~4096 in=4096b,write 1904640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.497638+0000", 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0075537360000000001, 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0076750229999999996, 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122132 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497638+0000", 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497638+0000", 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497637+0000", 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497650+0000", 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.327e-05 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497660+0000", 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.026e-05 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497668+0000", 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.627e-06 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497711+0000", 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3497e-05 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497784+0000", 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2193000000000005e-05 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122133 4.35 4:af28909f:::100000001f8.0000001b:head [write 3219456~4096 in=4096b,write 3690496~4096 in=4096b,write 3817472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.497953+0000", 2024-04-19T03:38:40.517 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0072379050000000002, 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007466945, 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122133 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497953+0000", 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497953+0000", 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497953+0000", 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497965+0000", 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2612999999999999e-05 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497980+0000", 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5122e-05 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.497987+0000", 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.759e-06 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.498407+0000", 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00042021000000000002 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.498497+0000", 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9258999999999994e-05 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122134 4.38 4:1d13bf87:::100000001f8.00000030:head [write 172032~4096 in=4096b,write 180224~4096 in=4096b,write 217088~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.498367+0000", 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0068246740000000002, 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0071261170000000004, 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.521 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122134 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.498367+0000", 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.498367+0000", 2024-04-19T03:38:40.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.498366+0000", 2024-04-19T03:38:40.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.498380+0000", 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4216000000000001e-05 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.498389+0000", 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.5569999999999996e-06 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.498396+0000", 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8510000000000001e-06 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502271+0000", 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0038750809999999998 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502345+0000", 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3943000000000007e-05 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:122131 4.28 e67/14 4:15eeb89b:::100000001f8.00000032:head v 67'3812, mlcod=67'3809)", 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.499830+0000", 2024-04-19T03:38:40.525 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0053610209999999997, 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057270639999999996, 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499830+0000", 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.526 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499830+0000", 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499830+0000", 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499845+0000", 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5620999999999998e-05 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499854+0000", 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6840000000000002e-06 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499860+0000", 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2990000000000002e-06 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502258+0000", 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0023973610000000002 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502276+0000", 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8505e-05 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:122121 4.36 e67/14 4:6c9c34b1:::100000001f8.00000010:head v 67'5731, mlcod=67'5728)", 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.499869+0000", 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0053221839999999998, 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057466599999999998, 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499869+0000", 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499869+0000", 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499869+0000", 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499885+0000", 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.641e-05 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499895+0000", 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4080000000000004e-06 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499900+0000", 2024-04-19T03:38:40.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499961+0000", 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1336999999999999e-05 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499983+0000", 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1882000000000002e-05 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.533 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:122136 4.6 e67/14 4:616d4c41:::100000001f8.00000034:head v 67'7570, mlcod=67'7566)", 2024-04-19T03:38:40.533 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.499911+0000", 2024-04-19T03:38:40.533 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0052806759999999998, 2024-04-19T03:38:40.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.005763766, 2024-04-19T03:38:40.533 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.533 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.533 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499911+0000", 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499911+0000", 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499910+0000", 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499923+0000", 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2864000000000001e-05 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499930+0000", 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9539999999999998e-06 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499935+0000", 2024-04-19T03:38:40.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8770000000000001e-06 2024-04-19T03:38:40.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.536 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.536 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.499997+0000", 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1503999999999999e-05 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.500015+0000", 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8695e-05 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122139 4.38 4:1dcf718c:::100000001f8.00000022:head [write 1736704~4096 in=4096b,write 1835008~4096 in=4096b,write 1867776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.500017+0000", 2024-04-19T03:38:40.537 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0051743520000000001, 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0057214900000000001, 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122139 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.500017+0000", 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.500017+0000", 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.500016+0000", 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.500037+0000", 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0936000000000001e-05 2024-04-19T03:38:40.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.500046+0000", 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6950000000000006e-06 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.500053+0000", 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0740000000000004e-06 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504801+0000", 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004747963 2024-04-19T03:38:40.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504884+0000", 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2522999999999996e-05 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122142 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 3821568~4096 in=4096b,write 3878912~4096 in=4096b,write 4153344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.501101+0000", 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0040906359999999999, 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004718089, 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.541 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122142 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501101+0000", 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501101+0000", 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501100+0000", 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501111+0000", 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1499e-05 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501122+0000", 2024-04-19T03:38:40.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0567000000000001e-05 2024-04-19T03:38:40.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501128+0000", 2024-04-19T03:38:40.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.241e-06 2024-04-19T03:38:40.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502528+0000", 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0013998599999999999 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502608+0000", 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9837000000000001e-05 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122144 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 2269184~8192 in=8192b,write 2658304~4096 in=4096b,write 2711552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.545 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.501785+0000", 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0034059419999999999, 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0041046959999999997, 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122144 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501785+0000", 2024-04-19T03:38:40.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501785+0000", 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501785+0000", 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501816+0000", 2024-04-19T03:38:40.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1776000000000002e-05 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501827+0000", 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0402e-05 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.501834+0000", 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.182e-06 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504551+0000", 2024-04-19T03:38:40.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002716694 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504623+0000", 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2483000000000004e-05 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:122140 4.36 e67/14 4:6c9c34b1:::100000001f8.00000010:head v 67'5732, mlcod=67'5728)", 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.502398+0000", 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0027935759999999999, 2024-04-19T03:38:40.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035627110000000001, 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502398+0000", 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502398+0000", 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502397+0000", 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502413+0000", 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5815999999999999e-05 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502422+0000", 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6039999999999993e-06 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502428+0000", 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5459999999999997e-06 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502627+0000", 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00019933400000000001 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502647+0000", 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9361e-05 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122146 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.502509+0000", 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0026823200000000002, 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0035080200000000001, 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122146 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502509+0000", 2024-04-19T03:38:40.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502509+0000", 2024-04-19T03:38:40.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502508+0000", 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502546+0000", 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7459999999999997e-05 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502554+0000", 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7509999999999997e-06 2024-04-19T03:38:40.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.502562+0000", 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8809999999999996e-06 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122149 4.30 4.88c79130 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.503827+0000", 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0013645230000000001, 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0022424329999999998, 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.556 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122149 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.503827+0000", 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.503827+0000", 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.503826+0000", 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.503840+0000", 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3658999999999999e-05 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.503848+0000", 2024-04-19T03:38:40.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6340000000000007e-06 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.503855+0000", 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8940000000000004e-06 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122151 4.23 4:c6f90462:::100000001f8.00000037:head [write 319488~4096 in=4096b,write 647168~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.504471+0000", 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.000720438, 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0016557779999999999, 2024-04-19T03:38:40.559 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122151 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504471+0000", 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504471+0000", 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504470+0000", 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504481+0000", 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0688e-05 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504488+0000", 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504493+0000", 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8709999999999996e-06 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504533+0000", 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9509999999999999e-05 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504613+0000", 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0197999999999993e-05 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504761+0000", 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014822300000000001 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122153 4.12 4:48ab9bde:::100000001f8.00000015:head [write 1228800~4096 in=4096b,write 1236992~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.504973+0000", 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.00021871400000000001, 2024-04-19T03:38:40.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012306699999999999, 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122153 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504973+0000", 2024-04-19T03:38:40.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504973+0000", 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504972+0000", 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504984+0000", 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2673e-05 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.504996+0000", 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2057e-05 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505004+0000", 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9969999999999998e-06 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505049+0000", 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4808000000000002e-05 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505126+0000", 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.6264e-05 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505258+0000", 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013263199999999999 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.567 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:122152 4.14 e67/14 4:2b28d75f:::100000001f8.00000016:head v 67'1874, mlcod=67'1872)", 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.505109+0000", 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 8.2179e-05, 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001175284, 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505109+0000", 2024-04-19T03:38:40.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505109+0000", 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505109+0000", 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.569 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505121+0000", 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2636999999999999e-05 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505130+0000", 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2469999999999997e-06 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505137+0000", 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.6630000000000004e-06 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505186+0000", 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8387000000000003e-05 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.505204+0000", 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8437e-05 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:122117 4.36 e67/14 4:6c9c34b1:::100000001f8.00000010:head v 67'5730, mlcod=67'5728)", 2024-04-19T03:38:40.571 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.494235+0000", 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010956456, 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01211375, 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494235+0000", 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494235+0000", 2024-04-19T03:38:40.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494235+0000", 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494252+0000", 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7119e-05 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494259+0000", 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2429999999999999e-06 2024-04-19T03:38:40.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494264+0000", 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5369999999999999e-06 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494296+0000", 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2261000000000002e-05 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494315+0000", 2024-04-19T03:38:40.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9406e-05 2024-04-19T03:38:40.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.575 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.575 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:122119 4.6 e67/14 4:62d56fc8:::100000001f8.0000001c:head v 67'7569, mlcod=67'7565)", 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.494792+0000", 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.010399116, 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011619856, 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494792+0000", 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.576 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494792+0000", 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494792+0000", 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494805+0000", 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3621000000000001e-05 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.577 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494814+0000", 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4570000000000005e-06 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494820+0000", 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9880000000000001e-06 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494841+0000", 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1350000000000001e-05 2024-04-19T03:38:40.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494853+0000", 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2231e-05 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:122122 4.28 e67/14 4:153ae410:::100000001f8.0000003b:head v 67'3811, mlcod=67'3809)", 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.494827+0000", 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.01036456, 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011648245, 2024-04-19T03:38:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494827+0000", 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494827+0000", 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.580 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494826+0000", 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494840+0000", 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3740999999999999e-05 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494846+0000", 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9739999999999999e-06 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.581 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494851+0000", 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8339999999999998e-06 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494883+0000", 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2258999999999997e-05 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.494901+0000", 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.7716000000000001e-05 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.582 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122125 4.30 4:0c89e311:::100000001f8.00000017:head [write 798720~4096 in=4096b,write 811008~4096 in=4096b,write 860160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.495320+0000", 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0098714890000000007, 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011227546, 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.583 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122125 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495320+0000", 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495320+0000", 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.584 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495319+0000", 2024-04-19T03:38:40.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:40.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.585 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.585 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.585 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495332+0000", 2024-04-19T03:38:40.585 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2605e-05 2024-04-19T03:38:40.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495341+0000", 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.7759999999999992e-06 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495348+0000", 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9630000000000001e-06 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495455+0000", 2024-04-19T03:38:40.586 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010695400000000001 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495549+0000", 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3589000000000001e-05 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122127 4.35 4:af28909f:::100000001f8.0000001b:head [write 3481600~4096 in=4096b,write 3534848~4096 in=4096b,write 3624960~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:40.587 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.495975+0000", 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.0092163230000000002, 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01068035, 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122127 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495975+0000", 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495975+0000", 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495974+0000", 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.589 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.495990+0000", 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5444999999999999e-05 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.496000+0000", 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0362e-05 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.496007+0000", 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.1149999999999996e-06 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.590 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.496055+0000", 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.778e-05 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.496163+0000", 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010755999999999999 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 21 2024-04-19T03:38:40.591 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:40.593 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:40.593 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:40.592+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:40.693 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:40.693+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:40.795 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:40.794+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:40.833 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:40.833 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:40.833 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:40.833 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:40.833 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:40.847 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:40.898 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:40.897+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:41.001 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:40.997+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:41.085 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.847016622000002, 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.086 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:41.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.845861288000002, 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.091 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:41.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:41.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.096 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.844430392, 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.097 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.098 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.098 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:41.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.098 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:41.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:41.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:41.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:41.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.843567424, 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.843134232000001, 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.841686195000001, 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:41.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:41.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:41.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:41.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:41.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:41.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.841011024, 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.121 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.124 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.125 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:41.125 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:41.125 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.839520453999999, 2024-04-19T03:38:41.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:41.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.126 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.126 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:41.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:41.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:41.130 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:41.131 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.839118345999999, 2024-04-19T03:38:41.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:41.131 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.131 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.131 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.131 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:41.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:41.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.135 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:41.136 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:41.136 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.839074971999999, 2024-04-19T03:38:41.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:41.136 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:41.140 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.839043057000001, 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:41.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:41.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.837601758000002, 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:41.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:41.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:41.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.837346319000002, 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.153 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.836653378000001, 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.155 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:41.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:41.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:41.159 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.99991511, 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.160 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.161 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:41.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:41.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:41.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.165 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.999221265999999, 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.166 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.167 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.168 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.169 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.170 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.998818965000002, 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.171 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.172 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.173 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:41.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:41.176 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.996215111000001, 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.177 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.178 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.179 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.180 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:41.182 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.995856406000001, 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:41.183 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:41.184 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:41.185 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.186 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122534 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1925120~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 0.41872229700000002, 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.084175462000000006, 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:41.188 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122534 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660781+0000", 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660793+0000", 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1924e-05 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660802+0000", 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.346e-06 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660809+0000", 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.866e-06 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688450+0000", 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027640688 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688513+0000", 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2966000000000007e-05 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688602+0000", 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9671000000000003e-05 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.698279+0000", 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096766579999999994 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744874+0000", 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.046594407999999997 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744917+0000", 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3127999999999998e-05 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744957+0000", 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0568000000000002e-05 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:41.193 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:41.195 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:41.194+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:41.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:41.297 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:41.297+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:41.397 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:38:41.401 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:41.396+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124169 4.3 4:c222b65c:::100000001f8.00000021:head [write 36864~4096 in=4096b,write 270336~4096 in=4096b,write 397312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.399991+0000", 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.015997730000000002, 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016029649999999999, 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.421 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124169 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.399991+0000", 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.399991+0000", 2024-04-19T03:38:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.399990+0000", 2024-04-19T03:38:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400005+0000", 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4983e-05 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400016+0000", 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1674999999999999e-05 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400025+0000", 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5199999999999997e-06 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400585+0000", 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055986999999999996 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400660+0000", 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5531999999999994e-05 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.425 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124204 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.412409+0000", 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0035789049999999998, 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037063159999999999, 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124204 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412409+0000", 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412409+0000", 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412408+0000", 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412424+0000", 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5214e-05 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412438+0000", 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4205999999999999e-05 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412446+0000", 2024-04-19T03:38:41.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0260000000000007e-06 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124170 4.28 4:153ae410:::100000001f8.0000003b:head [write 569344~4096 in=4096b,write 741376~4096 in=4096b,write 765952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.400033+0000", 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.015955092000000001, 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.016159397999999998, 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.429 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124170 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400033+0000", 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400033+0000", 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400033+0000", 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400046+0000", 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3329000000000001e-05 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400054+0000", 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.157e-06 2024-04-19T03:38:41.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400060+0000", 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1970000000000001e-06 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400101+0000", 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0738999999999997e-05 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400179+0000", 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8368000000000006e-05 2024-04-19T03:38:41.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.400346+0000", 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016672200000000001 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412009+0000", 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011662598 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.433 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124205 4.32 4:4f726a0c:::100000001f8.00000012:head [write 593920~4096 in=4096b,write 671744~4096 in=4096b,write 860160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.412763+0000", 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0032249420000000002, 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035322880000000002, 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124205 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412763+0000", 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412763+0000", 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412763+0000", 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412775+0000", 2024-04-19T03:38:41.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2923e-05 2024-04-19T03:38:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412796+0000", 2024-04-19T03:38:41.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0322e-05 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412803+0000", 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7150000000000001e-06 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412910+0000", 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010736800000000001 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412983+0000", 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3344999999999997e-05 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124176 4.19 4:997b7129:::100000001f8.00000000:head [write 1413120~4096 in=4096b,write 1519616~4096 in=4096b,write 1536000~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.401915+0000", 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.014073044, 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014460044999999999, 2024-04-19T03:38:41.439 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124176 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.401915+0000", 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.401915+0000", 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.401914+0000", 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.401929+0000", 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5024999999999999e-05 2024-04-19T03:38:41.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.401940+0000", 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1005999999999999e-05 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.401949+0000", 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6279999999999994e-06 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402001+0000", 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2389999999999998e-05 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402088+0000", 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6688999999999996e-05 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402258+0000", 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000170392 2024-04-19T03:38:41.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414517+0000", 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012258118 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124206 4.6 4:616d4c41:::100000001f8.00000034:head [write 3940352~4096 in=4096b,write 4050944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.413310+0000", 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0026784790000000001, 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031576339999999999, 2024-04-19T03:38:41.444 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124206 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413310+0000", 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413310+0000", 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413309+0000", 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413322+0000", 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2969999999999999e-05 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413334+0000", 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2177999999999999e-05 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413342+0000", 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3550000000000005e-06 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.416366+0000", 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030241140000000001 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.416443+0000", 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6285000000000006e-05 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:124168 4.37 e68/14 4:ecbf0fb2:::100000001f8.00000038:head v 68'5847, mlcod=67'5845)", 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.402028+0000", 2024-04-19T03:38:41.448 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.013960701000000001, 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014513938000000001, 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402028+0000", 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402028+0000", 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402027+0000", 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402048+0000", 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1208000000000001e-05 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402059+0000", 2024-04-19T03:38:41.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0747000000000001e-05 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402066+0000", 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5839999999999997e-06 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402102+0000", 2024-04-19T03:38:41.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6103000000000003e-05 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402124+0000", 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1188000000000001e-05 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124208 4.3d 4.b9df5cbd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.414013+0000", 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0019755609999999998, 2024-04-19T03:38:41.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025991260000000002, 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "queued for pg", 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124208 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414013+0000", 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414013+0000", 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414012+0000", 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414029+0000", 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6898e-05 2024-04-19T03:38:41.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414041+0000", 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2043e-05 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414050+0000", 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0999999999999993e-06 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:124202 4.12 e68/14 4:48ab9bde:::100000001f8.00000015:head v 68'3922, mlcod=67'3917)", 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.414872+0000", 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.001116749, 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018017090000000001, 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414872+0000", 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414872+0000", 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414871+0000", 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414893+0000", 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2433e-05 2024-04-19T03:38:41.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414906+0000", 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2676e-05 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414913+0000", 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4070000000000004e-06 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415997+0000", 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010840590000000001 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.416016+0000", 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9020000000000001e-05 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124210 4.19 4:997b7129:::100000001f8.00000000:head [write 741376~8192 in=8192b,write 753664~4096 in=4096b,write 815104~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.459 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.415665+0000", 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00032289900000000003, 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010964620000000001, 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124210 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415665+0000", 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415665+0000", 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415664+0000", 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415681+0000", 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7167999999999999e-05 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415696+0000", 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4127e-05 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415705+0000", 2024-04-19T03:38:41.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.935e-06 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415752+0000", 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7531999999999998e-05 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415855+0000", 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010306099999999999 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.416033+0000", 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017751900000000001 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:124171 4.2d e68/14 4:b4aa06e9:::100000001f8.0000001d:head v 68'3898, mlcod=67'3896)", 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.402122+0000", 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.013866428, 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014731175000000001, 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.464 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402122+0000", 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402122+0000", 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402122+0000", 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402136+0000", 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4154e-05 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402144+0000", 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5089999999999993e-06 2024-04-19T03:38:41.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402150+0000", 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6779999999999997e-06 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402185+0000", 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5528000000000003e-05 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402205+0000", 2024-04-19T03:38:41.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9239999999999999e-05 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124212 4.22 4:47e99c31:::100000001f8.00000025:head [write 2834432~4096 in=4096b,write 2871296~4096 in=4096b,write 2936832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.415723+0000", 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.00026554699999999998, 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011990309999999999, 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.468 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124212 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415723+0000", 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415723+0000", 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415722+0000", 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415735+0000", 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2703e-05 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415746+0000", 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.113e-05 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415753+0000", 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7190000000000004e-06 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415991+0000", 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000238781 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.416082+0000", 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0519999999999994e-05 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124178 4.1c 4:39b842ef:::100000001f8.00000029:head [write 3080192~4096 in=4096b,write 3153920~4096 in=4096b,write 3170304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.402692+0000", 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.013296304, 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014302634, 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.472 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124178 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402692+0000", 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402692+0000", 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402691+0000", 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402706+0000", 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5376e-05 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402720+0000", 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3371e-05 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402728+0000", 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1329999999999999e-06 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402779+0000", 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1533999999999998e-05 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402849+0000", 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9434e-05 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402940+0000", 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1539000000000006e-05 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.414434+0000", 2024-04-19T03:38:41.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011493292 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124180 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096 in=4096b,write 409600~4096 in=4096b,write 430080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.403407+0000", 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.012581349, 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013672406999999999, 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.477 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124180 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.403407+0000", 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.403407+0000", 2024-04-19T03:38:41.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.403406+0000", 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.403420+0000", 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4165000000000001e-05 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.403431+0000", 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0434e-05 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.403438+0000", 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3950000000000003e-06 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.403553+0000", 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114493 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.403639+0000", 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6193000000000006e-05 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.403816+0000", 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017736 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413412+0000", 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0095955480000000006 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.481 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:124177 4.12 e68/14 4:48ab9bde:::100000001f8.00000015:head v 68'3920, mlcod=67'3917)", 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.405305+0000", 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.010683587, 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011859665, 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405305+0000", 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405305+0000", 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405304+0000", 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405322+0000", 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7920000000000001e-05 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405334+0000", 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2302e-05 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405341+0000", 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0829999999999998e-06 2024-04-19T03:38:41.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405385+0000", 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3838000000000003e-05 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405409+0000", 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3917000000000002e-05 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124181 4.13 4:cbf33e86:::100000001f8.00000026:head [write 4005888~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.405392+0000", 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.010596599999999999, 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011838293, 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124181 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.486 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405392+0000", 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405392+0000", 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405391+0000", 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405403+0000", 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1975e-05 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405413+0000", 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0372e-05 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405420+0000", 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.956e-06 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405455+0000", 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5061000000000002e-05 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405523+0000", 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7355999999999997e-05 2024-04-19T03:38:41.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124182 4.3 4:c222b65c:::100000001f8.00000021:head [write 3088384~4096 in=4096b,write 3117056~4096 in=4096b,write 3452928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.405431+0000", 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.010557073, 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011881853, 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124182 2024-04-19T03:38:41.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405431+0000", 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405431+0000", 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405431+0000", 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405444+0000", 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3311e-05 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405451+0000", 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9600000000000003e-06 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405456+0000", 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409195+0000", 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037386390000000002 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409271+0000", 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5574000000000005e-05 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124183 4.28 4:153ae410:::100000001f8.0000003b:head [write 1294336~4096 in=4096b,write 1335296~4096 in=4096b,write 1380352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.405462+0000", 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.010526597, 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011926874000000001, 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124183 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.494 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405462+0000", 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405462+0000", 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405461+0000", 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405472+0000", 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0641e-05 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405478+0000", 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2940000000000002e-06 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405483+0000", 2024-04-19T03:38:41.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0150000000000003e-06 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409400+0000", 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039170369999999999 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409486+0000", 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5853999999999995e-05 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409637+0000", 2024-04-19T03:38:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000151018 2024-04-19T03:38:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124184 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3489792~4096 in=4096b,write 3502080~4096 in=4096b,write 3596288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.405494+0000", 2024-04-19T03:38:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.01049463, 2024-04-19T03:38:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011975235000000001, 2024-04-19T03:38:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124184 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405494+0000", 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405494+0000", 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405493+0000", 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405504+0000", 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0738e-05 2024-04-19T03:38:41.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405510+0000", 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2480000000000001e-06 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405515+0000", 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1270000000000002e-06 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405877+0000", 2024-04-19T03:38:41.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00036128799999999997 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405960+0000", 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3343000000000005e-05 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406133+0000", 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017328600000000001 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.416337+0000", 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010203818 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124187 4.13 4:cbf33e86:::100000001f8.00000026:head [write 3600384~4096 in=4096b,write 3813376~4096 in=4096b,write 3964928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.405618+0000", 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.01037038, 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011938017, 2024-04-19T03:38:41.504 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124187 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405618+0000", 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405618+0000", 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405617+0000", 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405652+0000", 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5086999999999998e-05 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405661+0000", 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405667+0000", 2024-04-19T03:38:41.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1330000000000004e-06 2024-04-19T03:38:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409231+0000", 2024-04-19T03:38:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035644750000000001 2024-04-19T03:38:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409294+0000", 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2043000000000002e-05 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:124186 4.37 e68/14 4:ecbf0fb2:::100000001f8.00000038:head v 68'5848, mlcod=67'5845)", 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.405774+0000", 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0102145, 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011852188, 2024-04-19T03:38:41.509 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405774+0000", 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405774+0000", 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405773+0000", 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405792+0000", 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8737999999999999e-05 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405810+0000", 2024-04-19T03:38:41.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8241e-05 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.405817+0000", 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9609999999999999e-06 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413189+0000", 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073723770000000003 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413271+0000", 2024-04-19T03:38:41.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1714999999999999e-05 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124189 4.24 4:27adda6e:::100000001f8.0000000f:head [write 3670016~4096 in=4096b,write 3710976~4096 in=4096b,write 3731456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.406575+0000", 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0094132020000000007, 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011118658999999999, 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.513 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124189 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406575+0000", 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406575+0000", 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406574+0000", 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406587+0000", 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3128e-05 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406598+0000", 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0362e-05 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406604+0000", 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8680000000000004e-06 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406650+0000", 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6471000000000003e-05 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406737+0000", 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6803000000000002e-05 2024-04-19T03:38:41.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124190 4.13 4:cbf33e86:::100000001f8.00000026:head [write 610304~8192 in=8192b,write 630784~4096 in=4096b,write 712704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.406958+0000", 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0090305609999999994, 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010809941999999999, 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.517 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124190 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406958+0000", 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406958+0000", 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406957+0000", 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406972+0000", 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.506e-05 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406981+0000", 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8370000000000003e-06 2024-04-19T03:38:41.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.406986+0000", 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1569999999999999e-06 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411669+0000", 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046828590000000002 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411724+0000", 2024-04-19T03:38:41.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5436999999999998e-05 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:124192 4.2d e68/14 4:b7099a35:::100000001f8.0000000e:head v 68'3899, mlcod=67'3896)", 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.408677+0000", 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0073110019999999996, 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0091587690000000006, 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.408677+0000", 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.408677+0000", 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.408677+0000", 2024-04-19T03:38:41.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.408692+0000", 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5478e-05 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.408704+0000", 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.19e-05 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.408712+0000", 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8949999999999998e-06 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415632+0000", 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069201339999999997 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.415818+0000", 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018613599999999999 2024-04-19T03:38:41.524 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124195 4.1c 4:39b842ef:::100000001f8.00000029:head [write 831488~4096 in=4096b,write 876544~4096 in=4096b,write 1171456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.409188+0000", 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0068006280000000004, 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.008726035, 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.525 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124195 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409188+0000", 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409188+0000", 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409187+0000", 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409206+0000", 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9837999999999999e-05 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409218+0000", 2024-04-19T03:38:41.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1154e-05 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409225+0000", 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5299999999999999e-06 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.416519+0000", 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.007294226 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.416609+0000", 2024-04-19T03:38:41.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0205999999999997e-05 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.416783+0000", 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017304000000000001 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124197 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1032192~4096 in=4096b,write 1052672~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.409941+0000", 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0060473080000000004, 2024-04-19T03:38:41.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080666020000000008, 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124197 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409941+0000", 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409941+0000", 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409940+0000", 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409954+0000", 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4154999999999999e-05 2024-04-19T03:38:41.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409968+0000", 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3708e-05 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409976+0000", 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8010000000000004e-06 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413408+0000", 2024-04-19T03:38:41.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034320879999999998 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413478+0000", 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.046e-05 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413573+0000", 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4690000000000003e-05 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124162 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3723264~4096 in=4096b,write 3751936~4096 in=4096b,write 3764224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.395487+0000", 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.020501591, 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022628243999999999, 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124162 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.534 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395487+0000", 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395487+0000", 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395486+0000", 2024-04-19T03:38:41.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395501+0000", 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5150999999999999e-05 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395512+0000", 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.098e-05 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395522+0000", 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9850000000000001e-06 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.396575+0000", 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010528099999999999 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.396651+0000", 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5939000000000006e-05 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.396806+0000", 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000155408 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.402325+0000", 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055191110000000002 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124201 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 3297280~4096 in=4096b,write 3375104~4096 in=4096b,write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.538 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.411264+0000", 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0047241269999999998, 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069670180000000002, 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124201 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411264+0000", 2024-04-19T03:38:41.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411264+0000", 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411263+0000", 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411282+0000", 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8664999999999998e-05 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411299+0000", 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7014e-05 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411305+0000", 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6010000000000002e-06 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413269+0000", 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019647599999999999 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.413377+0000", 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000107574 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.542 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:124161 4.12 e68/14 4:48ab9bde:::100000001f8.00000015:head v 68'3919, mlcod=67'3917)", 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.395852+0000", 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.020136523, 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022471109, 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395852+0000", 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395852+0000", 2024-04-19T03:38:41.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395852+0000", 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395866+0000", 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4076e-05 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.396290+0000", 2024-04-19T03:38:41.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042485400000000001 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.396300+0000", 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1640000000000007e-06 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.396337+0000", 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7342999999999998e-05 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.396359+0000", 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1933000000000002e-05 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124163 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3493888~4096 in=4096b,write 3506176~4096 in=4096b,write 3665920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.395851+0000", 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.020137565999999999, 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022564661, 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124163 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395851+0000", 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395851+0000", 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395850+0000", 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.395865+0000", 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5163e-05 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398396+0000", 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002530862 2024-04-19T03:38:41.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398403+0000", 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9439999999999999e-06 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398835+0000", 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000431984 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398911+0000", 2024-04-19T03:38:41.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5698000000000006e-05 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.399076+0000", 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000165575 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409460+0000", 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010384154 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124166 4.13 4:cbf33e86:::100000001f8.00000026:head [write 1564672~4096 in=4096b,write 1683456~4096 in=4096b,write 1716224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.398448+0000", 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.017540790000000001, 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.02007049, 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124166 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398448+0000", 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398448+0000", 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398447+0000", 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398461+0000", 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4372000000000001e-05 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398468+0000", 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8959999999999997e-06 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398475+0000", 2024-04-19T03:38:41.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5089999999999999e-06 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398516+0000", 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0822999999999999e-05 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.399077+0000", 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056151300000000003 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:124196 4.23 e68/14 4:c6f90462:::100000001f8.00000037:head v 68'1939, mlcod=67'1937)", 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.411447+0000", 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0045417089999999997, 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071536100000000004, 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411447+0000", 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411447+0000", 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411446+0000", 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967296 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411459+0000", 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3089e-05 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411466+0000", 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7449999999999998e-06 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411471+0000", 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7450000000000003e-06 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411659+0000", 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000187784 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411674+0000", 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5325e-05 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:124167 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 974848~4096 in=4096b,write 1011712~4096 in=4096b,write 1028096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.398485+0000", 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.017503405, 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020199103, 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 124167 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398485+0000", 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398485+0000", 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398484+0000", 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398497+0000", 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2907e-05 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398506+0000", 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398512+0000", 2024-04-19T03:38:41.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.066e-06 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398613+0000", 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101054 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398695+0000", 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2022999999999997e-05 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:41.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.398862+0000", 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016760700000000001 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.409162+0000", 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010299971999999999 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4526.0:124199 4.12 e68/14 4:48ab9bde:::100000001f8.00000015:head v 68'3921, mlcod=67'3917)", 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:41.411475+0000", 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.0045130910000000003, 2024-04-19T03:38:41.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0073114319999999997, 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411475+0000", 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411475+0000", 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411475+0000", 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967296 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411485+0000", 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0329999999999999e-05 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411492+0000", 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7290000000000003e-06 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.411496+0000", 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1829999999999996e-06 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412928+0000", 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014319840000000001 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:41.412948+0000", 2024-04-19T03:38:41.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0111000000000001e-05 2024-04-19T03:38:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-19T03:38:41.567 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 34 2024-04-19T03:38:41.567 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:41.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:41.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:41.570 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:41.568+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:41.670 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:41.669+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:41.767 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:41.771 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:41.771+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:41.793 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:41.797 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:41.797 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:41.837 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:41.837 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:41.855 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:41.895 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:41.895+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:41.972 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:41.971+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:42.076 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:42.075+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:42.117 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:42.117 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:42.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:42.185 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:42.182+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:42.275 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:42.275+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:42.332 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:42.333 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:42.342 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:42.384 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:42.383+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:42.477 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:42.477+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:42.566 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:42.566 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:42.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:42.578 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:42.578+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:42.679 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:42.679+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:42.771 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:42.771 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:42.779 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:42.779+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:42.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:42.881 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:42.880+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:42.981 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:42.980+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:43.014 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:43.014 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:43.032 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:43.082 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:43.081+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:43.183 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:43.181+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:43.284 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:43.283+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:43.305 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:43.305 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:43.323 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:43.384 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:43.383+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:43.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:38:43.432 INFO:tasks.workunit.client.0.smithi005.stdout:setting up random write file 2024-04-19T03:38:43.432 INFO:tasks.workunit.client.0.smithi005.stdout:done setting up random write file 2024-04-19T03:38:43.432 INFO:tasks.workunit.client.0.smithi005.stdout:starting fsync run 2024-04-19T03:38:43.432 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0070s fsync time: 0.0085s 2024-04-19T03:38:43.432 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0143s 2024-04-19T03:38:43.432 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0020s fsync time: 0.0109s 2024-04-19T03:38:43.432 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0018s fsync time: 0.0115s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0016s fsync time: 0.0149s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0017s fsync time: 0.0073s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0014s fsync time: 0.0130s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0124s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0018s fsync time: 0.0123s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0014s fsync time: 0.0184s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0020s fsync time: 0.0139s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0022s fsync time: 0.0195s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0142s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0016s fsync time: 0.0174s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0085s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0014s fsync time: 0.0098s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0172s 2024-04-19T03:38:43.433 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0022s fsync time: 0.0154s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0017s fsync time: 0.0126s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0019s fsync time: 0.0138s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0018s fsync time: 0.0144s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0155s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0016s fsync time: 0.0167s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0196s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0012s fsync time: 0.0157s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0014s fsync time: 0.0105s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0135s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0019s fsync time: 0.0145s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0017s fsync time: 0.0176s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0014s fsync time: 0.0126s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0018s fsync time: 0.0114s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0013s fsync time: 0.0132s 2024-04-19T03:38:43.434 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0017s fsync time: 0.0083s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0012s fsync time: 0.0148s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0149s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0031s fsync time: 0.0149s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0012s fsync time: 0.0158s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0022s fsync time: 0.0156s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0016s fsync time: 0.0124s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0019s fsync time: 0.0233s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0014s fsync time: 0.0113s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0024s fsync time: 0.0155s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0017s fsync time: 0.0210s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0019s fsync time: 0.0163s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0020s fsync time: 0.0188s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0015s fsync time: 0.0302s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0016s fsync time: 0.0207s 2024-04-19T03:38:43.435 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0016s fsync time: 0.0107s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0018s fsync time: 0.0225s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0021s fsync time: 0.0151s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0019s fsync time: 0.0626s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0017s fsync time: 0.0504s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0018s fsync time: 0.0115s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0013s fsync time: 0.0316s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0022s fsync time: 0.0343s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0014s fsync time: 0.0231s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0014s fsync time: 0.0119s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0014s fsync time: 0.0446s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0024s fsync time: 0.0206s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0020s fsync time: 0.0157s 2024-04-19T03:38:43.436 INFO:tasks.workunit.client.0.smithi005.stdout:run done 60 fsyncs total, killing random writer 2024-04-19T03:38:43.437 INFO:tasks.workunit.client.0.smithi005.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-04-19T03:38:43.437 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-04-19T03:38:43.437 INFO:tasks.workunit.client.0.smithi005.stderr:+ whereis lsof 2024-04-19T03:38:43.444 INFO:tasks.workunit.client.0.smithi005.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-04-19T03:38:43.444 INFO:tasks.workunit.client.0.smithi005.stderr:+ lsof 2024-04-19T03:38:43.485 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:43.485+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:43.537 INFO:tasks.workunit.client.0.smithi005.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-04-19T03:38:43.537 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_gp 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_gp 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_gp 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_gp 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_par_g 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_par_g 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-04-19T03:38:43.538 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_par_g 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_par_g 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:slub_flus 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:slub_flus 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:slub_flus 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:slub_flus 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-04-19T03:38:43.539 INFO:tasks.workunit.client.0.smithi005.stdout:mm_percpu 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:mm_percpu 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:mm_percpu 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:mm_percpu 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-04-19T03:38:43.540 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_sched 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_sched 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_sched 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_sched 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:migration 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:migration 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:migration 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:migration 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/0 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-04-19T03:38:43.541 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/0 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/0 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/0 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/1 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/1 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/1 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/1 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:migration 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:migration 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:migration 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-04-19T03:38:43.542 INFO:tasks.workunit.client.0.smithi005.stdout:migration 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 21 root cwd unknown /proc/21/cwd (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 21 root rtd unknown /proc/21/root (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 21 root txt unknown /proc/21/exe (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 21 root NOFD /proc/21/fd (opendir: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/2 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/2 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/2 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/2 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-04-19T03:38:43.543 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:migration 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:migration 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:migration 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:migration 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 27 root cwd unknown /proc/27/cwd (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 27 root rtd unknown /proc/27/root (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 27 root txt unknown /proc/27/exe (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 27 root NOFD /proc/27/fd (opendir: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-04-19T03:38:43.544 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/3 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/3 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/3 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/3 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:migration 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:migration 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:migration 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:migration 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 33 root cwd unknown /proc/33/cwd (readlink: Permission denied) 2024-04-19T03:38:43.545 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 33 root rtd unknown /proc/33/root (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 33 root txt unknown /proc/33/exe (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 33 root NOFD /proc/33/fd (opendir: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/4 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/4 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/4 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/4 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-04-19T03:38:43.546 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:migration 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:migration 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:migration 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:migration 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 39 root NOFD /proc/39/fd (opendir: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-04-19T03:38:43.547 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/5 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/5 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/5 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/5 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-04-19T03:38:43.548 INFO:tasks.workunit.client.0.smithi005.stdout:migration 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:migration 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:migration 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:migration 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 45 root cwd unknown /proc/45/cwd (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 45 root rtd unknown /proc/45/root (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 45 root txt unknown /proc/45/exe (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 45 root NOFD /proc/45/fd (opendir: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/6 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/6 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-04-19T03:38:43.549 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/6 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/6 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:migration 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:migration 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:migration 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:migration 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 51 root cwd unknown /proc/51/cwd (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 51 root rtd unknown /proc/51/root (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 51 root txt unknown /proc/51/exe (readlink: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 51 root NOFD /proc/51/fd (opendir: Permission denied) 2024-04-19T03:38:43.550 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/7 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/7 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/7 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/7 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:watchdog/ 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:migration 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:migration 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:migration 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-04-19T03:38:43.551 INFO:tasks.workunit.client.0.smithi005.stdout:migration 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 57 root cwd unknown /proc/57/cwd (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 57 root rtd unknown /proc/57/root (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 57 root txt unknown /proc/57/exe (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 57 root NOFD /proc/57/fd (opendir: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:kdevtmpfs 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:kdevtmpfs 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:kdevtmpfs 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:kdevtmpfs 68 root NOFD /proc/68/fd (opendir: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:netns 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:netns 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-04-19T03:38:43.552 INFO:tasks.workunit.client.0.smithi005.stdout:netns 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:netns 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:kauditd 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:kauditd 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:kauditd 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:kauditd 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:khungtask 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:khungtask 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:khungtask 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:khungtask 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:oom_reape 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:oom_reape 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:oom_reape 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:oom_reape 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-04-19T03:38:43.553 INFO:tasks.workunit.client.0.smithi005.stdout:writeback 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:writeback 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:writeback 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:writeback 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:kcompactd 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:kcompactd 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:kcompactd 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:kcompactd 75 root NOFD /proc/75/fd (opendir: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:ksmd 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:ksmd 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:ksmd 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:ksmd 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:khugepage 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-04-19T03:38:43.554 INFO:tasks.workunit.client.0.smithi005.stdout:khugepage 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:khugepage 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:khugepage 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:crypto 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:crypto 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:crypto 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:crypto 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:kintegrit 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:kintegrit 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:kintegrit 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-04-19T03:38:43.555 INFO:tasks.workunit.client.0.smithi005.stdout:kintegrit 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:kblockd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:kblockd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:kblockd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:kblockd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:blkcg_pun 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:blkcg_pun 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:blkcg_pun 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:blkcg_pun 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:tpm_dev_w 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:tpm_dev_w 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-04-19T03:38:43.556 INFO:tasks.workunit.client.0.smithi005.stdout:tpm_dev_w 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:tpm_dev_w 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:md 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:md 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:md 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:md 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:edac-poll 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:edac-poll 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:edac-poll 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:edac-poll 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-04-19T03:38:43.557 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kswapd0 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kswapd0 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kswapd0 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kswapd0 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 169 root cwd unknown /proc/169/cwd (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 169 root rtd unknown /proc/169/root (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 169 root txt unknown /proc/169/exe (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 169 root NOFD /proc/169/fd (opendir: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kthrotld 170 root cwd unknown /proc/170/cwd (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kthrotld 170 root rtd unknown /proc/170/root (readlink: Permission denied) 2024-04-19T03:38:43.558 INFO:tasks.workunit.client.0.smithi005.stdout:kthrotld 170 root txt unknown /proc/170/exe (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kthrotld 170 root NOFD /proc/170/fd (opendir: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:acpi_ther 171 root cwd unknown /proc/171/cwd (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:acpi_ther 171 root rtd unknown /proc/171/root (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:acpi_ther 171 root txt unknown /proc/171/exe (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:acpi_ther 171 root NOFD /proc/171/fd (opendir: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kmpath_rd 173 root cwd unknown /proc/173/cwd (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kmpath_rd 173 root rtd unknown /proc/173/root (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kmpath_rd 173 root txt unknown /proc/173/exe (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kmpath_rd 173 root NOFD /proc/173/fd (opendir: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kaluad 174 root cwd unknown /proc/174/cwd (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kaluad 174 root rtd unknown /proc/174/root (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kaluad 174 root txt unknown /proc/174/exe (readlink: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kaluad 174 root NOFD /proc/174/fd (opendir: Permission denied) 2024-04-19T03:38:43.559 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 175 root cwd unknown /proc/175/cwd (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 175 root rtd unknown /proc/175/root (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 175 root txt unknown /proc/175/exe (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 175 root NOFD /proc/175/fd (opendir: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 176 root cwd unknown /proc/176/cwd (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 176 root rtd unknown /proc/176/root (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 176 root txt unknown /proc/176/exe (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 176 root NOFD /proc/176/fd (opendir: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:ipv6_addr 177 root cwd unknown /proc/177/cwd (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:ipv6_addr 177 root rtd unknown /proc/177/root (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:ipv6_addr 177 root txt unknown /proc/177/exe (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:ipv6_addr 177 root NOFD /proc/177/fd (opendir: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kstrp 179 root cwd unknown /proc/179/cwd (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kstrp 179 root rtd unknown /proc/179/root (readlink: Permission denied) 2024-04-19T03:38:43.560 INFO:tasks.workunit.client.0.smithi005.stdout:kstrp 179 root txt unknown /proc/179/exe (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kstrp 179 root NOFD /proc/179/fd (opendir: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:zswap-shr 219 root cwd unknown /proc/219/cwd (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:zswap-shr 219 root rtd unknown /proc/219/root (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:zswap-shr 219 root txt unknown /proc/219/exe (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:zswap-shr 219 root NOFD /proc/219/fd (opendir: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 234 root cwd unknown /proc/234/cwd (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 234 root rtd unknown /proc/234/root (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 234 root txt unknown /proc/234/exe (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 234 root NOFD /proc/234/fd (opendir: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 240 root cwd unknown /proc/240/cwd (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 240 root rtd unknown /proc/240/root (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 240 root txt unknown /proc/240/exe (readlink: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 240 root NOFD /proc/240/fd (opendir: Permission denied) 2024-04-19T03:38:43.561 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 268 root cwd unknown /proc/268/cwd (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 268 root rtd unknown /proc/268/root (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 268 root txt unknown /proc/268/exe (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 268 root NOFD /proc/268/fd (opendir: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 271 root cwd unknown /proc/271/cwd (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 271 root rtd unknown /proc/271/root (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 271 root txt unknown /proc/271/exe (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 271 root NOFD /proc/271/fd (opendir: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 274 root cwd unknown /proc/274/cwd (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 274 root rtd unknown /proc/274/root (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 274 root txt unknown /proc/274/exe (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 274 root NOFD /proc/274/fd (opendir: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 366 root cwd unknown /proc/366/cwd (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 366 root rtd unknown /proc/366/root (readlink: Permission denied) 2024-04-19T03:38:43.562 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 366 root txt unknown /proc/366/exe (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 366 root NOFD /proc/366/fd (opendir: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 421 root cwd unknown /proc/421/cwd (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 421 root rtd unknown /proc/421/root (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 421 root txt unknown /proc/421/exe (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 421 root NOFD /proc/421/fd (opendir: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-wq 422 root cwd unknown /proc/422/cwd (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-wq 422 root rtd unknown /proc/422/root (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-wq 422 root txt unknown /proc/422/exe (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-wq 422 root NOFD /proc/422/fd (opendir: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-rese 423 root cwd unknown /proc/423/cwd (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-rese 423 root rtd unknown /proc/423/root (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-rese 423 root txt unknown /proc/423/exe (readlink: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-rese 423 root NOFD /proc/423/fd (opendir: Permission denied) 2024-04-19T03:38:43.563 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-dele 424 root cwd unknown /proc/424/cwd (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-dele 424 root rtd unknown /proc/424/root (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-dele 424 root txt unknown /proc/424/exe (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:nvme-dele 424 root NOFD /proc/424/fd (opendir: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:ata_sff 434 root cwd unknown /proc/434/cwd (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:ata_sff 434 root rtd unknown /proc/434/root (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:ata_sff 434 root txt unknown /proc/434/exe (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:ata_sff 434 root NOFD /proc/434/fd (opendir: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:ixgbe 436 root cwd unknown /proc/436/cwd (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:ixgbe 436 root rtd unknown /proc/436/root (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:ixgbe 436 root txt unknown /proc/436/exe (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:ixgbe 436 root NOFD /proc/436/fd (opendir: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_0 438 root cwd unknown /proc/438/cwd (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_0 438 root rtd unknown /proc/438/root (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_0 438 root txt unknown /proc/438/exe (readlink: Permission denied) 2024-04-19T03:38:43.564 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_0 438 root NOFD /proc/438/fd (opendir: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 439 root cwd unknown /proc/439/cwd (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 439 root rtd unknown /proc/439/root (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 439 root txt unknown /proc/439/exe (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 439 root NOFD /proc/439/fd (opendir: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_1 440 root cwd unknown /proc/440/cwd (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_1 440 root rtd unknown /proc/440/root (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_1 440 root txt unknown /proc/440/exe (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_1 440 root NOFD /proc/440/fd (opendir: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 441 root cwd unknown /proc/441/cwd (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 441 root rtd unknown /proc/441/root (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 441 root txt unknown /proc/441/exe (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 441 root NOFD /proc/441/fd (opendir: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_2 442 root cwd unknown /proc/442/cwd (readlink: Permission denied) 2024-04-19T03:38:43.565 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_2 442 root rtd unknown /proc/442/root (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_2 442 root txt unknown /proc/442/exe (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_2 442 root NOFD /proc/442/fd (opendir: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 443 root cwd unknown /proc/443/cwd (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 443 root rtd unknown /proc/443/root (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 443 root txt unknown /proc/443/exe (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 443 root NOFD /proc/443/fd (opendir: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_3 444 root cwd unknown /proc/444/cwd (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_3 444 root rtd unknown /proc/444/root (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_3 444 root txt unknown /proc/444/exe (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_3 444 root NOFD /proc/444/fd (opendir: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 445 root cwd unknown /proc/445/cwd (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 445 root rtd unknown /proc/445/root (readlink: Permission denied) 2024-04-19T03:38:43.566 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 445 root txt unknown /proc/445/exe (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 445 root NOFD /proc/445/fd (opendir: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_4 446 root cwd unknown /proc/446/cwd (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_4 446 root rtd unknown /proc/446/root (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_4 446 root txt unknown /proc/446/exe (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_4 446 root NOFD /proc/446/fd (opendir: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 447 root cwd unknown /proc/447/cwd (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 447 root rtd unknown /proc/447/root (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 447 root txt unknown /proc/447/exe (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 447 root NOFD /proc/447/fd (opendir: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_5 448 root cwd unknown /proc/448/cwd (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_5 448 root rtd unknown /proc/448/root (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_5 448 root txt unknown /proc/448/exe (readlink: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_5 448 root NOFD /proc/448/fd (opendir: Permission denied) 2024-04-19T03:38:43.567 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_6 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_6 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_6 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_6 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_7 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_7 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_7 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-04-19T03:38:43.568 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_7 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_8 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_8 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_8 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_8 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_9 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-04-19T03:38:43.569 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_9 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_9 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_9 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_tmf_ 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 458 root cwd unknown /proc/458/cwd (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 458 root rtd unknown /proc/458/root (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 458 root txt unknown /proc/458/exe (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 458 root NOFD /proc/458/fd (opendir: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:jbd2/sda1 491 root cwd unknown /proc/491/cwd (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:jbd2/sda1 491 root rtd unknown /proc/491/root (readlink: Permission denied) 2024-04-19T03:38:43.570 INFO:tasks.workunit.client.0.smithi005.stdout:jbd2/sda1 491 root txt unknown /proc/491/exe (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:jbd2/sda1 491 root NOFD /proc/491/fd (opendir: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:ext4-rsv- 492 root cwd unknown /proc/492/cwd (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:ext4-rsv- 492 root rtd unknown /proc/492/root (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:ext4-rsv- 492 root txt unknown /proc/492/exe (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:ext4-rsv- 492 root NOFD /proc/492/fd (opendir: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-j 594 root cwd unknown /proc/594/cwd (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-j 594 root rtd unknown /proc/594/root (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-j 594 root txt unknown /proc/594/exe (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-j 594 root NOFD /proc/594/fd (opendir: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:ext4lazyi 600 root cwd unknown /proc/600/cwd (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:ext4lazyi 600 root rtd unknown /proc/600/root (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:ext4lazyi 600 root txt unknown /proc/600/exe (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:ext4lazyi 600 root NOFD /proc/600/fd (opendir: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 623 root cwd unknown /proc/623/cwd (readlink: Permission denied) 2024-04-19T03:38:43.571 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 623 root rtd unknown /proc/623/root (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 623 root txt unknown /proc/623/exe (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 623 root NOFD /proc/623/fd (opendir: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 660 root cwd unknown /proc/660/cwd (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 660 root rtd unknown /proc/660/root (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 660 root txt unknown /proc/660/exe (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 660 root NOFD /proc/660/fd (opendir: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-u 663 root cwd unknown /proc/663/cwd (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-u 663 root rtd unknown /proc/663/root (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-u 663 root txt unknown /proc/663/exe (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-u 663 root NOFD /proc/663/fd (opendir: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:rpcbind 665 rpc cwd unknown /proc/665/cwd (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:rpcbind 665 rpc rtd unknown /proc/665/root (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:rpcbind 665 rpc txt unknown /proc/665/exe (readlink: Permission denied) 2024-04-19T03:38:43.572 INFO:tasks.workunit.client.0.smithi005.stdout:rpcbind 665 rpc NOFD /proc/665/fd (opendir: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 root cwd unknown /proc/669/cwd (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 root rtd unknown /proc/669/root (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 root txt unknown /proc/669/exe (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 root NOFD /proc/669/fd (opendir: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 670 auditd root cwd unknown /proc/669/task/670/cwd (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 670 auditd root rtd unknown /proc/669/task/670/root (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 670 auditd root txt unknown /proc/669/task/670/exe (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 670 auditd root NOFD /proc/669/task/670/fd (opendir: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 675 auditd root cwd unknown /proc/669/task/675/cwd (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 675 auditd root rtd unknown /proc/669/task/675/root (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 675 auditd root txt unknown /proc/669/task/675/exe (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 669 675 auditd root NOFD /proc/669/task/675/fd (opendir: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:rpciod 671 root cwd unknown /proc/671/cwd (readlink: Permission denied) 2024-04-19T03:38:43.573 INFO:tasks.workunit.client.0.smithi005.stdout:rpciod 671 root rtd unknown /proc/671/root (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:rpciod 671 root txt unknown /proc/671/exe (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:rpciod 671 root NOFD /proc/671/fd (opendir: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:xprtiod 672 root cwd unknown /proc/672/cwd (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:xprtiod 672 root rtd unknown /proc/672/root (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:xprtiod 672 root txt unknown /proc/672/exe (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:xprtiod 672 root NOFD /proc/672/fd (opendir: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:sedispatc 674 root cwd unknown /proc/674/cwd (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:sedispatc 674 root rtd unknown /proc/674/root (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:sedispatc 674 root txt unknown /proc/674/exe (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:sedispatc 674 root NOFD /proc/674/fd (opendir: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:ipmi-msgh 721 root cwd unknown /proc/721/cwd (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:ipmi-msgh 721 root rtd unknown /proc/721/root (readlink: Permission denied) 2024-04-19T03:38:43.574 INFO:tasks.workunit.client.0.smithi005.stdout:ipmi-msgh 721 root txt unknown /proc/721/exe (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:ipmi-msgh 721 root NOFD /proc/721/fd (opendir: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:kipmi0 732 root cwd unknown /proc/732/cwd (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:kipmi0 732 root rtd unknown /proc/732/root (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:kipmi0 732 root txt unknown /proc/732/exe (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:kipmi0 732 root NOFD /proc/732/fd (opendir: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-daem 811 dbus cwd unknown /proc/811/cwd (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-daem 811 dbus rtd unknown /proc/811/root (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-daem 811 dbus txt unknown /proc/811/exe (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-daem 811 dbus NOFD /proc/811/fd (opendir: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-daem 811 867 dbus-daem dbus cwd unknown /proc/811/task/867/cwd (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-daem 811 867 dbus-daem dbus rtd unknown /proc/811/task/867/root (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-daem 811 867 dbus-daem dbus txt unknown /proc/811/task/867/exe (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-daem 811 867 dbus-daem dbus NOFD /proc/811/task/867/fd (opendir: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 root cwd unknown /proc/812/cwd (readlink: Permission denied) 2024-04-19T03:38:43.575 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 root rtd unknown /proc/812/root (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 root txt unknown /proc/812/exe (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 root NOFD /proc/812/fd (opendir: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 873 gmain root cwd unknown /proc/812/task/873/cwd (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 873 gmain root rtd unknown /proc/812/task/873/root (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 873 gmain root txt unknown /proc/812/task/873/exe (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 873 gmain root NOFD /proc/812/task/873/fd (opendir: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 875 gdbus root cwd unknown /proc/812/task/875/cwd (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 875 gdbus root rtd unknown /proc/812/task/875/root (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 875 gdbus root txt unknown /proc/812/task/875/exe (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 812 875 gdbus root NOFD /proc/812/task/875/fd (opendir: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:avahi-dae 814 avahi cwd unknown /proc/814/cwd (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:avahi-dae 814 avahi rtd unknown /proc/814/root (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:avahi-dae 814 avahi txt unknown /proc/814/exe (readlink: Permission denied) 2024-04-19T03:38:43.576 INFO:tasks.workunit.client.0.smithi005.stdout:avahi-dae 814 avahi NOFD /proc/814/fd (opendir: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:lsmd 815 libstoragemgmt cwd unknown /proc/815/cwd (readlink: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:lsmd 815 libstoragemgmt rtd unknown /proc/815/root (readlink: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:lsmd 815 libstoragemgmt txt unknown /proc/815/exe (readlink: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:lsmd 815 libstoragemgmt NOFD /proc/815/fd (opendir: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 818 root cwd unknown /proc/818/cwd (readlink: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 818 root rtd unknown /proc/818/root (readlink: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 818 root txt unknown /proc/818/exe (readlink: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 818 root NOFD /proc/818/fd (opendir: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 818 820 gmain root cwd unknown /proc/818/task/820/cwd (readlink: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 818 820 gmain root rtd unknown /proc/818/task/820/root (readlink: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 818 820 gmain root txt unknown /proc/818/task/820/exe (readlink: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 818 820 gmain root NOFD /proc/818/task/820/fd (opendir: Permission denied) 2024-04-19T03:38:43.577 INFO:tasks.workunit.client.0.smithi005.stdout:mcelog 819 root cwd unknown /proc/819/cwd (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:mcelog 819 root rtd unknown /proc/819/root (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:mcelog 819 root txt unknown /proc/819/exe (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:mcelog 819 root NOFD /proc/819/fd (opendir: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 polkitd cwd unknown /proc/822/cwd (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 polkitd rtd unknown /proc/822/root (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 polkitd txt unknown /proc/822/exe (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 polkitd NOFD /proc/822/fd (opendir: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 893 gmain polkitd cwd unknown /proc/822/task/893/cwd (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 893 gmain polkitd rtd unknown /proc/822/task/893/root (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 893 gmain polkitd txt unknown /proc/822/task/893/exe (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 893 gmain polkitd NOFD /proc/822/task/893/fd (opendir: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 894 gdbus polkitd cwd unknown /proc/822/task/894/cwd (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 894 gdbus polkitd rtd unknown /proc/822/task/894/root (readlink: Permission denied) 2024-04-19T03:38:43.578 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 894 gdbus polkitd txt unknown /proc/822/task/894/exe (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 894 gdbus polkitd NOFD /proc/822/task/894/fd (opendir: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 895 JS\x20Hel polkitd cwd unknown /proc/822/task/895/cwd (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 895 JS\x20Hel polkitd rtd unknown /proc/822/task/895/root (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 895 JS\x20Hel polkitd txt unknown /proc/822/task/895/exe (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 895 JS\x20Hel polkitd NOFD /proc/822/task/895/fd (opendir: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 896 JS\x20Hel polkitd cwd unknown /proc/822/task/896/cwd (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 896 JS\x20Hel polkitd rtd unknown /proc/822/task/896/root (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 896 JS\x20Hel polkitd txt unknown /proc/822/task/896/exe (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 896 JS\x20Hel polkitd NOFD /proc/822/task/896/fd (opendir: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 897 JS\x20Hel polkitd cwd unknown /proc/822/task/897/cwd (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 897 JS\x20Hel polkitd rtd unknown /proc/822/task/897/root (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 897 JS\x20Hel polkitd txt unknown /proc/822/task/897/exe (readlink: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 897 JS\x20Hel polkitd NOFD /proc/822/task/897/fd (opendir: Permission denied) 2024-04-19T03:38:43.579 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 898 JS\x20Hel polkitd cwd unknown /proc/822/task/898/cwd (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 898 JS\x20Hel polkitd rtd unknown /proc/822/task/898/root (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 898 JS\x20Hel polkitd txt unknown /proc/822/task/898/exe (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 898 JS\x20Hel polkitd NOFD /proc/822/task/898/fd (opendir: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 899 JS\x20Hel polkitd cwd unknown /proc/822/task/899/cwd (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 899 JS\x20Hel polkitd rtd unknown /proc/822/task/899/root (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 899 JS\x20Hel polkitd txt unknown /proc/822/task/899/exe (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 899 JS\x20Hel polkitd NOFD /proc/822/task/899/fd (opendir: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 900 JS\x20Hel polkitd cwd unknown /proc/822/task/900/cwd (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 900 JS\x20Hel polkitd rtd unknown /proc/822/task/900/root (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 900 JS\x20Hel polkitd txt unknown /proc/822/task/900/exe (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 900 JS\x20Hel polkitd NOFD /proc/822/task/900/fd (opendir: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 901 JS\x20Hel polkitd cwd unknown /proc/822/task/901/cwd (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 901 JS\x20Hel polkitd rtd unknown /proc/822/task/901/root (readlink: Permission denied) 2024-04-19T03:38:43.580 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 901 JS\x20Hel polkitd txt unknown /proc/822/task/901/exe (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 901 JS\x20Hel polkitd NOFD /proc/822/task/901/fd (opendir: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 902 JS\x20Hel polkitd cwd unknown /proc/822/task/902/cwd (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 902 JS\x20Hel polkitd rtd unknown /proc/822/task/902/root (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 902 JS\x20Hel polkitd txt unknown /proc/822/task/902/exe (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 902 JS\x20Hel polkitd NOFD /proc/822/task/902/fd (opendir: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 911 polkitd polkitd cwd unknown /proc/822/task/911/cwd (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 911 polkitd polkitd rtd unknown /proc/822/task/911/root (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 911 polkitd polkitd txt unknown /proc/822/task/911/exe (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 822 911 polkitd polkitd NOFD /proc/822/task/911/fd (opendir: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:smartd 823 root cwd unknown /proc/823/cwd (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:smartd 823 root rtd unknown /proc/823/root (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:smartd 823 root txt unknown /proc/823/exe (readlink: Permission denied) 2024-04-19T03:38:43.581 INFO:tasks.workunit.client.0.smithi005.stdout:smartd 823 root NOFD /proc/823/fd (opendir: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:sssd 827 root cwd unknown /proc/827/cwd (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:sssd 827 root rtd unknown /proc/827/root (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:sssd 827 root txt unknown /proc/827/exe (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:sssd 827 root NOFD /proc/827/fd (opendir: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:avahi-dae 870 avahi cwd unknown /proc/870/cwd (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:avahi-dae 870 avahi rtd unknown /proc/870/root (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:avahi-dae 870 avahi txt unknown /proc/870/exe (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:avahi-dae 870 avahi NOFD /proc/870/fd (opendir: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 root cwd unknown /proc/877/cwd (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 root rtd unknown /proc/877/root (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 root txt unknown /proc/877/exe (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 root NOFD /proc/877/fd (opendir: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1105 tuned root cwd unknown /proc/877/task/1105/cwd (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1105 tuned root rtd unknown /proc/877/task/1105/root (readlink: Permission denied) 2024-04-19T03:38:43.582 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1105 tuned root txt unknown /proc/877/task/1105/exe (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1105 tuned root NOFD /proc/877/task/1105/fd (opendir: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1110 tuned root cwd unknown /proc/877/task/1110/cwd (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1110 tuned root rtd unknown /proc/877/task/1110/root (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1110 tuned root txt unknown /proc/877/task/1110/exe (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1110 tuned root NOFD /proc/877/task/1110/fd (opendir: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1127 tuned root cwd unknown /proc/877/task/1127/cwd (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1127 tuned root rtd unknown /proc/877/task/1127/root (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1127 tuned root txt unknown /proc/877/task/1127/exe (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1127 tuned root NOFD /proc/877/task/1127/fd (opendir: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1128 tuned root cwd unknown /proc/877/task/1128/cwd (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1128 tuned root rtd unknown /proc/877/task/1128/root (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1128 tuned root txt unknown /proc/877/task/1128/exe (readlink: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:tuned 877 1128 tuned root NOFD /proc/877/task/1128/fd (opendir: Permission denied) 2024-04-19T03:38:43.583 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 878 root cwd unknown /proc/878/cwd (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 878 root rtd unknown /proc/878/root (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 878 root txt unknown /proc/878/exe (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 878 root NOFD /proc/878/fd (opendir: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:rhsmcertd 881 root cwd unknown /proc/881/cwd (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:rhsmcertd 881 root rtd unknown /proc/881/root (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:rhsmcertd 881 root txt unknown /proc/881/exe (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:rhsmcertd 881 root NOFD /proc/881/fd (opendir: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 root cwd unknown /proc/887/cwd (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 root rtd unknown /proc/887/root (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 root txt unknown /proc/887/exe (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 root NOFD /proc/887/fd (opendir: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 888 gssproxy root cwd unknown /proc/887/task/888/cwd (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 888 gssproxy root rtd unknown /proc/887/task/888/root (readlink: Permission denied) 2024-04-19T03:38:43.584 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 888 gssproxy root txt unknown /proc/887/task/888/exe (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 888 gssproxy root NOFD /proc/887/task/888/fd (opendir: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 889 gssproxy root cwd unknown /proc/887/task/889/cwd (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 889 gssproxy root rtd unknown /proc/887/task/889/root (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 889 gssproxy root txt unknown /proc/887/task/889/exe (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 889 gssproxy root NOFD /proc/887/task/889/fd (opendir: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 890 gssproxy root cwd unknown /proc/887/task/890/cwd (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 890 gssproxy root rtd unknown /proc/887/task/890/root (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 890 gssproxy root txt unknown /proc/887/task/890/exe (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 890 gssproxy root NOFD /proc/887/task/890/fd (opendir: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 891 gssproxy root cwd unknown /proc/887/task/891/cwd (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 891 gssproxy root rtd unknown /proc/887/task/891/root (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 891 gssproxy root txt unknown /proc/887/task/891/exe (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 891 gssproxy root NOFD /proc/887/task/891/fd (opendir: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 892 gssproxy root cwd unknown /proc/887/task/892/cwd (readlink: Permission denied) 2024-04-19T03:38:43.585 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 892 gssproxy root rtd unknown /proc/887/task/892/root (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 892 gssproxy root txt unknown /proc/887/task/892/exe (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 887 892 gssproxy root NOFD /proc/887/task/892/fd (opendir: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:sssd_be 912 root cwd unknown /proc/912/cwd (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:sssd_be 912 root rtd unknown /proc/912/root (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:sssd_be 912 root txt unknown /proc/912/exe (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:sssd_be 912 root NOFD /proc/912/fd (opendir: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:sssd_nss 940 root cwd unknown /proc/940/cwd (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:sssd_nss 940 root rtd unknown /proc/940/root (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:sssd_nss 940 root txt unknown /proc/940/exe (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:sssd_nss 940 root NOFD /proc/940/fd (opendir: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-l 950 root cwd unknown /proc/950/cwd (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-l 950 root rtd unknown /proc/950/root (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-l 950 root txt unknown /proc/950/exe (readlink: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-l 950 root NOFD /proc/950/fd (opendir: Permission denied) 2024-04-19T03:38:43.586 INFO:tasks.workunit.client.0.smithi005.stdout:cupsd 952 root cwd unknown /proc/952/cwd (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:cupsd 952 root rtd unknown /proc/952/root (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:cupsd 952 root txt unknown /proc/952/exe (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:cupsd 952 root NOFD /proc/952/fd (opendir: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:atd 970 root cwd unknown /proc/970/cwd (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:atd 970 root rtd unknown /proc/970/root (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:atd 970 root txt unknown /proc/970/exe (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:atd 970 root NOFD /proc/970/fd (opendir: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:crond 985 root cwd unknown /proc/985/cwd (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:crond 985 root rtd unknown /proc/985/root (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:crond 985 root txt unknown /proc/985/exe (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:crond 985 root NOFD /proc/985/fd (opendir: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:nrpe 1149 nrpe cwd unknown /proc/1149/cwd (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:nrpe 1149 nrpe rtd unknown /proc/1149/root (readlink: Permission denied) 2024-04-19T03:38:43.587 INFO:tasks.workunit.client.0.smithi005.stdout:nrpe 1149 nrpe txt unknown /proc/1149/exe (readlink: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:nrpe 1149 nrpe NOFD /proc/1149/fd (opendir: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 5894 root cwd unknown /proc/5894/cwd (readlink: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 5894 root rtd unknown /proc/5894/root (readlink: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 5894 root txt unknown /proc/5894/exe (readlink: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 5894 root NOFD /proc/5894/fd (opendir: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 5895 root cwd unknown /proc/5895/cwd (readlink: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 5895 root rtd unknown /proc/5895/root (readlink: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 5895 root txt unknown /proc/5895/exe (readlink: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 5895 root NOFD /proc/5895/fd (opendir: Permission denied) 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu cwd DIR 8,1 4096 2 / 2024-04-19T03:38:43.588 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu rtd DIR 8,1 4096 2 / 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu txt REG 8,1 1601312 8305 /usr/lib/systemd/systemd 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 1598808 5171 /usr/lib64/libm-2.28.so 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 636728 7430 /usr/lib64/libudev.so.1.6.11 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 735192 5316 /usr/lib64/libsepol.so.1 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 1760264 5414 /usr/lib64/libunistring.so.2.1.0 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 144392 5392 /usr/lib64/libgpg-error.so.0.24.2 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 66912 5574 /usr/lib64/libjson-c.so.4.0.0 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 371224 7497 /usr/lib64/libdevmapper.so.1.02 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 26192 5481 /usr/lib64/libattr.so.1.1.2448 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu DEL REG 8,1 7507 /usr/lib64/libcrypto.so.1.1.1k 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu DEL REG 8,1 7509 /usr/lib64/libssl.so.1.1.1k 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 99600 5318 /usr/lib64/libz.so.1.2.11 2024-04-19T03:38:43.589 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 24928 5576 /usr/lib64/libcap-ng.so.0.0.0 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu DEL REG 8,1 5382 /usr/lib64/libuuid.so.1.3.0 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 543160 4872 /usr/lib64/libpcre2-8.so.0.7.1 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu DEL REG 8,1 7499 /usr/lib64/libblkid.so.1.1.0 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 119760 5781 /usr/lib64/liblz4.so.1.8.3 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 192016 5359 /usr/lib64/liblzma.so.5.2.4 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 162224 5584 /usr/lib64/libidn2.so.0.3.6 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 1187360 5616 /usr/lib64/libgcrypt.so.20.2.5 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 526360 7535 /usr/lib64/libcryptsetup.so.12.6.0 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 54816 5483 /usr/lib64/libacl.so.1.1.2253 2024-04-19T03:38:43.590 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 33752 5371 /usr/lib64/libcap.so.2.48 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 99664 6703 /usr/lib64/libgcc_s-8-20210514.so.1 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 100200 7532 /usr/lib64/libkmod.so.2.3.3 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 135792 5578 /usr/lib64/libaudit.so.1.0.0 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 66504 7674 /usr/lib64/libpam.so.0.84.2 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu DEL REG 8,1 7306 /usr/lib64/libmount.so.1.1.0 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 168536 4876 /usr/lib64/libselinux.so.1 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 128784 6087 /usr/lib64/libseccomp.so.2.5.2 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 42744 5185 /usr/lib64/librt-2.28.so 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 2740672 8300 /usr/lib/systemd/libsystemd-shared-239.so 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 0r CHR 1,3 0t0 3082 /dev/null 2024-04-19T03:38:43.591 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 1u unix 0x0000000000000000 0t0 37867 type=STREAM 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 2u unix 0x0000000000000000 0t0 37867 type=STREAM 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 3u unix 0x0000000000000000 0t0 37884 type=DGRAM 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 4u a_inode 0,14 0 13556 [eventpoll] 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 5u a_inode 0,14 0 13556 [signalfd] 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 6r DIR 0,26 0 948 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 7u a_inode 0,14 0 13556 [timerfd] 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 8u netlink 0t0 45059 KOBJECT_UEVENT 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 9u a_inode 0,14 0 13556 [eventpoll] 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 10r a_inode 0,14 0 13556 inotify 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 11u unix 0x0000000000000000 0t0 45077 /run/user/1000/bus type=STREAM 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 12r REG 0,5 0 45064 /proc/6133/mountinfo 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 13r a_inode 0,14 0 13556 inotify 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 15u unix 0x0000000000000000 0t0 45065 /run/user/1000/systemd/notify type=DGRAM 2024-04-19T03:38:43.592 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 16u unix 0x0000000000000000 0t0 45067 type=DGRAM 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 17u unix 0x0000000000000000 0t0 45068 type=DGRAM 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 18u unix 0x0000000000000000 0t0 45069 /run/user/1000/systemd/private type=STREAM 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 19u unix 0x0000000000000000 0t0 45071 type=STREAM 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 20u a_inode 0,14 0 13556 [timerfd] 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 6133 ubuntu 26u netlink 0t0 45080 SELINUX 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 6136 ubuntu cwd unknown /proc/6136/cwd (readlink: Permission denied) 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 6136 ubuntu rtd unknown /proc/6136/root (readlink: Permission denied) 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 6136 ubuntu txt unknown /proc/6136/exe (readlink: Permission denied) 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 6136 ubuntu NOFD /proc/6136/fd (opendir: Permission denied) 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 root cwd unknown /proc/6690/cwd (readlink: Permission denied) 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 root rtd unknown /proc/6690/root (readlink: Permission denied) 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 root txt unknown /proc/6690/exe (readlink: Permission denied) 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 root NOFD /proc/6690/fd (opendir: Permission denied) 2024-04-19T03:38:43.593 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 6692 in:imjour root cwd unknown /proc/6690/task/6692/cwd (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 6692 in:imjour root rtd unknown /proc/6690/task/6692/root (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 6692 in:imjour root txt unknown /proc/6690/task/6692/exe (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 6692 in:imjour root NOFD /proc/6690/task/6692/fd (opendir: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 6693 rs:main root cwd unknown /proc/6690/task/6693/cwd (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 6693 rs:main root rtd unknown /proc/6690/task/6693/root (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 6693 rs:main root txt unknown /proc/6690/task/6693/exe (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 6690 6693 rs:main root NOFD /proc/6690/task/6693/fd (opendir: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 21287 root cwd unknown /proc/21287/cwd (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 21287 root rtd unknown /proc/21287/root (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 21287 root txt unknown /proc/21287/exe (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 21287 root NOFD /proc/21287/fd (opendir: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 25600 root cwd unknown /proc/25600/cwd (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 25600 root rtd unknown /proc/25600/root (readlink: Permission denied) 2024-04-19T03:38:43.594 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 25600 root txt unknown /proc/25600/exe (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 25600 root NOFD /proc/25600/fd (opendir: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 25735 root cwd unknown /proc/25735/cwd (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 25735 root rtd unknown /proc/25735/root (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 25735 root txt unknown /proc/25735/exe (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 25735 root NOFD /proc/25735/fd (opendir: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 25744 root cwd unknown /proc/25744/cwd (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 25744 root rtd unknown /proc/25744/root (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 25744 root txt unknown /proc/25744/exe (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 25744 root NOFD /proc/25744/fd (opendir: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:ksmtuned 25865 root cwd unknown /proc/25865/cwd (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:ksmtuned 25865 root rtd unknown /proc/25865/root (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:ksmtuned 25865 root txt unknown /proc/25865/exe (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:ksmtuned 25865 root NOFD /proc/25865/fd (opendir: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 25867 root cwd unknown /proc/25867/cwd (readlink: Permission denied) 2024-04-19T03:38:43.595 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 25867 root rtd unknown /proc/25867/root (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 25867 root txt unknown /proc/25867/exe (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 25867 root NOFD /proc/25867/fd (opendir: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 27465 root cwd unknown /proc/27465/cwd (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 27465 root rtd unknown /proc/27465/root (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 27465 root txt unknown /proc/27465/exe (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 27465 root NOFD /proc/27465/fd (opendir: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 27466 root cwd unknown /proc/27466/cwd (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 27466 root rtd unknown /proc/27466/root (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 27466 root txt unknown /proc/27466/exe (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 27466 root NOFD /proc/27466/fd (opendir: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28155 root cwd unknown /proc/28155/cwd (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28155 root rtd unknown /proc/28155/root (readlink: Permission denied) 2024-04-19T03:38:43.596 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28155 root txt unknown /proc/28155/exe (readlink: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28155 root NOFD /proc/28155/fd (opendir: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28192 root cwd unknown /proc/28192/cwd (readlink: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28192 root rtd unknown /proc/28192/root (readlink: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28192 root txt unknown /proc/28192/exe (readlink: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28192 root NOFD /proc/28192/fd (opendir: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28229 root cwd unknown /proc/28229/cwd (readlink: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28229 root rtd unknown /proc/28229/root (readlink: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28229 root txt unknown /proc/28229/exe (readlink: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28229 root NOFD /proc/28229/fd (opendir: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28266 root cwd unknown /proc/28266/cwd (readlink: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28266 root rtd unknown /proc/28266/root (readlink: Permission denied) 2024-04-19T03:38:43.597 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28266 root txt unknown /proc/28266/exe (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28266 root NOFD /proc/28266/fd (opendir: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28303 root cwd unknown /proc/28303/cwd (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28303 root rtd unknown /proc/28303/root (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28303 root txt unknown /proc/28303/exe (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:kdmflush/ 28303 root NOFD /proc/28303/fd (opendir: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:xfsalloc 28516 root cwd unknown /proc/28516/cwd (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:xfsalloc 28516 root rtd unknown /proc/28516/root (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:xfsalloc 28516 root txt unknown /proc/28516/exe (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:xfsalloc 28516 root NOFD /proc/28516/fd (opendir: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:xfs_mru_c 28517 root cwd unknown /proc/28517/cwd (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:xfs_mru_c 28517 root rtd unknown /proc/28517/root (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:xfs_mru_c 28517 root txt unknown /proc/28517/exe (readlink: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:xfs_mru_c 28517 root NOFD /proc/28517/fd (opendir: Permission denied) 2024-04-19T03:38:43.598 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-buf/d 28518 root cwd unknown /proc/28518/cwd (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-buf/d 28518 root rtd unknown /proc/28518/root (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-buf/d 28518 root txt unknown /proc/28518/exe (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-buf/d 28518 root NOFD /proc/28518/fd (opendir: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-conv/ 28519 root cwd unknown /proc/28519/cwd (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-conv/ 28519 root rtd unknown /proc/28519/root (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-conv/ 28519 root txt unknown /proc/28519/exe (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-conv/ 28519 root NOFD /proc/28519/fd (opendir: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-cil/d 28520 root cwd unknown /proc/28520/cwd (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-cil/d 28520 root rtd unknown /proc/28520/root (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-cil/d 28520 root txt unknown /proc/28520/exe (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-cil/d 28520 root NOFD /proc/28520/fd (opendir: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-recla 28521 root cwd unknown /proc/28521/cwd (readlink: Permission denied) 2024-04-19T03:38:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-recla 28521 root rtd unknown /proc/28521/root (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-recla 28521 root txt unknown /proc/28521/exe (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-recla 28521 root NOFD /proc/28521/fd (opendir: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-block 28522 root cwd unknown /proc/28522/cwd (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-block 28522 root rtd unknown /proc/28522/root (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-block 28522 root txt unknown /proc/28522/exe (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-block 28522 root NOFD /proc/28522/fd (opendir: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-log/d 28523 root cwd unknown /proc/28523/cwd (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-log/d 28523 root rtd unknown /proc/28523/root (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-log/d 28523 root txt unknown /proc/28523/exe (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfs-log/d 28523 root NOFD /proc/28523/fd (opendir: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfsaild/d 28524 root cwd unknown /proc/28524/cwd (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfsaild/d 28524 root rtd unknown /proc/28524/root (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfsaild/d 28524 root txt unknown /proc/28524/exe (readlink: Permission denied) 2024-04-19T03:38:43.600 INFO:tasks.workunit.client.0.smithi005.stdout:xfsaild/d 28524 root NOFD /proc/28524/fd (opendir: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 31569 root cwd unknown /proc/31569/cwd (readlink: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 31569 root rtd unknown /proc/31569/root (readlink: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 31569 root txt unknown /proc/31569/exe (readlink: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 31569 root NOFD /proc/31569/fd (opendir: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 32222 root cwd unknown /proc/32222/cwd (readlink: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 32222 root rtd unknown /proc/32222/root (readlink: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 32222 root txt unknown /proc/32222/exe (readlink: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 32222 root NOFD /proc/32222/fd (opendir: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 32226 ubuntu cwd unknown /proc/32226/cwd (readlink: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 32226 ubuntu rtd unknown /proc/32226/root (readlink: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 32226 ubuntu txt unknown /proc/32226/exe (readlink: Permission denied) 2024-04-19T03:38:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 32226 ubuntu NOFD /proc/32226/fd (opendir: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 32286 root cwd unknown /proc/32286/cwd (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 32286 root rtd unknown /proc/32286/root (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 32286 root txt unknown /proc/32286/exe (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 32286 root NOFD /proc/32286/fd (opendir: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:chronyd 32298 chrony cwd unknown /proc/32298/cwd (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:chronyd 32298 chrony rtd unknown /proc/32298/root (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:chronyd 32298 chrony txt unknown /proc/32298/exe (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:chronyd 32298 chrony NOFD /proc/32298/fd (opendir: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 32307 root cwd unknown /proc/32307/cwd (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 32307 root rtd unknown /proc/32307/root (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 32307 root txt unknown /proc/32307/exe (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 32307 root NOFD /proc/32307/fd (opendir: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 32491 root cwd unknown /proc/32491/cwd (readlink: Permission denied) 2024-04-19T03:38:43.602 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 32491 root rtd unknown /proc/32491/root (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 32491 root txt unknown /proc/32491/exe (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 32491 root NOFD /proc/32491/fd (opendir: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-cras 32617 ceph cwd unknown /proc/32617/cwd (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-cras 32617 ceph rtd unknown /proc/32617/root (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-cras 32617 ceph txt unknown /proc/32617/exe (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-cras 32617 ceph NOFD /proc/32617/fd (opendir: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 39108 root cwd unknown /proc/39108/cwd (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 39108 root rtd unknown /proc/39108/root (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 39108 root txt unknown /proc/39108/exe (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 39108 root NOFD /proc/39108/fd (opendir: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39634 root cwd unknown /proc/39634/cwd (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39634 root rtd unknown /proc/39634/root (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39634 root txt unknown /proc/39634/exe (readlink: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39634 root NOFD /proc/39634/fd (opendir: Permission denied) 2024-04-19T03:38:43.603 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39637 root cwd unknown /proc/39637/cwd (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39637 root rtd unknown /proc/39637/root (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39637 root txt unknown /proc/39637/exe (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39637 root NOFD /proc/39637/fd (opendir: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39643 root cwd unknown /proc/39643/cwd (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39643 root rtd unknown /proc/39643/root (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39643 root txt unknown /proc/39643/exe (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39643 root NOFD /proc/39643/fd (opendir: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39650 root cwd unknown /proc/39650/cwd (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39650 root rtd unknown /proc/39650/root (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39650 root txt unknown /proc/39650/exe (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39650 root NOFD /proc/39650/fd (opendir: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39659 root cwd unknown /proc/39659/cwd (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39659 root rtd unknown /proc/39659/root (readlink: Permission denied) 2024-04-19T03:38:43.604 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39659 root txt unknown /proc/39659/exe (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 39659 root NOFD /proc/39659/fd (opendir: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39751 root cwd unknown /proc/39751/cwd (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39751 root rtd unknown /proc/39751/root (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39751 root txt unknown /proc/39751/exe (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39751 root NOFD /proc/39751/fd (opendir: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39752 root cwd unknown /proc/39752/cwd (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39752 root rtd unknown /proc/39752/root (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39752 root txt unknown /proc/39752/exe (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39752 root NOFD /proc/39752/fd (opendir: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39756 root cwd unknown /proc/39756/cwd (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39756 root rtd unknown /proc/39756/root (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39756 root txt unknown /proc/39756/exe (readlink: Permission denied) 2024-04-19T03:38:43.605 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39756 root NOFD /proc/39756/fd (opendir: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39759 root cwd unknown /proc/39759/cwd (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39759 root rtd unknown /proc/39759/root (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39759 root txt unknown /proc/39759/exe (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39759 root NOFD /proc/39759/fd (opendir: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39763 root cwd unknown /proc/39763/cwd (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39763 root rtd unknown /proc/39763/root (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39763 root txt unknown /proc/39763/exe (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 39763 root NOFD /proc/39763/fd (opendir: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 root cwd unknown /proc/39765/cwd (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 root rtd unknown /proc/39765/root (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 root txt unknown /proc/39765/exe (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 root NOFD /proc/39765/fd (opendir: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39768 log root cwd unknown /proc/39765/task/39768/cwd (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39768 log root rtd unknown /proc/39765/task/39768/root (readlink: Permission denied) 2024-04-19T03:38:43.606 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39768 log root txt unknown /proc/39765/task/39768/exe (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39768 log root NOFD /proc/39765/task/39768/fd (opendir: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39769 service root cwd unknown /proc/39765/task/39769/cwd (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39769 service root rtd unknown /proc/39765/task/39769/root (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39769 service root txt unknown /proc/39765/task/39769/exe (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39769 service root NOFD /proc/39765/task/39769/fd (opendir: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39770 admin_soc root cwd unknown /proc/39765/task/39770/cwd (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39770 admin_soc root rtd unknown /proc/39765/task/39770/root (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39770 admin_soc root txt unknown /proc/39765/task/39770/exe (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39770 admin_soc root NOFD /proc/39765/task/39770/fd (opendir: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39772 signal_ha root cwd unknown /proc/39765/task/39772/cwd (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39772 signal_ha root rtd unknown /proc/39765/task/39772/root (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39772 signal_ha root txt unknown /proc/39765/task/39772/exe (readlink: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39772 signal_ha root NOFD /proc/39765/task/39772/fd (opendir: Permission denied) 2024-04-19T03:38:43.607 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39773 rocksdb:l root cwd unknown /proc/39765/task/39773/cwd (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39773 rocksdb:l root rtd unknown /proc/39765/task/39773/root (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39773 rocksdb:l root txt unknown /proc/39765/task/39773/exe (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39773 rocksdb:l root NOFD /proc/39765/task/39773/fd (opendir: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39774 rocksdb:h root cwd unknown /proc/39765/task/39774/cwd (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39774 rocksdb:h root rtd unknown /proc/39765/task/39774/root (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39774 rocksdb:h root txt unknown /proc/39765/task/39774/exe (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39774 rocksdb:h root NOFD /proc/39765/task/39774/fd (opendir: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39790 ceph-mon root cwd unknown /proc/39765/task/39790/cwd (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39790 ceph-mon root rtd unknown /proc/39765/task/39790/root (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39790 ceph-mon root txt unknown /proc/39765/task/39790/exe (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39790 ceph-mon root NOFD /proc/39765/task/39790/fd (opendir: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39791 fn_monsto root cwd unknown /proc/39765/task/39791/cwd (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39791 fn_monsto root rtd unknown /proc/39765/task/39791/root (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39791 fn_monsto root txt unknown /proc/39765/task/39791/exe (readlink: Permission denied) 2024-04-19T03:38:43.608 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39791 fn_monsto root NOFD /proc/39765/task/39791/fd (opendir: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39792 msgr-work root cwd unknown /proc/39765/task/39792/cwd (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39792 msgr-work root rtd unknown /proc/39765/task/39792/root (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39792 msgr-work root txt unknown /proc/39765/task/39792/exe (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39792 msgr-work root NOFD /proc/39765/task/39792/fd (opendir: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39793 msgr-work root cwd unknown /proc/39765/task/39793/cwd (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39793 msgr-work root rtd unknown /proc/39765/task/39793/root (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39793 msgr-work root txt unknown /proc/39765/task/39793/exe (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39793 msgr-work root NOFD /proc/39765/task/39793/fd (opendir: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39794 msgr-work root cwd unknown /proc/39765/task/39794/cwd (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39794 msgr-work root rtd unknown /proc/39765/task/39794/root (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39794 msgr-work root txt unknown /proc/39765/task/39794/exe (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39794 msgr-work root NOFD /proc/39765/task/39794/fd (opendir: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39796 OpHistory root cwd unknown /proc/39765/task/39796/cwd (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39796 OpHistory root rtd unknown /proc/39765/task/39796/root (readlink: Permission denied) 2024-04-19T03:38:43.609 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39796 OpHistory root txt unknown /proc/39765/task/39796/exe (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39796 OpHistory root NOFD /proc/39765/task/39796/fd (opendir: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39797 fin root cwd unknown /proc/39765/task/39797/cwd (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39797 fin root rtd unknown /proc/39765/task/39797/root (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39797 fin root txt unknown /proc/39765/task/39797/exe (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39797 fin root NOFD /proc/39765/task/39797/fd (opendir: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39798 safe_time root cwd unknown /proc/39765/task/39798/cwd (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39798 safe_time root rtd unknown /proc/39765/task/39798/root (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39798 safe_time root txt unknown /proc/39765/task/39798/exe (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39798 safe_time root NOFD /proc/39765/task/39798/fd (opendir: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39799 cpu_tp root cwd unknown /proc/39765/task/39799/cwd (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39799 cpu_tp root rtd unknown /proc/39765/task/39799/root (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39799 cpu_tp root txt unknown /proc/39765/task/39799/exe (readlink: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39799 cpu_tp root NOFD /proc/39765/task/39799/fd (opendir: Permission denied) 2024-04-19T03:38:43.610 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39800 cpu_tp root cwd unknown /proc/39765/task/39800/cwd (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39800 cpu_tp root rtd unknown /proc/39765/task/39800/root (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39800 cpu_tp root txt unknown /proc/39765/task/39800/exe (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39800 cpu_tp root NOFD /proc/39765/task/39800/fd (opendir: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39801 cpu_tp root cwd unknown /proc/39765/task/39801/cwd (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39801 cpu_tp root rtd unknown /proc/39765/task/39801/root (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39801 cpu_tp root txt unknown /proc/39765/task/39801/exe (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39801 cpu_tp root NOFD /proc/39765/task/39801/fd (opendir: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39802 cpu_tp root cwd unknown /proc/39765/task/39802/cwd (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39802 cpu_tp root rtd unknown /proc/39765/task/39802/root (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39802 cpu_tp root txt unknown /proc/39765/task/39802/exe (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39802 cpu_tp root NOFD /proc/39765/task/39802/fd (opendir: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39803 ms_dispat root cwd unknown /proc/39765/task/39803/cwd (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39803 ms_dispat root rtd unknown /proc/39765/task/39803/root (readlink: Permission denied) 2024-04-19T03:38:43.611 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39803 ms_dispat root txt unknown /proc/39765/task/39803/exe (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39803 ms_dispat root NOFD /proc/39765/task/39803/fd (opendir: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39804 ms_local root cwd unknown /proc/39765/task/39804/cwd (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39804 ms_local root rtd unknown /proc/39765/task/39804/root (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39804 ms_local root txt unknown /proc/39765/task/39804/exe (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39804 ms_local root NOFD /proc/39765/task/39804/fd (opendir: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39805 safe_time root cwd unknown /proc/39765/task/39805/cwd (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39805 safe_time root rtd unknown /proc/39765/task/39805/root (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39805 safe_time root txt unknown /proc/39765/task/39805/exe (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39805 safe_time root NOFD /proc/39765/task/39805/fd (opendir: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39806 ms_dispat root cwd unknown /proc/39765/task/39806/cwd (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39806 ms_dispat root rtd unknown /proc/39765/task/39806/root (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39806 ms_dispat root txt unknown /proc/39765/task/39806/exe (readlink: Permission denied) 2024-04-19T03:38:43.612 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39806 ms_dispat root NOFD /proc/39765/task/39806/fd (opendir: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39807 ms_local root cwd unknown /proc/39765/task/39807/cwd (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39807 ms_local root rtd unknown /proc/39765/task/39807/root (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39807 ms_local root txt unknown /proc/39765/task/39807/exe (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39765 39807 ms_local root NOFD /proc/39765/task/39807/fd (opendir: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 root cwd unknown /proc/39766/cwd (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 root rtd unknown /proc/39766/root (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 root txt unknown /proc/39766/exe (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 root NOFD /proc/39766/fd (opendir: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39812 log root cwd unknown /proc/39766/task/39812/cwd (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39812 log root rtd unknown /proc/39766/task/39812/root (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39812 log root txt unknown /proc/39766/task/39812/exe (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39812 log root NOFD /proc/39766/task/39812/fd (opendir: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39813 service root cwd unknown /proc/39766/task/39813/cwd (readlink: Permission denied) 2024-04-19T03:38:43.613 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39813 service root rtd unknown /proc/39766/task/39813/root (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39813 service root txt unknown /proc/39766/task/39813/exe (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39813 service root NOFD /proc/39766/task/39813/fd (opendir: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39814 admin_soc root cwd unknown /proc/39766/task/39814/cwd (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39814 admin_soc root rtd unknown /proc/39766/task/39814/root (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39814 admin_soc root txt unknown /proc/39766/task/39814/exe (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39814 admin_soc root NOFD /proc/39766/task/39814/fd (opendir: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39846 signal_ha root cwd unknown /proc/39766/task/39846/cwd (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39846 signal_ha root rtd unknown /proc/39766/task/39846/root (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39846 signal_ha root txt unknown /proc/39766/task/39846/exe (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39846 signal_ha root NOFD /proc/39766/task/39846/fd (opendir: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39852 rocksdb:l root cwd unknown /proc/39766/task/39852/cwd (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39852 rocksdb:l root rtd unknown /proc/39766/task/39852/root (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39852 rocksdb:l root txt unknown /proc/39766/task/39852/exe (readlink: Permission denied) 2024-04-19T03:38:43.614 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39852 rocksdb:l root NOFD /proc/39766/task/39852/fd (opendir: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39854 rocksdb:h root cwd unknown /proc/39766/task/39854/cwd (readlink: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39854 rocksdb:h root rtd unknown /proc/39766/task/39854/root (readlink: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39854 rocksdb:h root txt unknown /proc/39766/task/39854/exe (readlink: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39854 rocksdb:h root NOFD /proc/39766/task/39854/fd (opendir: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39875 ceph-mon root cwd unknown /proc/39766/task/39875/cwd (readlink: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39875 ceph-mon root rtd unknown /proc/39766/task/39875/root (readlink: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39875 ceph-mon root txt unknown /proc/39766/task/39875/exe (readlink: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39875 ceph-mon root NOFD /proc/39766/task/39875/fd (opendir: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39876 fn_monsto root cwd unknown /proc/39766/task/39876/cwd (readlink: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39876 fn_monsto root rtd unknown /proc/39766/task/39876/root (readlink: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39876 fn_monsto root txt unknown /proc/39766/task/39876/exe (readlink: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39876 fn_monsto root NOFD /proc/39766/task/39876/fd (opendir: Permission denied) 2024-04-19T03:38:43.615 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39885 msgr-work root cwd unknown /proc/39766/task/39885/cwd (readlink: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39885 msgr-work root rtd unknown /proc/39766/task/39885/root (readlink: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39885 msgr-work root txt unknown /proc/39766/task/39885/exe (readlink: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39885 msgr-work root NOFD /proc/39766/task/39885/fd (opendir: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39886 msgr-work root cwd unknown /proc/39766/task/39886/cwd (readlink: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39886 msgr-work root rtd unknown /proc/39766/task/39886/root (readlink: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39886 msgr-work root txt unknown /proc/39766/task/39886/exe (readlink: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39886 msgr-work root NOFD /proc/39766/task/39886/fd (opendir: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39887 msgr-work root cwd unknown /proc/39766/task/39887/cwd (readlink: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39887 msgr-work root rtd unknown /proc/39766/task/39887/root (readlink: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39887 msgr-work root txt unknown /proc/39766/task/39887/exe (readlink: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39887 msgr-work root NOFD /proc/39766/task/39887/fd (opendir: Permission denied) 2024-04-19T03:38:43.616 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39888 OpHistory root cwd unknown /proc/39766/task/39888/cwd (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39888 OpHistory root rtd unknown /proc/39766/task/39888/root (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39888 OpHistory root txt unknown /proc/39766/task/39888/exe (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39888 OpHistory root NOFD /proc/39766/task/39888/fd (opendir: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39889 fin root cwd unknown /proc/39766/task/39889/cwd (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39889 fin root rtd unknown /proc/39766/task/39889/root (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39889 fin root txt unknown /proc/39766/task/39889/exe (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39889 fin root NOFD /proc/39766/task/39889/fd (opendir: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39890 safe_time root cwd unknown /proc/39766/task/39890/cwd (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39890 safe_time root rtd unknown /proc/39766/task/39890/root (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39890 safe_time root txt unknown /proc/39766/task/39890/exe (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39890 safe_time root NOFD /proc/39766/task/39890/fd (opendir: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39891 cpu_tp root cwd unknown /proc/39766/task/39891/cwd (readlink: Permission denied) 2024-04-19T03:38:43.617 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39891 cpu_tp root rtd unknown /proc/39766/task/39891/root (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39891 cpu_tp root txt unknown /proc/39766/task/39891/exe (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39891 cpu_tp root NOFD /proc/39766/task/39891/fd (opendir: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39892 cpu_tp root cwd unknown /proc/39766/task/39892/cwd (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39892 cpu_tp root rtd unknown /proc/39766/task/39892/root (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39892 cpu_tp root txt unknown /proc/39766/task/39892/exe (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39892 cpu_tp root NOFD /proc/39766/task/39892/fd (opendir: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39893 cpu_tp root cwd unknown /proc/39766/task/39893/cwd (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39893 cpu_tp root rtd unknown /proc/39766/task/39893/root (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39893 cpu_tp root txt unknown /proc/39766/task/39893/exe (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39893 cpu_tp root NOFD /proc/39766/task/39893/fd (opendir: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39894 cpu_tp root cwd unknown /proc/39766/task/39894/cwd (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39894 cpu_tp root rtd unknown /proc/39766/task/39894/root (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39894 cpu_tp root txt unknown /proc/39766/task/39894/exe (readlink: Permission denied) 2024-04-19T03:38:43.618 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39894 cpu_tp root NOFD /proc/39766/task/39894/fd (opendir: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39895 ms_dispat root cwd unknown /proc/39766/task/39895/cwd (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39895 ms_dispat root rtd unknown /proc/39766/task/39895/root (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39895 ms_dispat root txt unknown /proc/39766/task/39895/exe (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39895 ms_dispat root NOFD /proc/39766/task/39895/fd (opendir: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39896 ms_local root cwd unknown /proc/39766/task/39896/cwd (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39896 ms_local root rtd unknown /proc/39766/task/39896/root (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39896 ms_local root txt unknown /proc/39766/task/39896/exe (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39896 ms_local root NOFD /proc/39766/task/39896/fd (opendir: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39897 safe_time root cwd unknown /proc/39766/task/39897/cwd (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39897 safe_time root rtd unknown /proc/39766/task/39897/root (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39897 safe_time root txt unknown /proc/39766/task/39897/exe (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39897 safe_time root NOFD /proc/39766/task/39897/fd (opendir: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39898 ms_dispat root cwd unknown /proc/39766/task/39898/cwd (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39898 ms_dispat root rtd unknown /proc/39766/task/39898/root (readlink: Permission denied) 2024-04-19T03:38:43.619 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39898 ms_dispat root txt unknown /proc/39766/task/39898/exe (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39898 ms_dispat root NOFD /proc/39766/task/39898/fd (opendir: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39899 ms_local root cwd unknown /proc/39766/task/39899/cwd (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39899 ms_local root rtd unknown /proc/39766/task/39899/root (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39899 ms_local root txt unknown /proc/39766/task/39899/exe (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39766 39899 ms_local root NOFD /proc/39766/task/39899/fd (opendir: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 root cwd unknown /proc/39767/cwd (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 root rtd unknown /proc/39767/root (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 root txt unknown /proc/39767/exe (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 root NOFD /proc/39767/fd (opendir: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39808 log root cwd unknown /proc/39767/task/39808/cwd (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39808 log root rtd unknown /proc/39767/task/39808/root (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39808 log root txt unknown /proc/39767/task/39808/exe (readlink: Permission denied) 2024-04-19T03:38:43.620 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39808 log root NOFD /proc/39767/task/39808/fd (opendir: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39809 service root cwd unknown /proc/39767/task/39809/cwd (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39809 service root rtd unknown /proc/39767/task/39809/root (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39809 service root txt unknown /proc/39767/task/39809/exe (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39809 service root NOFD /proc/39767/task/39809/fd (opendir: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39810 admin_soc root cwd unknown /proc/39767/task/39810/cwd (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39810 admin_soc root rtd unknown /proc/39767/task/39810/root (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39810 admin_soc root txt unknown /proc/39767/task/39810/exe (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39810 admin_soc root NOFD /proc/39767/task/39810/fd (opendir: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39811 signal_ha root cwd unknown /proc/39767/task/39811/cwd (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39811 signal_ha root rtd unknown /proc/39767/task/39811/root (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39811 signal_ha root txt unknown /proc/39767/task/39811/exe (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39811 signal_ha root NOFD /proc/39767/task/39811/fd (opendir: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39815 rocksdb:l root cwd unknown /proc/39767/task/39815/cwd (readlink: Permission denied) 2024-04-19T03:38:43.621 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39815 rocksdb:l root rtd unknown /proc/39767/task/39815/root (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39815 rocksdb:l root txt unknown /proc/39767/task/39815/exe (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39815 rocksdb:l root NOFD /proc/39767/task/39815/fd (opendir: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39816 rocksdb:h root cwd unknown /proc/39767/task/39816/cwd (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39816 rocksdb:h root rtd unknown /proc/39767/task/39816/root (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39816 rocksdb:h root txt unknown /proc/39767/task/39816/exe (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39816 rocksdb:h root NOFD /proc/39767/task/39816/fd (opendir: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39833 ceph-mon root cwd unknown /proc/39767/task/39833/cwd (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39833 ceph-mon root rtd unknown /proc/39767/task/39833/root (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39833 ceph-mon root txt unknown /proc/39767/task/39833/exe (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39833 ceph-mon root NOFD /proc/39767/task/39833/fd (opendir: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39834 fn_monsto root cwd unknown /proc/39767/task/39834/cwd (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39834 fn_monsto root rtd unknown /proc/39767/task/39834/root (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39834 fn_monsto root txt unknown /proc/39767/task/39834/exe (readlink: Permission denied) 2024-04-19T03:38:43.622 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39834 fn_monsto root NOFD /proc/39767/task/39834/fd (opendir: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39839 msgr-work root cwd unknown /proc/39767/task/39839/cwd (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39839 msgr-work root rtd unknown /proc/39767/task/39839/root (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39839 msgr-work root txt unknown /proc/39767/task/39839/exe (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39839 msgr-work root NOFD /proc/39767/task/39839/fd (opendir: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39840 msgr-work root cwd unknown /proc/39767/task/39840/cwd (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39840 msgr-work root rtd unknown /proc/39767/task/39840/root (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39840 msgr-work root txt unknown /proc/39767/task/39840/exe (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39840 msgr-work root NOFD /proc/39767/task/39840/fd (opendir: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39841 msgr-work root cwd unknown /proc/39767/task/39841/cwd (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39841 msgr-work root rtd unknown /proc/39767/task/39841/root (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39841 msgr-work root txt unknown /proc/39767/task/39841/exe (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39841 msgr-work root NOFD /proc/39767/task/39841/fd (opendir: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39844 OpHistory root cwd unknown /proc/39767/task/39844/cwd (readlink: Permission denied) 2024-04-19T03:38:43.623 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39844 OpHistory root rtd unknown /proc/39767/task/39844/root (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39844 OpHistory root txt unknown /proc/39767/task/39844/exe (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39844 OpHistory root NOFD /proc/39767/task/39844/fd (opendir: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39847 fin root cwd unknown /proc/39767/task/39847/cwd (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39847 fin root rtd unknown /proc/39767/task/39847/root (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39847 fin root txt unknown /proc/39767/task/39847/exe (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39847 fin root NOFD /proc/39767/task/39847/fd (opendir: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39848 safe_time root cwd unknown /proc/39767/task/39848/cwd (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39848 safe_time root rtd unknown /proc/39767/task/39848/root (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39848 safe_time root txt unknown /proc/39767/task/39848/exe (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39848 safe_time root NOFD /proc/39767/task/39848/fd (opendir: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39849 cpu_tp root cwd unknown /proc/39767/task/39849/cwd (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39849 cpu_tp root rtd unknown /proc/39767/task/39849/root (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39849 cpu_tp root txt unknown /proc/39767/task/39849/exe (readlink: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39849 cpu_tp root NOFD /proc/39767/task/39849/fd (opendir: Permission denied) 2024-04-19T03:38:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39850 cpu_tp root cwd unknown /proc/39767/task/39850/cwd (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39850 cpu_tp root rtd unknown /proc/39767/task/39850/root (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39850 cpu_tp root txt unknown /proc/39767/task/39850/exe (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39850 cpu_tp root NOFD /proc/39767/task/39850/fd (opendir: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39851 cpu_tp root cwd unknown /proc/39767/task/39851/cwd (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39851 cpu_tp root rtd unknown /proc/39767/task/39851/root (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39851 cpu_tp root txt unknown /proc/39767/task/39851/exe (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39851 cpu_tp root NOFD /proc/39767/task/39851/fd (opendir: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39853 cpu_tp root cwd unknown /proc/39767/task/39853/cwd (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39853 cpu_tp root rtd unknown /proc/39767/task/39853/root (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39853 cpu_tp root txt unknown /proc/39767/task/39853/exe (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39853 cpu_tp root NOFD /proc/39767/task/39853/fd (opendir: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39855 ms_dispat root cwd unknown /proc/39767/task/39855/cwd (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39855 ms_dispat root rtd unknown /proc/39767/task/39855/root (readlink: Permission denied) 2024-04-19T03:38:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39855 ms_dispat root txt unknown /proc/39767/task/39855/exe (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39855 ms_dispat root NOFD /proc/39767/task/39855/fd (opendir: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39856 ms_local root cwd unknown /proc/39767/task/39856/cwd (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39856 ms_local root rtd unknown /proc/39767/task/39856/root (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39856 ms_local root txt unknown /proc/39767/task/39856/exe (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39856 ms_local root NOFD /proc/39767/task/39856/fd (opendir: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39857 safe_time root cwd unknown /proc/39767/task/39857/cwd (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39857 safe_time root rtd unknown /proc/39767/task/39857/root (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39857 safe_time root txt unknown /proc/39767/task/39857/exe (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39857 safe_time root NOFD /proc/39767/task/39857/fd (opendir: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39858 ms_dispat root cwd unknown /proc/39767/task/39858/cwd (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39858 ms_dispat root rtd unknown /proc/39767/task/39858/root (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39858 ms_dispat root txt unknown /proc/39767/task/39858/exe (readlink: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39858 ms_dispat root NOFD /proc/39767/task/39858/fd (opendir: Permission denied) 2024-04-19T03:38:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39859 ms_local root cwd unknown /proc/39767/task/39859/cwd (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39859 ms_local root rtd unknown /proc/39767/task/39859/root (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39859 ms_local root txt unknown /proc/39767/task/39859/exe (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 39767 39859 ms_local root NOFD /proc/39767/task/39859/fd (opendir: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 root cwd unknown /proc/39771/cwd (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 root rtd unknown /proc/39771/root (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 root txt unknown /proc/39771/exe (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 root NOFD /proc/39771/fd (opendir: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39832 log root cwd unknown /proc/39771/task/39832/cwd (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39832 log root rtd unknown /proc/39771/task/39832/root (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39832 log root txt unknown /proc/39771/task/39832/exe (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39832 log root NOFD /proc/39771/task/39832/fd (opendir: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39836 msgr-work root cwd unknown /proc/39771/task/39836/cwd (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39836 msgr-work root rtd unknown /proc/39771/task/39836/root (readlink: Permission denied) 2024-04-19T03:38:43.627 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39836 msgr-work root txt unknown /proc/39771/task/39836/exe (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39836 msgr-work root NOFD /proc/39771/task/39836/fd (opendir: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39837 msgr-work root cwd unknown /proc/39771/task/39837/cwd (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39837 msgr-work root rtd unknown /proc/39771/task/39837/root (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39837 msgr-work root txt unknown /proc/39771/task/39837/exe (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39837 msgr-work root NOFD /proc/39771/task/39837/fd (opendir: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39838 msgr-work root cwd unknown /proc/39771/task/39838/cwd (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39838 msgr-work root rtd unknown /proc/39771/task/39838/root (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39838 msgr-work root txt unknown /proc/39771/task/39838/exe (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39838 msgr-work root NOFD /proc/39771/task/39838/fd (opendir: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39923 service root cwd unknown /proc/39771/task/39923/cwd (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39923 service root rtd unknown /proc/39771/task/39923/root (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39923 service root txt unknown /proc/39771/task/39923/exe (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39923 service root NOFD /proc/39771/task/39923/fd (opendir: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39924 admin_soc root cwd unknown /proc/39771/task/39924/cwd (readlink: Permission denied) 2024-04-19T03:38:43.628 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39924 admin_soc root rtd unknown /proc/39771/task/39924/root (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39924 admin_soc root txt unknown /proc/39771/task/39924/exe (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39924 admin_soc root NOFD /proc/39771/task/39924/fd (opendir: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39925 ceph_time root cwd unknown /proc/39771/task/39925/cwd (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39925 ceph_time root rtd unknown /proc/39771/task/39925/root (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39925 ceph_time root txt unknown /proc/39771/task/39925/exe (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39925 ceph_time root NOFD /proc/39771/task/39925/fd (opendir: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39926 fn_anonym root cwd unknown /proc/39771/task/39926/cwd (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39926 fn_anonym root rtd unknown /proc/39771/task/39926/root (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39926 fn_anonym root txt unknown /proc/39771/task/39926/exe (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39926 fn_anonym root NOFD /proc/39771/task/39926/fd (opendir: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39927 signal_ha root cwd unknown /proc/39771/task/39927/cwd (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39927 signal_ha root rtd unknown /proc/39771/task/39927/root (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39927 signal_ha root txt unknown /proc/39771/task/39927/exe (readlink: Permission denied) 2024-04-19T03:38:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39927 signal_ha root NOFD /proc/39771/task/39927/fd (opendir: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39928 mgrsb-fin root cwd unknown /proc/39771/task/39928/cwd (readlink: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39928 mgrsb-fin root rtd unknown /proc/39771/task/39928/root (readlink: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39928 mgrsb-fin root txt unknown /proc/39771/task/39928/exe (readlink: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39928 mgrsb-fin root NOFD /proc/39771/task/39928/fd (opendir: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39929 ms_dispat root cwd unknown /proc/39771/task/39929/cwd (readlink: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39929 ms_dispat root rtd unknown /proc/39771/task/39929/root (readlink: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39929 ms_dispat root txt unknown /proc/39771/task/39929/exe (readlink: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39929 ms_dispat root NOFD /proc/39771/task/39929/fd (opendir: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39930 ms_local root cwd unknown /proc/39771/task/39930/cwd (readlink: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39930 ms_local root rtd unknown /proc/39771/task/39930/root (readlink: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39930 ms_local root txt unknown /proc/39771/task/39930/exe (readlink: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39930 ms_local root NOFD /proc/39771/task/39930/fd (opendir: Permission denied) 2024-04-19T03:38:43.630 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39931 io_contex root cwd unknown /proc/39771/task/39931/cwd (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39931 io_contex root rtd unknown /proc/39771/task/39931/root (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39931 io_contex root txt unknown /proc/39771/task/39931/exe (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39931 io_contex root NOFD /proc/39771/task/39931/fd (opendir: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39932 io_contex root cwd unknown /proc/39771/task/39932/cwd (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39932 io_contex root rtd unknown /proc/39771/task/39932/root (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39932 io_contex root txt unknown /proc/39771/task/39932/exe (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39932 io_contex root NOFD /proc/39771/task/39932/fd (opendir: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39933 safe_time root cwd unknown /proc/39771/task/39933/cwd (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39933 safe_time root rtd unknown /proc/39771/task/39933/root (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39933 safe_time root txt unknown /proc/39771/task/39933/exe (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39933 safe_time root NOFD /proc/39771/task/39933/fd (opendir: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39934 safe_time root cwd unknown /proc/39771/task/39934/cwd (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39934 safe_time root rtd unknown /proc/39771/task/39934/root (readlink: Permission denied) 2024-04-19T03:38:43.631 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39934 safe_time root txt unknown /proc/39771/task/39934/exe (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39934 safe_time root NOFD /proc/39771/task/39934/fd (opendir: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39935 safe_time root cwd unknown /proc/39771/task/39935/cwd (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39935 safe_time root rtd unknown /proc/39771/task/39935/root (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39935 safe_time root txt unknown /proc/39771/task/39935/exe (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39935 safe_time root NOFD /proc/39771/task/39935/fd (opendir: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39936 fn_anonym root cwd unknown /proc/39771/task/39936/cwd (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39936 fn_anonym root rtd unknown /proc/39771/task/39936/root (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39936 fn_anonym root txt unknown /proc/39771/task/39936/exe (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39936 fn_anonym root NOFD /proc/39771/task/39936/fd (opendir: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39937 flusher root cwd unknown /proc/39771/task/39937/cwd (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39937 flusher root rtd unknown /proc/39771/task/39937/root (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39937 flusher root txt unknown /proc/39771/task/39937/exe (readlink: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39937 flusher root NOFD /proc/39771/task/39937/fd (opendir: Permission denied) 2024-04-19T03:38:43.632 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39938 safe_time root cwd unknown /proc/39771/task/39938/cwd (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39938 safe_time root rtd unknown /proc/39771/task/39938/root (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39938 safe_time root txt unknown /proc/39771/task/39938/exe (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 39938 safe_time root NOFD /proc/39771/task/39938/fd (opendir: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40166 mgr-fin root cwd unknown /proc/39771/task/40166/cwd (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40166 mgr-fin root rtd unknown /proc/39771/task/40166/root (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40166 mgr-fin root txt unknown /proc/39771/task/40166/exe (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40166 mgr-fin root NOFD /proc/39771/task/40166/fd (opendir: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40167 ms_dispat root cwd unknown /proc/39771/task/40167/cwd (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40167 ms_dispat root rtd unknown /proc/39771/task/40167/root (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40167 ms_dispat root txt unknown /proc/39771/task/40167/exe (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40167 ms_dispat root NOFD /proc/39771/task/40167/fd (opendir: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40168 ms_local root cwd unknown /proc/39771/task/40168/cwd (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40168 ms_local root rtd unknown /proc/39771/task/40168/root (readlink: Permission denied) 2024-04-19T03:38:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40168 ms_local root txt unknown /proc/39771/task/40168/exe (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40168 ms_local root NOFD /proc/39771/task/40168/fd (opendir: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40169 safe_time root cwd unknown /proc/39771/task/40169/cwd (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40169 safe_time root rtd unknown /proc/39771/task/40169/root (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40169 safe_time root txt unknown /proc/39771/task/40169/exe (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40169 safe_time root NOFD /proc/39771/task/40169/fd (opendir: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40170 cmdfin root cwd unknown /proc/39771/task/40170/cwd (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40170 cmdfin root rtd unknown /proc/39771/task/40170/root (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40170 cmdfin root txt unknown /proc/39771/task/40170/exe (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40170 cmdfin root NOFD /proc/39771/task/40170/fd (opendir: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40174 io_contex root cwd unknown /proc/39771/task/40174/cwd (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40174 io_contex root rtd unknown /proc/39771/task/40174/root (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40174 io_contex root txt unknown /proc/39771/task/40174/exe (readlink: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40174 io_contex root NOFD /proc/39771/task/40174/fd (opendir: Permission denied) 2024-04-19T03:38:43.634 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40175 io_contex root cwd unknown /proc/39771/task/40175/cwd (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40175 io_contex root rtd unknown /proc/39771/task/40175/root (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40175 io_contex root txt unknown /proc/39771/task/40175/exe (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40175 io_contex root NOFD /proc/39771/task/40175/fd (opendir: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40176 ceph_time root cwd unknown /proc/39771/task/40176/cwd (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40176 ceph_time root rtd unknown /proc/39771/task/40176/root (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40176 ceph_time root txt unknown /proc/39771/task/40176/exe (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40176 ceph_time root NOFD /proc/39771/task/40176/fd (opendir: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40177 ms_dispat root cwd unknown /proc/39771/task/40177/cwd (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40177 ms_dispat root rtd unknown /proc/39771/task/40177/root (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40177 ms_dispat root txt unknown /proc/39771/task/40177/exe (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40177 ms_dispat root NOFD /proc/39771/task/40177/fd (opendir: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40178 ms_local root cwd unknown /proc/39771/task/40178/cwd (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40178 ms_local root rtd unknown /proc/39771/task/40178/root (readlink: Permission denied) 2024-04-19T03:38:43.635 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40178 ms_local root txt unknown /proc/39771/task/40178/exe (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40178 ms_local root NOFD /proc/39771/task/40178/fd (opendir: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40179 safe_time root cwd unknown /proc/39771/task/40179/cwd (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40179 safe_time root rtd unknown /proc/39771/task/40179/root (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40179 safe_time root txt unknown /proc/39771/task/40179/exe (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40179 safe_time root NOFD /proc/39771/task/40179/fd (opendir: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40180 safe_time root cwd unknown /proc/39771/task/40180/cwd (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40180 safe_time root rtd unknown /proc/39771/task/40180/root (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40180 safe_time root txt unknown /proc/39771/task/40180/exe (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40180 safe_time root NOFD /proc/39771/task/40180/fd (opendir: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40181 balancer root cwd unknown /proc/39771/task/40181/cwd (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40181 balancer root rtd unknown /proc/39771/task/40181/root (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40181 balancer root txt unknown /proc/39771/task/40181/exe (readlink: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40181 balancer root NOFD /proc/39771/task/40181/fd (opendir: Permission denied) 2024-04-19T03:38:43.636 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40182 m-fin-bal root cwd unknown /proc/39771/task/40182/cwd (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40182 m-fin-bal root rtd unknown /proc/39771/task/40182/root (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40182 m-fin-bal root txt unknown /proc/39771/task/40182/exe (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40182 m-fin-bal root NOFD /proc/39771/task/40182/fd (opendir: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40183 crash root cwd unknown /proc/39771/task/40183/cwd (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40183 crash root rtd unknown /proc/39771/task/40183/root (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40183 crash root txt unknown /proc/39771/task/40183/exe (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40183 crash root NOFD /proc/39771/task/40183/fd (opendir: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40184 m-fin-cra root cwd unknown /proc/39771/task/40184/cwd (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40184 m-fin-cra root rtd unknown /proc/39771/task/40184/root (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40184 m-fin-cra root txt unknown /proc/39771/task/40184/exe (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40184 m-fin-cra root NOFD /proc/39771/task/40184/fd (opendir: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40185 devicehea root cwd unknown /proc/39771/task/40185/cwd (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40185 devicehea root rtd unknown /proc/39771/task/40185/root (readlink: Permission denied) 2024-04-19T03:38:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40185 devicehea root txt unknown /proc/39771/task/40185/exe (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40185 devicehea root NOFD /proc/39771/task/40185/fd (opendir: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40186 m-fin-dev root cwd unknown /proc/39771/task/40186/cwd (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40186 m-fin-dev root rtd unknown /proc/39771/task/40186/root (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40186 m-fin-dev root txt unknown /proc/39771/task/40186/exe (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40186 m-fin-dev root NOFD /proc/39771/task/40186/fd (opendir: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40188 m-fin-ios root cwd unknown /proc/39771/task/40188/cwd (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40188 m-fin-ios root rtd unknown /proc/39771/task/40188/root (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40188 m-fin-ios root txt unknown /proc/39771/task/40188/exe (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40188 m-fin-ios root NOFD /proc/39771/task/40188/fd (opendir: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40190 m-fin-nfs root cwd unknown /proc/39771/task/40190/cwd (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40190 m-fin-nfs root rtd unknown /proc/39771/task/40190/root (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40190 m-fin-nfs root txt unknown /proc/39771/task/40190/exe (readlink: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40190 m-fin-nfs root NOFD /proc/39771/task/40190/fd (opendir: Permission denied) 2024-04-19T03:38:43.638 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40192 m-fin-orc root cwd unknown /proc/39771/task/40192/cwd (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40192 m-fin-orc root rtd unknown /proc/39771/task/40192/root (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40192 m-fin-orc root txt unknown /proc/39771/task/40192/exe (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40192 m-fin-orc root NOFD /proc/39771/task/40192/fd (opendir: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40193 pg_autosc root cwd unknown /proc/39771/task/40193/cwd (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40193 pg_autosc root rtd unknown /proc/39771/task/40193/root (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40193 pg_autosc root txt unknown /proc/39771/task/40193/exe (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40193 pg_autosc root NOFD /proc/39771/task/40193/fd (opendir: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40194 m-fin-pg_ root cwd unknown /proc/39771/task/40194/cwd (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40194 m-fin-pg_ root rtd unknown /proc/39771/task/40194/root (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40194 m-fin-pg_ root txt unknown /proc/39771/task/40194/exe (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40194 m-fin-pg_ root NOFD /proc/39771/task/40194/fd (opendir: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40195 progress root cwd unknown /proc/39771/task/40195/cwd (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40195 progress root rtd unknown /proc/39771/task/40195/root (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40195 progress root txt unknown /proc/39771/task/40195/exe (readlink: Permission denied) 2024-04-19T03:38:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40195 progress root NOFD /proc/39771/task/40195/fd (opendir: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40196 m-fin-pro root cwd unknown /proc/39771/task/40196/cwd (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40196 m-fin-pro root rtd unknown /proc/39771/task/40196/root (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40196 m-fin-pro root txt unknown /proc/39771/task/40196/exe (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40196 m-fin-pro root NOFD /proc/39771/task/40196/fd (opendir: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40200 io_contex root cwd unknown /proc/39771/task/40200/cwd (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40200 io_contex root rtd unknown /proc/39771/task/40200/root (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40200 io_contex root txt unknown /proc/39771/task/40200/exe (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40200 io_contex root NOFD /proc/39771/task/40200/fd (opendir: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40201 io_contex root cwd unknown /proc/39771/task/40201/cwd (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40201 io_contex root rtd unknown /proc/39771/task/40201/root (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40201 io_contex root txt unknown /proc/39771/task/40201/exe (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40201 io_contex root NOFD /proc/39771/task/40201/fd (opendir: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40202 ceph_time root cwd unknown /proc/39771/task/40202/cwd (readlink: Permission denied) 2024-04-19T03:38:43.640 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40202 ceph_time root rtd unknown /proc/39771/task/40202/root (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40202 ceph_time root txt unknown /proc/39771/task/40202/exe (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40202 ceph_time root NOFD /proc/39771/task/40202/fd (opendir: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40203 ms_dispat root cwd unknown /proc/39771/task/40203/cwd (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40203 ms_dispat root rtd unknown /proc/39771/task/40203/root (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40203 ms_dispat root txt unknown /proc/39771/task/40203/exe (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40203 ms_dispat root NOFD /proc/39771/task/40203/fd (opendir: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40204 ms_local root cwd unknown /proc/39771/task/40204/cwd (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40204 ms_local root rtd unknown /proc/39771/task/40204/root (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40204 ms_local root txt unknown /proc/39771/task/40204/exe (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40204 ms_local root NOFD /proc/39771/task/40204/fd (opendir: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40205 safe_time root cwd unknown /proc/39771/task/40205/cwd (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40205 safe_time root rtd unknown /proc/39771/task/40205/root (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40205 safe_time root txt unknown /proc/39771/task/40205/exe (readlink: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40205 safe_time root NOFD /proc/39771/task/40205/fd (opendir: Permission denied) 2024-04-19T03:38:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40206 safe_time root cwd unknown /proc/39771/task/40206/cwd (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40206 safe_time root rtd unknown /proc/39771/task/40206/root (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40206 safe_time root txt unknown /proc/39771/task/40206/exe (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40206 safe_time root NOFD /proc/39771/task/40206/fd (opendir: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40207 mgr-fin root cwd unknown /proc/39771/task/40207/cwd (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40207 mgr-fin root rtd unknown /proc/39771/task/40207/root (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40207 mgr-fin root txt unknown /proc/39771/task/40207/exe (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40207 mgr-fin root NOFD /proc/39771/task/40207/fd (opendir: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40209 m-fin-rbd root cwd unknown /proc/39771/task/40209/cwd (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40209 m-fin-rbd root rtd unknown /proc/39771/task/40209/root (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40209 m-fin-rbd root txt unknown /proc/39771/task/40209/exe (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40209 m-fin-rbd root NOFD /proc/39771/task/40209/fd (opendir: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40210 restful root cwd unknown /proc/39771/task/40210/cwd (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40210 restful root rtd unknown /proc/39771/task/40210/root (readlink: Permission denied) 2024-04-19T03:38:43.642 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40210 restful root txt unknown /proc/39771/task/40210/exe (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40210 restful root NOFD /proc/39771/task/40210/fd (opendir: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40211 m-fin-res root cwd unknown /proc/39771/task/40211/cwd (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40211 m-fin-res root rtd unknown /proc/39771/task/40211/root (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40211 m-fin-res root txt unknown /proc/39771/task/40211/exe (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40211 m-fin-res root NOFD /proc/39771/task/40211/fd (opendir: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40213 m-fin-sta root cwd unknown /proc/39771/task/40213/cwd (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40213 m-fin-sta root rtd unknown /proc/39771/task/40213/root (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40213 m-fin-sta root txt unknown /proc/39771/task/40213/exe (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40213 m-fin-sta root NOFD /proc/39771/task/40213/fd (opendir: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40214 mgr-fin root cwd unknown /proc/39771/task/40214/cwd (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40214 mgr-fin root rtd unknown /proc/39771/task/40214/root (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40214 mgr-fin root txt unknown /proc/39771/task/40214/exe (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40214 mgr-fin root NOFD /proc/39771/task/40214/fd (opendir: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40215 mgr-fin root cwd unknown /proc/39771/task/40215/cwd (readlink: Permission denied) 2024-04-19T03:38:43.643 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40215 mgr-fin root rtd unknown /proc/39771/task/40215/root (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40215 mgr-fin root txt unknown /proc/39771/task/40215/exe (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40215 mgr-fin root NOFD /proc/39771/task/40215/fd (opendir: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40216 mgr-fin root cwd unknown /proc/39771/task/40216/cwd (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40216 mgr-fin root rtd unknown /proc/39771/task/40216/root (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40216 mgr-fin root txt unknown /proc/39771/task/40216/exe (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40216 mgr-fin root NOFD /proc/39771/task/40216/fd (opendir: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40217 telemetry root cwd unknown /proc/39771/task/40217/cwd (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40217 telemetry root rtd unknown /proc/39771/task/40217/root (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40217 telemetry root txt unknown /proc/39771/task/40217/exe (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40217 telemetry root NOFD /proc/39771/task/40217/fd (opendir: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40218 m-fin-tel root cwd unknown /proc/39771/task/40218/cwd (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40218 m-fin-tel root rtd unknown /proc/39771/task/40218/root (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40218 m-fin-tel root txt unknown /proc/39771/task/40218/exe (readlink: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40218 m-fin-tel root NOFD /proc/39771/task/40218/fd (opendir: Permission denied) 2024-04-19T03:38:43.644 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40219 mgr-fin root cwd unknown /proc/39771/task/40219/cwd (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40219 mgr-fin root rtd unknown /proc/39771/task/40219/root (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40219 mgr-fin root txt unknown /proc/39771/task/40219/exe (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40219 mgr-fin root NOFD /proc/39771/task/40219/fd (opendir: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40223 io_contex root cwd unknown /proc/39771/task/40223/cwd (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40223 io_contex root rtd unknown /proc/39771/task/40223/root (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40223 io_contex root txt unknown /proc/39771/task/40223/exe (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40223 io_contex root NOFD /proc/39771/task/40223/fd (opendir: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40224 io_contex root cwd unknown /proc/39771/task/40224/cwd (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40224 io_contex root rtd unknown /proc/39771/task/40224/root (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40224 io_contex root txt unknown /proc/39771/task/40224/exe (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40224 io_contex root NOFD /proc/39771/task/40224/fd (opendir: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40225 ceph_time root cwd unknown /proc/39771/task/40225/cwd (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40225 ceph_time root rtd unknown /proc/39771/task/40225/root (readlink: Permission denied) 2024-04-19T03:38:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40225 ceph_time root txt unknown /proc/39771/task/40225/exe (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40225 ceph_time root NOFD /proc/39771/task/40225/fd (opendir: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40226 ms_dispat root cwd unknown /proc/39771/task/40226/cwd (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40226 ms_dispat root rtd unknown /proc/39771/task/40226/root (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40226 ms_dispat root txt unknown /proc/39771/task/40226/exe (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40226 ms_dispat root NOFD /proc/39771/task/40226/fd (opendir: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40227 ms_local root cwd unknown /proc/39771/task/40227/cwd (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40227 ms_local root rtd unknown /proc/39771/task/40227/root (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40227 ms_local root txt unknown /proc/39771/task/40227/exe (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40227 ms_local root NOFD /proc/39771/task/40227/fd (opendir: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40228 mgr-fin root cwd unknown /proc/39771/task/40228/cwd (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40228 mgr-fin root rtd unknown /proc/39771/task/40228/root (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40228 mgr-fin root txt unknown /proc/39771/task/40228/exe (readlink: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40228 mgr-fin root NOFD /proc/39771/task/40228/fd (opendir: Permission denied) 2024-04-19T03:38:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40229 safe_time root cwd unknown /proc/39771/task/40229/cwd (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40229 safe_time root rtd unknown /proc/39771/task/40229/root (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40229 safe_time root txt unknown /proc/39771/task/40229/exe (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40229 safe_time root NOFD /proc/39771/task/40229/fd (opendir: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40230 safe_time root cwd unknown /proc/39771/task/40230/cwd (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40230 safe_time root rtd unknown /proc/39771/task/40230/root (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40230 safe_time root txt unknown /proc/39771/task/40230/exe (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40230 safe_time root NOFD /proc/39771/task/40230/fd (opendir: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40231 mgr-fin root cwd unknown /proc/39771/task/40231/cwd (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40231 mgr-fin root rtd unknown /proc/39771/task/40231/root (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40231 mgr-fin root txt unknown /proc/39771/task/40231/exe (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40231 mgr-fin root NOFD /proc/39771/task/40231/fd (opendir: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40232 mgr-fin root cwd unknown /proc/39771/task/40232/cwd (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40232 mgr-fin root rtd unknown /proc/39771/task/40232/root (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40232 mgr-fin root txt unknown /proc/39771/task/40232/exe (readlink: Permission denied) 2024-04-19T03:38:43.647 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40232 mgr-fin root NOFD /proc/39771/task/40232/fd (opendir: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40233 mgr-fin root cwd unknown /proc/39771/task/40233/cwd (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40233 mgr-fin root rtd unknown /proc/39771/task/40233/root (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40233 mgr-fin root txt unknown /proc/39771/task/40233/exe (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40233 mgr-fin root NOFD /proc/39771/task/40233/fd (opendir: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40234 mgr-fin root cwd unknown /proc/39771/task/40234/cwd (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40234 mgr-fin root rtd unknown /proc/39771/task/40234/root (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40234 mgr-fin root txt unknown /proc/39771/task/40234/exe (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40234 mgr-fin root NOFD /proc/39771/task/40234/fd (opendir: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40235 mgr-fin root cwd unknown /proc/39771/task/40235/cwd (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40235 mgr-fin root rtd unknown /proc/39771/task/40235/root (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40235 mgr-fin root txt unknown /proc/39771/task/40235/exe (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40235 mgr-fin root NOFD /proc/39771/task/40235/fd (opendir: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40236 mgr-fin root cwd unknown /proc/39771/task/40236/cwd (readlink: Permission denied) 2024-04-19T03:38:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40236 mgr-fin root rtd unknown /proc/39771/task/40236/root (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40236 mgr-fin root txt unknown /proc/39771/task/40236/exe (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40236 mgr-fin root NOFD /proc/39771/task/40236/fd (opendir: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40237 mgr-fin root cwd unknown /proc/39771/task/40237/cwd (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40237 mgr-fin root rtd unknown /proc/39771/task/40237/root (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40237 mgr-fin root txt unknown /proc/39771/task/40237/exe (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40237 mgr-fin root NOFD /proc/39771/task/40237/fd (opendir: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40238 mgr-fin root cwd unknown /proc/39771/task/40238/cwd (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40238 mgr-fin root rtd unknown /proc/39771/task/40238/root (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40238 mgr-fin root txt unknown /proc/39771/task/40238/exe (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40238 mgr-fin root NOFD /proc/39771/task/40238/fd (opendir: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40239 mgr-fin root cwd unknown /proc/39771/task/40239/cwd (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40239 mgr-fin root rtd unknown /proc/39771/task/40239/root (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40239 mgr-fin root txt unknown /proc/39771/task/40239/exe (readlink: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40239 mgr-fin root NOFD /proc/39771/task/40239/fd (opendir: Permission denied) 2024-04-19T03:38:43.649 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40240 mgr-fin root cwd unknown /proc/39771/task/40240/cwd (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40240 mgr-fin root rtd unknown /proc/39771/task/40240/root (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40240 mgr-fin root txt unknown /proc/39771/task/40240/exe (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40240 mgr-fin root NOFD /proc/39771/task/40240/fd (opendir: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40241 mgr-fin root cwd unknown /proc/39771/task/40241/cwd (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40241 mgr-fin root rtd unknown /proc/39771/task/40241/root (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40241 mgr-fin root txt unknown /proc/39771/task/40241/exe (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40241 mgr-fin root NOFD /proc/39771/task/40241/fd (opendir: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40242 mgr-fin root cwd unknown /proc/39771/task/40242/cwd (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40242 mgr-fin root rtd unknown /proc/39771/task/40242/root (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40242 mgr-fin root txt unknown /proc/39771/task/40242/exe (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40242 mgr-fin root NOFD /proc/39771/task/40242/fd (opendir: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40244 m-fin-vol root cwd unknown /proc/39771/task/40244/cwd (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40244 m-fin-vol root rtd unknown /proc/39771/task/40244/root (readlink: Permission denied) 2024-04-19T03:38:43.650 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40244 m-fin-vol root txt unknown /proc/39771/task/40244/exe (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40244 m-fin-vol root NOFD /proc/39771/task/40244/fd (opendir: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40558 devicehea root cwd unknown /proc/39771/task/40558/cwd (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40558 devicehea root rtd unknown /proc/39771/task/40558/root (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40558 devicehea root txt unknown /proc/39771/task/40558/exe (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40558 devicehea root NOFD /proc/39771/task/40558/fd (opendir: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40562 io_contex root cwd unknown /proc/39771/task/40562/cwd (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40562 io_contex root rtd unknown /proc/39771/task/40562/root (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40562 io_contex root txt unknown /proc/39771/task/40562/exe (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40562 io_contex root NOFD /proc/39771/task/40562/fd (opendir: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40563 io_contex root cwd unknown /proc/39771/task/40563/cwd (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40563 io_contex root rtd unknown /proc/39771/task/40563/root (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40563 io_contex root txt unknown /proc/39771/task/40563/exe (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40563 io_contex root NOFD /proc/39771/task/40563/fd (opendir: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40564 ceph_time root cwd unknown /proc/39771/task/40564/cwd (readlink: Permission denied) 2024-04-19T03:38:43.651 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40564 ceph_time root rtd unknown /proc/39771/task/40564/root (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40564 ceph_time root txt unknown /proc/39771/task/40564/exe (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40564 ceph_time root NOFD /proc/39771/task/40564/fd (opendir: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40565 ms_dispat root cwd unknown /proc/39771/task/40565/cwd (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40565 ms_dispat root rtd unknown /proc/39771/task/40565/root (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40565 ms_dispat root txt unknown /proc/39771/task/40565/exe (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40565 ms_dispat root NOFD /proc/39771/task/40565/fd (opendir: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40566 ms_local root cwd unknown /proc/39771/task/40566/cwd (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40566 ms_local root rtd unknown /proc/39771/task/40566/root (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40566 ms_local root txt unknown /proc/39771/task/40566/exe (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40566 ms_local root NOFD /proc/39771/task/40566/fd (opendir: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40567 safe_time root cwd unknown /proc/39771/task/40567/cwd (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40567 safe_time root rtd unknown /proc/39771/task/40567/root (readlink: Permission denied) 2024-04-19T03:38:43.652 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40567 safe_time root txt unknown /proc/39771/task/40567/exe (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40567 safe_time root NOFD /proc/39771/task/40567/fd (opendir: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40568 safe_time root cwd unknown /proc/39771/task/40568/cwd (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40568 safe_time root rtd unknown /proc/39771/task/40568/root (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40568 safe_time root txt unknown /proc/39771/task/40568/exe (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39771 40568 safe_time root NOFD /proc/39771/task/40568/fd (opendir: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 root cwd unknown /proc/39795/cwd (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 root rtd unknown /proc/39795/root (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 root txt unknown /proc/39795/exe (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 root NOFD /proc/39795/fd (opendir: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39877 log root cwd unknown /proc/39795/task/39877/cwd (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39877 log root rtd unknown /proc/39795/task/39877/root (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39877 log root txt unknown /proc/39795/task/39877/exe (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39877 log root NOFD /proc/39795/task/39877/fd (opendir: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39879 msgr-work root cwd unknown /proc/39795/task/39879/cwd (readlink: Permission denied) 2024-04-19T03:38:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39879 msgr-work root rtd unknown /proc/39795/task/39879/root (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39879 msgr-work root txt unknown /proc/39795/task/39879/exe (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39879 msgr-work root NOFD /proc/39795/task/39879/fd (opendir: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39880 msgr-work root cwd unknown /proc/39795/task/39880/cwd (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39880 msgr-work root rtd unknown /proc/39795/task/39880/root (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39880 msgr-work root txt unknown /proc/39795/task/39880/exe (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39880 msgr-work root NOFD /proc/39795/task/39880/fd (opendir: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39881 msgr-work root cwd unknown /proc/39795/task/39881/cwd (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39881 msgr-work root rtd unknown /proc/39795/task/39881/root (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39881 msgr-work root txt unknown /proc/39795/task/39881/exe (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39881 msgr-work root NOFD /proc/39795/task/39881/fd (opendir: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39939 service root cwd unknown /proc/39795/task/39939/cwd (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39939 service root rtd unknown /proc/39795/task/39939/root (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39939 service root txt unknown /proc/39795/task/39939/exe (readlink: Permission denied) 2024-04-19T03:38:43.654 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39939 service root NOFD /proc/39795/task/39939/fd (opendir: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39940 admin_soc root cwd unknown /proc/39795/task/39940/cwd (readlink: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39940 admin_soc root rtd unknown /proc/39795/task/39940/root (readlink: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39940 admin_soc root txt unknown /proc/39795/task/39940/exe (readlink: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39940 admin_soc root NOFD /proc/39795/task/39940/fd (opendir: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39941 ceph_time root cwd unknown /proc/39795/task/39941/cwd (readlink: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39941 ceph_time root rtd unknown /proc/39795/task/39941/root (readlink: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39941 ceph_time root txt unknown /proc/39795/task/39941/exe (readlink: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39941 ceph_time root NOFD /proc/39795/task/39941/fd (opendir: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39942 fn_anonym root cwd unknown /proc/39795/task/39942/cwd (readlink: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39942 fn_anonym root rtd unknown /proc/39795/task/39942/root (readlink: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39942 fn_anonym root txt unknown /proc/39795/task/39942/exe (readlink: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39942 fn_anonym root NOFD /proc/39795/task/39942/fd (opendir: Permission denied) 2024-04-19T03:38:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39943 signal_ha root cwd unknown /proc/39795/task/39943/cwd (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39943 signal_ha root rtd unknown /proc/39795/task/39943/root (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39943 signal_ha root txt unknown /proc/39795/task/39943/exe (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39943 signal_ha root NOFD /proc/39795/task/39943/fd (opendir: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39944 mgrsb-fin root cwd unknown /proc/39795/task/39944/cwd (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39944 mgrsb-fin root rtd unknown /proc/39795/task/39944/root (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39944 mgrsb-fin root txt unknown /proc/39795/task/39944/exe (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39944 mgrsb-fin root NOFD /proc/39795/task/39944/fd (opendir: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39945 ms_dispat root cwd unknown /proc/39795/task/39945/cwd (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39945 ms_dispat root rtd unknown /proc/39795/task/39945/root (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39945 ms_dispat root txt unknown /proc/39795/task/39945/exe (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39945 ms_dispat root NOFD /proc/39795/task/39945/fd (opendir: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39946 ms_local root cwd unknown /proc/39795/task/39946/cwd (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39946 ms_local root rtd unknown /proc/39795/task/39946/root (readlink: Permission denied) 2024-04-19T03:38:43.656 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39946 ms_local root txt unknown /proc/39795/task/39946/exe (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39946 ms_local root NOFD /proc/39795/task/39946/fd (opendir: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39947 io_contex root cwd unknown /proc/39795/task/39947/cwd (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39947 io_contex root rtd unknown /proc/39795/task/39947/root (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39947 io_contex root txt unknown /proc/39795/task/39947/exe (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39947 io_contex root NOFD /proc/39795/task/39947/fd (opendir: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39948 io_contex root cwd unknown /proc/39795/task/39948/cwd (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39948 io_contex root rtd unknown /proc/39795/task/39948/root (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39948 io_contex root txt unknown /proc/39795/task/39948/exe (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39948 io_contex root NOFD /proc/39795/task/39948/fd (opendir: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39949 safe_time root cwd unknown /proc/39795/task/39949/cwd (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39949 safe_time root rtd unknown /proc/39795/task/39949/root (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39949 safe_time root txt unknown /proc/39795/task/39949/exe (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39949 safe_time root NOFD /proc/39795/task/39949/fd (opendir: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39950 safe_time root cwd unknown /proc/39795/task/39950/cwd (readlink: Permission denied) 2024-04-19T03:38:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39950 safe_time root rtd unknown /proc/39795/task/39950/root (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39950 safe_time root txt unknown /proc/39795/task/39950/exe (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39950 safe_time root NOFD /proc/39795/task/39950/fd (opendir: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39951 safe_time root cwd unknown /proc/39795/task/39951/cwd (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39951 safe_time root rtd unknown /proc/39795/task/39951/root (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39951 safe_time root txt unknown /proc/39795/task/39951/exe (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39951 safe_time root NOFD /proc/39795/task/39951/fd (opendir: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39952 fn_anonym root cwd unknown /proc/39795/task/39952/cwd (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39952 fn_anonym root rtd unknown /proc/39795/task/39952/root (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39952 fn_anonym root txt unknown /proc/39795/task/39952/exe (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39952 fn_anonym root NOFD /proc/39795/task/39952/fd (opendir: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39953 flusher root cwd unknown /proc/39795/task/39953/cwd (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39953 flusher root rtd unknown /proc/39795/task/39953/root (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39953 flusher root txt unknown /proc/39795/task/39953/exe (readlink: Permission denied) 2024-04-19T03:38:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39953 flusher root NOFD /proc/39795/task/39953/fd (opendir: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39954 safe_time root cwd unknown /proc/39795/task/39954/cwd (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39954 safe_time root rtd unknown /proc/39795/task/39954/root (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39954 safe_time root txt unknown /proc/39795/task/39954/exe (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 39795 39954 safe_time root NOFD /proc/39795/task/39954/fd (opendir: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 40380 root cwd unknown /proc/40380/cwd (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 40380 root rtd unknown /proc/40380/root (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 40380 root txt unknown /proc/40380/exe (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 40380 root NOFD /proc/40380/fd (opendir: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 40420 root cwd unknown /proc/40420/cwd (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 40420 root rtd unknown /proc/40420/root (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 40420 root txt unknown /proc/40420/exe (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 40420 root NOFD /proc/40420/fd (opendir: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 root cwd unknown /proc/40425/cwd (readlink: Permission denied) 2024-04-19T03:38:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 root rtd unknown /proc/40425/root (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 root txt unknown /proc/40425/exe (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 root NOFD /proc/40425/fd (opendir: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40426 log root cwd unknown /proc/40425/task/40426/cwd (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40426 log root rtd unknown /proc/40425/task/40426/root (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40426 log root txt unknown /proc/40425/task/40426/exe (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40426 log root NOFD /proc/40425/task/40426/fd (opendir: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40428 msgr-work root cwd unknown /proc/40425/task/40428/cwd (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40428 msgr-work root rtd unknown /proc/40425/task/40428/root (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40428 msgr-work root txt unknown /proc/40425/task/40428/exe (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40428 msgr-work root NOFD /proc/40425/task/40428/fd (opendir: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40429 msgr-work root cwd unknown /proc/40425/task/40429/cwd (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40429 msgr-work root rtd unknown /proc/40425/task/40429/root (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40429 msgr-work root txt unknown /proc/40425/task/40429/exe (readlink: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40429 msgr-work root NOFD /proc/40425/task/40429/fd (opendir: Permission denied) 2024-04-19T03:38:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40430 msgr-work root cwd unknown /proc/40425/task/40430/cwd (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40430 msgr-work root rtd unknown /proc/40425/task/40430/root (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40430 msgr-work root txt unknown /proc/40425/task/40430/exe (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40430 msgr-work root NOFD /proc/40425/task/40430/fd (opendir: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40434 service root cwd unknown /proc/40425/task/40434/cwd (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40434 service root rtd unknown /proc/40425/task/40434/root (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40434 service root txt unknown /proc/40425/task/40434/exe (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40434 service root NOFD /proc/40425/task/40434/fd (opendir: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40435 admin_soc root cwd unknown /proc/40425/task/40435/cwd (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40435 admin_soc root rtd unknown /proc/40425/task/40435/root (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40435 admin_soc root txt unknown /proc/40425/task/40435/exe (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40435 admin_soc root NOFD /proc/40425/task/40435/fd (opendir: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40436 signal_ha root cwd unknown /proc/40425/task/40436/cwd (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40436 signal_ha root rtd unknown /proc/40425/task/40436/root (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40436 signal_ha root txt unknown /proc/40425/task/40436/exe (readlink: Permission denied) 2024-04-19T03:38:43.661 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40436 signal_ha root NOFD /proc/40425/task/40436/fd (opendir: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40437 io_contex root cwd unknown /proc/40425/task/40437/cwd (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40437 io_contex root rtd unknown /proc/40425/task/40437/root (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40437 io_contex root txt unknown /proc/40425/task/40437/exe (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40437 io_contex root NOFD /proc/40425/task/40437/fd (opendir: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40438 io_contex root cwd unknown /proc/40425/task/40438/cwd (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40438 io_contex root rtd unknown /proc/40425/task/40438/root (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40438 io_contex root txt unknown /proc/40425/task/40438/exe (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40438 io_contex root NOFD /proc/40425/task/40438/fd (opendir: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40439 ms_dispat root cwd unknown /proc/40425/task/40439/cwd (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40439 ms_dispat root rtd unknown /proc/40425/task/40439/root (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40439 ms_dispat root txt unknown /proc/40425/task/40439/exe (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40439 ms_dispat root NOFD /proc/40425/task/40439/fd (opendir: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40440 ms_local root cwd unknown /proc/40425/task/40440/cwd (readlink: Permission denied) 2024-04-19T03:38:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40440 ms_local root rtd unknown /proc/40425/task/40440/root (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40440 ms_local root txt unknown /proc/40425/task/40440/exe (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40440 ms_local root NOFD /proc/40425/task/40440/fd (opendir: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40441 safe_time root cwd unknown /proc/40425/task/40441/cwd (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40441 safe_time root rtd unknown /proc/40425/task/40441/root (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40441 safe_time root txt unknown /proc/40425/task/40441/exe (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40441 safe_time root NOFD /proc/40425/task/40441/fd (opendir: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40442 safe_time root cwd unknown /proc/40425/task/40442/cwd (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40442 safe_time root rtd unknown /proc/40425/task/40442/root (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40442 safe_time root txt unknown /proc/40425/task/40442/exe (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40442 safe_time root NOFD /proc/40425/task/40442/fd (opendir: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40443 ceph-mds root cwd unknown /proc/40425/task/40443/cwd (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40443 ceph-mds root rtd unknown /proc/40425/task/40443/root (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40443 ceph-mds root txt unknown /proc/40425/task/40443/exe (readlink: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40443 ceph-mds root NOFD /proc/40425/task/40443/fd (opendir: Permission denied) 2024-04-19T03:38:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40444 safe_time root cwd unknown /proc/40425/task/40444/cwd (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40444 safe_time root rtd unknown /proc/40425/task/40444/root (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40444 safe_time root txt unknown /proc/40425/task/40444/exe (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40444 safe_time root NOFD /proc/40425/task/40444/fd (opendir: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40966 ceph_time root cwd unknown /proc/40425/task/40966/cwd (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40966 ceph_time root rtd unknown /proc/40425/task/40966/root (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40966 ceph_time root txt unknown /proc/40425/task/40966/exe (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40966 ceph_time root NOFD /proc/40425/task/40966/fd (opendir: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40967 OpHistory root cwd unknown /proc/40425/task/40967/cwd (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40967 OpHistory root rtd unknown /proc/40425/task/40967/root (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40967 OpHistory root txt unknown /proc/40425/task/40967/exe (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40967 OpHistory root NOFD /proc/40425/task/40967/fd (opendir: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40968 ms_dispat root cwd unknown /proc/40425/task/40968/cwd (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40968 ms_dispat root rtd unknown /proc/40425/task/40968/root (readlink: Permission denied) 2024-04-19T03:38:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40968 ms_dispat root txt unknown /proc/40425/task/40968/exe (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40968 ms_dispat root NOFD /proc/40425/task/40968/fd (opendir: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40969 mds_rank_ root cwd unknown /proc/40425/task/40969/cwd (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40969 mds_rank_ root rtd unknown /proc/40425/task/40969/root (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40969 mds_rank_ root txt unknown /proc/40425/task/40969/exe (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40969 mds_rank_ root NOFD /proc/40425/task/40969/fd (opendir: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40970 PQ_Finish root cwd unknown /proc/40425/task/40970/cwd (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40970 PQ_Finish root rtd unknown /proc/40425/task/40970/root (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40970 PQ_Finish root txt unknown /proc/40425/task/40970/exe (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40970 PQ_Finish root NOFD /proc/40425/task/40970/fd (opendir: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40971 safe_time root cwd unknown /proc/40425/task/40971/cwd (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40971 safe_time root rtd unknown /proc/40425/task/40971/root (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40971 safe_time root txt unknown /proc/40425/task/40971/exe (readlink: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40971 safe_time root NOFD /proc/40425/task/40971/fd (opendir: Permission denied) 2024-04-19T03:38:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40972 MR_Finish root cwd unknown /proc/40425/task/40972/cwd (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40972 MR_Finish root rtd unknown /proc/40425/task/40972/root (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40972 MR_Finish root txt unknown /proc/40425/task/40972/exe (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40972 MR_Finish root NOFD /proc/40425/task/40972/fd (opendir: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40973 md_submit root cwd unknown /proc/40425/task/40973/cwd (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40973 md_submit root rtd unknown /proc/40425/task/40973/root (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40973 md_submit root txt unknown /proc/40425/task/40973/exe (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 40973 md_submit root NOFD /proc/40425/task/40973/fd (opendir: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 41111 ms_dispat root cwd unknown /proc/40425/task/41111/cwd (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 41111 ms_dispat root rtd unknown /proc/40425/task/41111/root (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 41111 ms_dispat root txt unknown /proc/40425/task/41111/exe (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 41111 ms_dispat root NOFD /proc/40425/task/41111/fd (opendir: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 41112 ms_dispat root cwd unknown /proc/40425/task/41112/cwd (readlink: Permission denied) 2024-04-19T03:38:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 41112 ms_dispat root rtd unknown /proc/40425/task/41112/root (readlink: Permission denied) 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 41112 ms_dispat root txt unknown /proc/40425/task/41112/exe (readlink: Permission denied) 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 40425 41112 ms_dispat root NOFD /proc/40425/task/41112/fd (opendir: Permission denied) 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu cwd DIR 8,1 4096 73163 /home/ubuntu 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu rtd DIR 8,1 4096 2 / 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu txt REG 8,1 1150584 5206 /usr/bin/bash 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 2586930 18369 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 187552 4894 /usr/lib64/libtinfo.so.6.1 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 54 18374 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 3316 18324 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-19T03:38:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 286 18408 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 57 18372 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 34 18389 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 77 18373 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 167 18405 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 59 18409 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 23 18407 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu mem REG 8,1 368 18406 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu 0r FIFO 0,13 0t0 245742 pipe 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu 1w FIFO 0,13 0t0 245743 pipe 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:bash 43708 ubuntu 2w FIFO 0,13 0t0 245744 pipe 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 43745 root cwd unknown /proc/43745/cwd (readlink: Permission denied) 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 43745 root rtd unknown /proc/43745/root (readlink: Permission denied) 2024-04-19T03:38:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 43745 root txt unknown /proc/43745/exe (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 43745 root NOFD /proc/43745/fd (opendir: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 43749 root cwd unknown /proc/43749/cwd (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 43749 root rtd unknown /proc/43749/root (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 43749 root txt unknown /proc/43749/exe (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 43749 root NOFD /proc/43749/fd (opendir: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 43752 root cwd unknown /proc/43752/cwd (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 43752 root rtd unknown /proc/43752/root (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 43752 root txt unknown /proc/43752/exe (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 43752 root NOFD /proc/43752/fd (opendir: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 root cwd unknown /proc/43762/cwd (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 root rtd unknown /proc/43762/root (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 root txt unknown /proc/43762/exe (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 root NOFD /proc/43762/fd (opendir: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43775 log root cwd unknown /proc/43762/task/43775/cwd (readlink: Permission denied) 2024-04-19T03:38:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43775 log root rtd unknown /proc/43762/task/43775/root (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43775 log root txt unknown /proc/43762/task/43775/exe (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43775 log root NOFD /proc/43762/task/43775/fd (opendir: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43777 msgr-work root cwd unknown /proc/43762/task/43777/cwd (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43777 msgr-work root rtd unknown /proc/43762/task/43777/root (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43777 msgr-work root txt unknown /proc/43762/task/43777/exe (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43777 msgr-work root NOFD /proc/43762/task/43777/fd (opendir: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43779 msgr-work root cwd unknown /proc/43762/task/43779/cwd (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43779 msgr-work root rtd unknown /proc/43762/task/43779/root (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43779 msgr-work root txt unknown /proc/43762/task/43779/exe (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43779 msgr-work root NOFD /proc/43762/task/43779/fd (opendir: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43780 msgr-work root cwd unknown /proc/43762/task/43780/cwd (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43780 msgr-work root rtd unknown /proc/43762/task/43780/root (readlink: Permission denied) 2024-04-19T03:38:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43780 msgr-work root txt unknown /proc/43762/task/43780/exe (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43780 msgr-work root NOFD /proc/43762/task/43780/fd (opendir: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43784 service root cwd unknown /proc/43762/task/43784/cwd (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43784 service root rtd unknown /proc/43762/task/43784/root (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43784 service root txt unknown /proc/43762/task/43784/exe (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43784 service root NOFD /proc/43762/task/43784/fd (opendir: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43785 admin_soc root cwd unknown /proc/43762/task/43785/cwd (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43785 admin_soc root rtd unknown /proc/43762/task/43785/root (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43785 admin_soc root txt unknown /proc/43762/task/43785/exe (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43785 admin_soc root NOFD /proc/43762/task/43785/fd (opendir: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43786 signal_ha root cwd unknown /proc/43762/task/43786/cwd (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43786 signal_ha root rtd unknown /proc/43762/task/43786/root (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43786 signal_ha root txt unknown /proc/43762/task/43786/exe (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43786 signal_ha root NOFD /proc/43762/task/43786/fd (opendir: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43787 io_contex root cwd unknown /proc/43762/task/43787/cwd (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43787 io_contex root rtd unknown /proc/43762/task/43787/root (readlink: Permission denied) 2024-04-19T03:38:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43787 io_contex root txt unknown /proc/43762/task/43787/exe (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43787 io_contex root NOFD /proc/43762/task/43787/fd (opendir: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43788 io_contex root cwd unknown /proc/43762/task/43788/cwd (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43788 io_contex root rtd unknown /proc/43762/task/43788/root (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43788 io_contex root txt unknown /proc/43762/task/43788/exe (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43788 io_contex root NOFD /proc/43762/task/43788/fd (opendir: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43789 ceph_time root cwd unknown /proc/43762/task/43789/cwd (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43789 ceph_time root rtd unknown /proc/43762/task/43789/root (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43789 ceph_time root txt unknown /proc/43762/task/43789/exe (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43789 ceph_time root NOFD /proc/43762/task/43789/fd (opendir: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43790 fn_anonym root cwd unknown /proc/43762/task/43790/cwd (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43790 fn_anonym root rtd unknown /proc/43762/task/43790/root (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43790 fn_anonym root txt unknown /proc/43762/task/43790/exe (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43790 fn_anonym root NOFD /proc/43762/task/43790/fd (opendir: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43791 fn_anonym root cwd unknown /proc/43762/task/43791/cwd (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43791 fn_anonym root rtd unknown /proc/43762/task/43791/root (readlink: Permission denied) 2024-04-19T03:38:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43791 fn_anonym root txt unknown /proc/43762/task/43791/exe (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43791 fn_anonym root NOFD /proc/43762/task/43791/fd (opendir: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43792 fn_anonym root cwd unknown /proc/43762/task/43792/cwd (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43792 fn_anonym root rtd unknown /proc/43762/task/43792/root (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43792 fn_anonym root txt unknown /proc/43762/task/43792/exe (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43792 fn_anonym root NOFD /proc/43762/task/43792/fd (opendir: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43793 fn_anonym root cwd unknown /proc/43762/task/43793/cwd (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43793 fn_anonym root rtd unknown /proc/43762/task/43793/root (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43793 fn_anonym root txt unknown /proc/43762/task/43793/exe (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43793 fn_anonym root NOFD /proc/43762/task/43793/fd (opendir: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43794 fn_anonym root cwd unknown /proc/43762/task/43794/cwd (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43794 fn_anonym root rtd unknown /proc/43762/task/43794/root (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43794 fn_anonym root txt unknown /proc/43762/task/43794/exe (readlink: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43794 fn_anonym root NOFD /proc/43762/task/43794/fd (opendir: Permission denied) 2024-04-19T03:38:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43795 safe_time root cwd unknown /proc/43762/task/43795/cwd (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43795 safe_time root rtd unknown /proc/43762/task/43795/root (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43795 safe_time root txt unknown /proc/43762/task/43795/exe (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43795 safe_time root NOFD /proc/43762/task/43795/fd (opendir: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43796 fn_anonym root cwd unknown /proc/43762/task/43796/cwd (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43796 fn_anonym root rtd unknown /proc/43762/task/43796/root (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43796 fn_anonym root txt unknown /proc/43762/task/43796/exe (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43796 fn_anonym root NOFD /proc/43762/task/43796/fd (opendir: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43797 flusher root cwd unknown /proc/43762/task/43797/cwd (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43797 flusher root rtd unknown /proc/43762/task/43797/root (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43797 flusher root txt unknown /proc/43762/task/43797/exe (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43797 flusher root NOFD /proc/43762/task/43797/fd (opendir: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43798 ms_dispat root cwd unknown /proc/43762/task/43798/cwd (readlink: Permission denied) 2024-04-19T03:38:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43798 ms_dispat root rtd unknown /proc/43762/task/43798/root (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43798 ms_dispat root txt unknown /proc/43762/task/43798/exe (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43798 ms_dispat root NOFD /proc/43762/task/43798/fd (opendir: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43799 ms_local root cwd unknown /proc/43762/task/43799/cwd (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43799 ms_local root rtd unknown /proc/43762/task/43799/root (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43799 ms_local root txt unknown /proc/43762/task/43799/exe (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43799 ms_local root NOFD /proc/43762/task/43799/fd (opendir: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43800 safe_time root cwd unknown /proc/43762/task/43800/cwd (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43800 safe_time root rtd unknown /proc/43762/task/43800/root (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43800 safe_time root txt unknown /proc/43762/task/43800/exe (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43800 safe_time root NOFD /proc/43762/task/43800/fd (opendir: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43801 ceph-fuse root cwd unknown /proc/43762/task/43801/cwd (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43801 ceph-fuse root rtd unknown /proc/43762/task/43801/root (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43801 ceph-fuse root txt unknown /proc/43762/task/43801/exe (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43801 ceph-fuse root NOFD /proc/43762/task/43801/fd (opendir: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43803 ceph-fuse root cwd unknown /proc/43762/task/43803/cwd (readlink: Permission denied) 2024-04-19T03:38:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43803 ceph-fuse root rtd unknown /proc/43762/task/43803/root (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43803 ceph-fuse root txt unknown /proc/43762/task/43803/exe (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43803 ceph-fuse root NOFD /proc/43762/task/43803/fd (opendir: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43806 ceph-fuse root cwd unknown /proc/43762/task/43806/cwd (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43806 ceph-fuse root rtd unknown /proc/43762/task/43806/root (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43806 ceph-fuse root txt unknown /proc/43762/task/43806/exe (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 43806 ceph-fuse root NOFD /proc/43762/task/43806/fd (opendir: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 47084 ceph-fuse root cwd unknown /proc/43762/task/47084/cwd (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 47084 ceph-fuse root rtd unknown /proc/43762/task/47084/root (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 47084 ceph-fuse root txt unknown /proc/43762/task/47084/exe (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 47084 ceph-fuse root NOFD /proc/43762/task/47084/fd (opendir: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 47384 ceph-fuse root cwd unknown /proc/43762/task/47384/cwd (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 47384 ceph-fuse root rtd unknown /proc/43762/task/47384/root (readlink: Permission denied) 2024-04-19T03:38:43.676 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 47384 ceph-fuse root txt unknown /proc/43762/task/47384/exe (readlink: Permission denied) 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-fuse 43762 47384 ceph-fuse root NOFD /proc/43762/task/47384/fd (opendir: Permission denied) 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 44321 root cwd unknown /proc/44321/cwd (readlink: Permission denied) 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 44321 root rtd unknown /proc/44321/root (readlink: Permission denied) 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 44321 root txt unknown /proc/44321/exe (readlink: Permission denied) 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 44321 root NOFD /proc/44321/fd (opendir: Permission denied) 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu cwd DIR 0,47 194249488 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu rtd DIR 8,1 4096 2 / 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu txt REG 8,1 42840 7406 /usr/bin/timeout 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 2586930 18369 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 42744 5185 /usr/lib64/librt-2.28.so 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-19T03:38:43.677 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 54 18374 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 3316 18324 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 286 18408 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 57 18372 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 34 18389 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 77 18373 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 167 18405 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 59 18409 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 23 18407 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu mem REG 8,1 368 18406 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu 0r FIFO 0,13 0t0 266511 pipe 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu 1w FIFO 0,13 0t0 266512 pipe 2024-04-19T03:38:43.678 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 47061 ubuntu 2w FIFO 0,13 0t0 266513 pipe 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu cwd DIR 0,47 194249488 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu rtd DIR 8,1 4096 2 / 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu txt REG 8,1 1150584 5206 /usr/bin/bash 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 2586930 18369 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 187552 4894 /usr/lib64/libtinfo.so.6.1 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 54 18374 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 3316 18324 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 286 18408 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 57 18372 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 34 18389 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-19T03:38:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 77 18373 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 167 18405 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 59 18409 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 23 18407 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu mem REG 8,1 368 18406 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu 0r FIFO 0,13 0t0 266511 pipe 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu 1w FIFO 0,13 0t0 266512 pipe 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu 2w FIFO 0,13 0t0 266513 pipe 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 47082 ubuntu 255r REG 8,1 209 919081 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:sleep 49351 root cwd unknown /proc/49351/cwd (readlink: Permission denied) 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:sleep 49351 root rtd unknown /proc/49351/root (readlink: Permission denied) 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:sleep 49351 root txt unknown /proc/49351/exe (readlink: Permission denied) 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:sleep 49351 root NOFD /proc/49351/fd (opendir: Permission denied) 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 49591 root cwd unknown /proc/49591/cwd (readlink: Permission denied) 2024-04-19T03:38:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 49591 root rtd unknown /proc/49591/root (readlink: Permission denied) 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 49591 root txt unknown /proc/49591/exe (readlink: Permission denied) 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 49591 root NOFD /proc/49591/fd (opendir: Permission denied) 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu cwd DIR 0,47 194249488 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu rtd DIR 8,1 4096 2 / 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu txt REG 8,1 179672 11587 /usr/bin/lsof 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 99600 5318 /usr/lib64/libz.so.1.2.11 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 88824 5183 /usr/lib64/libresolv-2.28.so 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 3087848 2278 /usr/lib64/libcrypto.so.1.1.1k 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 16192 5609 /usr/lib64/libkeyutils.so.1.6 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 71464 7213 /usr/lib64/libkrb5support.so.0.1 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 16792 5320 /usr/lib64/libcom_err.so.2.1 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 96272 7207 /usr/lib64/libk5crypto.so.3.1 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 975608 7212 /usr/lib64/libkrb5.so.3.3 2024-04-19T03:38:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 355960 7204 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 543160 4872 /usr/lib64/libpcre2-8.so.0.7.1 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 213592 7222 /usr/lib64/libtirpc.so.3.0.0 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 168536 4876 /usr/lib64/libselinux.so.1 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu 0r FIFO 0,13 0t0 266511 pipe 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu 1w FIFO 0,13 0t0 266512 pipe 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu 2w FIFO 0,13 0t0 266513 pipe 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu 3r DIR 0,5 0 1 /proc 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu 4r DIR 0,5 0 279863 /proc/49611/fd 2024-04-19T03:38:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu 5w FIFO 0,13 0t0 279868 pipe 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49611 ubuntu 6r FIFO 0,13 0t0 279869 pipe 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 49613 root cwd unknown /proc/49613/cwd (readlink: Permission denied) 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 49613 root rtd unknown /proc/49613/root (readlink: Permission denied) 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 49613 root txt unknown /proc/49613/exe (readlink: Permission denied) 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 49613 root NOFD /proc/49613/fd (opendir: Permission denied) 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:ceph 49615 root cwd unknown /proc/49615/cwd (readlink: Permission denied) 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:ceph 49615 root rtd unknown /proc/49615/root (readlink: Permission denied) 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:ceph 49615 root txt unknown /proc/49615/exe (readlink: Permission denied) 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:ceph 49615 root NOFD /proc/49615/fd (opendir: Permission denied) 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu cwd DIR 0,47 194249488 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu rtd DIR 8,1 4096 2 / 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu txt REG 8,1 179672 11587 /usr/bin/lsof 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 99600 5318 /usr/lib64/libz.so.1.2.11 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 88824 5183 /usr/lib64/libresolv-2.28.so 2024-04-19T03:38:43.683 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 3087848 2278 /usr/lib64/libcrypto.so.1.1.1k 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 16192 5609 /usr/lib64/libkeyutils.so.1.6 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 71464 7213 /usr/lib64/libkrb5support.so.0.1 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 16792 5320 /usr/lib64/libcom_err.so.2.1 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 96272 7207 /usr/lib64/libk5crypto.so.3.1 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 975608 7212 /usr/lib64/libkrb5.so.3.3 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 355960 7204 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 543160 4872 /usr/lib64/libpcre2-8.so.0.7.1 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 213592 7222 /usr/lib64/libtirpc.so.3.0.0 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 168536 4876 /usr/lib64/libselinux.so.1 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-19T03:38:43.684 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-19T03:38:43.685 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu 4r FIFO 0,13 0t0 279868 pipe 2024-04-19T03:38:43.685 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 49616 ubuntu 7w FIFO 0,13 0t0 279869 pipe 2024-04-19T03:38:43.685 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-19T03:38:43.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-19T03:38:43.687 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:43.687 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:43.687 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:43.688 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:43.686+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:43.740 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-04-19T03:38:43.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-19T03:38:43.788 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:43.787+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:43.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:43.825 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:43.825 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:43.835 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:38:43.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2024-04-19T03:38:43.888 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:43.888+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:43.966 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:43.986 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:43.987 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:43.989 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:43.988+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:43.991 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:43.992 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:44.003 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:44.003 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:44.003 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:44.003 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:44.003 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:44.013 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:44.073 DEBUG:teuthology.parallel:result is None 2024-04-19T03:38:44.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-19T03:38:44.090 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:44.090+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:44.109 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-19T03:38:44.109 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-19T03:38:44.122 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-19T03:38:44.122 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:38:44.122 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-19T03:38:44.167 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:38:44.167 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-19T03:38:44.185 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.951514182, 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.187 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:44.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:44.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:44.190 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.950358848, 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.191 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:44.193 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:44.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.194 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:44.194 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:44.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.194 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.194 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.195 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.196 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.948927951999998, 2024-04-19T03:38:44.197 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.198 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.199 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:44.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:44.201 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.202 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.948064983999998, 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.203 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:44.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.204 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.204 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.204 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:44.204 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:44.205 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.206 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.947631791999999, 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.208 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.209 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:44.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:44.210 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.210 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.210 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.210 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:44.210 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:44.211 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:44.212 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.946183755, 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.213 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:44.215 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.216 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.217 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.218 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.945508583999999, 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:44.220 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.221 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.222 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.944018014000001, 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.223 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:44.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:44.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:44.226 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.943615906000002, 2024-04-19T03:38:44.227 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.228 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.229 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:44.230 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.943572532000001, 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.232 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.233 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:44.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:44.235 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.943540617, 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.236 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.237 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:44.238 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.239 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.240 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.942099318, 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.241 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.242 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:44.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:44.245 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.246 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.941843879, 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.247 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.248 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.249 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.941150938, 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.251 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.252 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.253 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:44.254 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.255 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.104412669999999, 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.256 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.258 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.259 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.260 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.261 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.103718826000001, 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:44.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:44.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:44.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.103316525, 2024-04-19T03:38:44.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:44.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:44.273 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.100712671, 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:44.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:44.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 30.100353966, 2024-04-19T03:38:44.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:44.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122534 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1925120~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 3.523219857, 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.084175462000000006, 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:44.285 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122534 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:44.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660781+0000", 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660793+0000", 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1924e-05 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:44.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660802+0000", 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.346e-06 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660809+0000", 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.866e-06 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688450+0000", 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027640688 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688513+0000", 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2966000000000007e-05 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688602+0000", 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9671000000000003e-05 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.698279+0000", 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096766579999999994 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744874+0000", 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.046594407999999997 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744917+0000", 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3127999999999998e-05 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744957+0000", 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0568000000000002e-05 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.290 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.291 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.291 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:44.291 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:44.291 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:44.292 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:44.292+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:44.293 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:44.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:38:44.393 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:44.393+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:44.446 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:44.446 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:44.446 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:38:44.446 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:44.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:44.499 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:44.499+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:44.595 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:44.594+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:44.644 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:44.645 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:44.645 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:44.645 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:44.645 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:44.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:44.696 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:44.695+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:44.725 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:38:44.725 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:38:43.864702+0000","last_up_change":"2024-04-19T03:36:28.360929+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":19}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:38:44.742 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:35:52.932739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:35:54.326287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:35:58.002172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:35:58.844614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:38:44.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:38:44.797 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:44.796+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:44.844 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:44.844 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:44.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:44.844 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:44.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.844 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.844 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:44.844 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.598390222999999, 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:44.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:44.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:44.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:44.850 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.595769602000001, 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.851 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:44.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:44.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.593326180999998, 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.857 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:44.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.862 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.592558535999999, 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.863 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:44.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:44.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.581966332, 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:44.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:44.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.579265208999999, 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:44.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:44.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:44.881 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.711169679000001, 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:44.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.887 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4:fde182c5:::100000001f8.00000039:head [write 57344~4096,write 999424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.204720059, 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100832459, 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:44.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726148+0000", 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089264587000000006 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726232+0000", 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4432999999999996e-05 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726387+0000", 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015492899999999999 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.730073+0000", 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036859179999999998 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737597+0000", 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075243239999999998 2024-04-19T03:38:44.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737645+0000", 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7920999999999997e-05 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737683+0000", 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7849999999999998e-05 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110110 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2383872~4096,write 2453504~4096,write 2482176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8600391189999996, 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093470530999999996, 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110110 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981530+0000", 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:44.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981548+0000", 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.827e-05 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981562+0000", 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3745e-05 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981572+0000", 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9210000000000004e-06 2024-04-19T03:38:44.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045614+0000", 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064041782000000005 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045699+0000", 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4690000000000004e-05 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045898+0000", 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019934600000000001 2024-04-19T03:38:44.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054237+0000", 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083394360000000004 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074935+0000", 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020697898999999999 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074966+0000", 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0806999999999998e-05 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075002+0000", 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5879e-05 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110111 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2441216~4096,write 2551808~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8599875140000002, 2024-04-19T03:38:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093517948000000004, 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110111 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981582+0000", 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981596+0000", 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3873000000000001e-05 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981604+0000", 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8420000000000005e-06 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981611+0000", 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0879999999999997e-06 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053316+0000", 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071704618999999997 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053403+0000", 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6757999999999998e-05 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053574+0000", 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017118400000000001 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.057921+0000", 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043469090000000004 2024-04-19T03:38:44.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075014+0000", 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017093168999999998 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075063+0000", 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9208e-05 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075101+0000", 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7808999999999997e-05 2024-04-19T03:38:44.904 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110132 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2691072~4096,write 2813952~4096,write 2932736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8538636549999996, 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093537876000000006, 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.905 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110132 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987706+0000", 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987718+0000", 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987729+0000", 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1590000000000001e-05 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987738+0000", 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4780000000000008e-06 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054265+0000", 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066526945000000004 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054370+0000", 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105499 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054556+0000", 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185761 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058085+0000", 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003529089 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081142+0000", 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023057281999999998 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081197+0000", 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4978000000000001e-05 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081245+0000", 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7345999999999997e-05 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.910 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110152 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1605632~4096,write 1675264~4096,write 1921024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8465108739999998, 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.094148551999999996, 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110152 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:44.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995059+0000", 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995075+0000", 2024-04-19T03:38:44.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6583e-05 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995086+0000", 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995108+0000", 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1087999999999999e-05 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058217+0000", 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.063109928999999995 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058309+0000", 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1687999999999994e-05 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058434+0000", 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012497800000000001 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.068998+0000", 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010564053 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089103+0000", 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020104899999999998 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089158+0000", 2024-04-19T03:38:44.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4880000000000003e-05 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089208+0000", 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0241000000000002e-05 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110160 4.27 4:e68799fb:::100000001f8.00000018:head [write 2277376~4096,write 2322432~4096,write 2445312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8440348909999997, 2024-04-19T03:38:44.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.10998324299999999, 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110160 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997535+0000", 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997549+0000", 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4514e-05 2024-04-19T03:38:44.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997561+0000", 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1701e-05 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997569+0000", 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7610000000000007e-06 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095749+0000", 2024-04-19T03:38:44.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.098180607000000003 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095831+0000", 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1689999999999999e-05 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107325+0000", 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011493512000000001 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107444+0000", 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011904 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107519+0000", 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5278999999999995e-05 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110172 4.36 4:6fa85f86:::100000001f8.00000013:head [write 663552~4096,write 688128~4096,write 921600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:44.921 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8371335339999995, 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084877683999999995, 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110172 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:44.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004436+0000", 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004456+0000", 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0098999999999998e-05 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004470+0000", 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4117999999999999e-05 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004480+0000", 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9809999999999998e-06 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063606+0000", 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059126074000000001 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063696+0000", 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0105999999999994e-05 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063813+0000", 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116574 2024-04-19T03:38:44.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075044+0000", 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011231507999999999 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089219+0000", 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014175304999999999 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089265+0000", 2024-04-19T03:38:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5853999999999998e-05 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089315+0000", 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9366999999999997e-05 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110174 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3280896~4096,write 3293184~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8370440339999998, 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084998899000000003, 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110174 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004539+0000", 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3473e-05 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004550+0000", 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0438999999999999e-05 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004558+0000", 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0139999999999998e-06 2024-04-19T03:38:44.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069043+0000", 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064484737 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069127+0000", 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3905000000000004e-05 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069337+0000", 2024-04-19T03:38:44.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000210471 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081133+0000", 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011795684000000001 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089438+0000", 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083048649999999998 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089484+0000", 2024-04-19T03:38:44.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6832999999999997e-05 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089525+0000", 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1026000000000003e-05 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110212 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3047424~8192,write 3063808~4096,write 3076096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:44.933 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.823680285, 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093266469000000005, 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110212 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017889+0000", 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017905+0000", 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5617e-05 2024-04-19T03:38:44.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017915+0000", 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0215e-05 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017923+0000", 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6990000000000003e-06 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097726+0000", 2024-04-19T03:38:44.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079803221999999993 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097839+0000", 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112575 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.098019+0000", 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180392 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111092+0000", 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013072587 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111104+0000", 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.236e-05 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111134+0000", 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9513999999999999e-05 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111157+0000", 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3156999999999999e-05 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.939 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110221 4.36 4:6da220e6:::100000001f8.0000003f:head [write 4096~4096,write 24576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8200128309999997, 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084587624, 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110221 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021557+0000", 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021581+0000", 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4346999999999999e-05 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021594+0000", 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2602999999999999e-05 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021602+0000", 2024-04-19T03:38:44.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078747+0000", 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.057145174999999999 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078838+0000", 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0402999999999995e-05 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078969+0000", 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013092900000000001 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084690+0000", 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057209870000000003 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106035+0000", 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021345425000000001 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106092+0000", 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6842999999999998e-05 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106145+0000", 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3536999999999999e-05 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110231 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2793472~4096,write 2838528~4096,write 3112960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8157666690000003, 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083514087000000001, 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110231 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:44.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:44.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025803+0000", 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025813+0000", 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6220000000000004e-06 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025820+0000", 2024-04-19T03:38:44.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5509999999999996e-06 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025825+0000", 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3029999999999999e-06 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084726+0000", 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058900606000000001 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084812+0000", 2024-04-19T03:38:44.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6182999999999998e-05 2024-04-19T03:38:44.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084984+0000", 2024-04-19T03:38:44.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017231700000000001 2024-04-19T03:38:44.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089351+0000", 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043671459999999997 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109218+0000", 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019866681000000001 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109263+0000", 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5621000000000002e-05 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109318+0000", 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4435999999999999e-05 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110234 4.6 4:616d4c41:::100000001f8.00000034:head [write 3207168~8192,write 3223552~4096,write 3342336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8144131059999999, 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085527898000000005, 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.953 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110234 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027172+0000", 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5939000000000001e-05 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027184+0000", 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1139e-05 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027191+0000", 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089455+0000", 2024-04-19T03:38:44.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.062263753999999998 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089534+0000", 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8744000000000004e-05 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089690+0000", 2024-04-19T03:38:44.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156203 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102714+0000", 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013023798 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112600+0000", 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0098863189999999993 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112649+0000", 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8986000000000002e-05 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112685+0000", 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6251000000000002e-05 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110414 4.36 4:6fa85f86:::100000001f8.00000013:head [write 348160~4096,write 409600~4096,write 438272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:44.959 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.7385723239999997, 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085383260000000002, 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110414 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102997+0000", 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103011+0000", 2024-04-19T03:38:44.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4224e-05 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103023+0000", 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2024e-05 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103032+0000", 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6049999999999998e-06 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:44.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164051+0000", 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.06101939 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164139+0000", 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7497999999999995e-05 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164269+0000", 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013044700000000001 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.177794+0000", 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013525099 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188243+0000", 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010448834000000001 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188329+0000", 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6120999999999998e-05 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:44.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:44.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188381+0000", 2024-04-19T03:38:44.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2030000000000002e-05 2024-04-19T03:38:44.965 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.965 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.965 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.965 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:44.965 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:44.965 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:44.967 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:44.968 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:44.966+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:45.068 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:45.067+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:45.108 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:45.108 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:45.108 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:38:45.108 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:45.113 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2024-04-19T03:38:45.118 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:45.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:38:45.169 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:45.169+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:45.246 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:45.246 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:45.246 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:45.246 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:45.246 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:45.256 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:45.300 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:45.299+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:45.371 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:45.370+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:45.385 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.151305655999998, 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.386 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:45.387 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:45.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:45.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.150150322000002, 2024-04-19T03:38:45.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:45.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:45.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:45.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.397 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.148719426, 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.401 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:45.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:45.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:45.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:45.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:45.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.147856458, 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.404 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:45.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:45.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.147423265999997, 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:45.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:45.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.145975229000001, 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:45.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:45.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.145300057999997, 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:45.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:45.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:45.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.143809488000002, 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:45.428 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:45.432 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.143407379999999, 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:45.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.436 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.143364005999999, 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.438 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.143332090999998, 2024-04-19T03:38:45.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.445 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.141890791999998, 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:45.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:45.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:45.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.141635352999998, 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.140942412000001, 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.455 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:45.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:45.459 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.304204144, 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.460 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.303510299999999, 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:45.465 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.466 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.303107999000002, 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.300504145000001, 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.476 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.300145440000001, 2024-04-19T03:38:45.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.486 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122534 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1925120~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 4.7230113310000004, 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.084175462000000006, 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122534 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:45.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660781+0000", 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660793+0000", 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1924e-05 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660802+0000", 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.346e-06 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660809+0000", 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.866e-06 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688450+0000", 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027640688 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688513+0000", 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2966000000000007e-05 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688602+0000", 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9671000000000003e-05 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.698279+0000", 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096766579999999994 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744874+0000", 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.046594407999999997 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744917+0000", 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3127999999999998e-05 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:45.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:45.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744957+0000", 2024-04-19T03:38:45.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0568000000000002e-05 2024-04-19T03:38:45.492 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.492 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.492 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.492 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:45.492 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:45.492 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:45.494 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:45.493+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:45.494 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:45.495 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-19T03:38:45.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T03:38:45.594 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:45.594+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:45.647 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:38:45.647 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:45.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:45.695 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:45.695+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:45.797 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:45.796+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:45.801 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:45.801 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:45.801 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:45.801 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:45.801 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:45.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:45.873 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-19T03:38:45.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:38:45.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T03:38:45.897 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:45.896+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:45.975 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:45.975 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:45.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:45.975 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:45.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.975 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.975 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.728478815000003, 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:45.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:45.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:45.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.725858193999997, 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:45.981 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:45.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:45.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:45.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.723414773000002, 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.987 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:45.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:45.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:45.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:45.992 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.722647127999998, 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:45.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.712054924, 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:45.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:45.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:46.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.003 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.709353800999999, 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:46.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:46.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.841258271000001, 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:46.009 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:46.014 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4:fde182c5:::100000001f8.00000039:head [write 57344~4096,write 999424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.334808650999999, 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100832459, 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.015 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726148+0000", 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089264587000000006 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726232+0000", 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4432999999999996e-05 2024-04-19T03:38:46.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726387+0000", 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015492899999999999 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.730073+0000", 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036859179999999998 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737597+0000", 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075243239999999998 2024-04-19T03:38:46.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737645+0000", 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7920999999999997e-05 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737683+0000", 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7849999999999998e-05 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110110 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2383872~4096,write 2453504~4096,write 2482176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.990127711, 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093470530999999996, 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110110 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:46.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981530+0000", 2024-04-19T03:38:46.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981548+0000", 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.827e-05 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981562+0000", 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3745e-05 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981572+0000", 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9210000000000004e-06 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045614+0000", 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064041782000000005 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045699+0000", 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4690000000000004e-05 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045898+0000", 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019934600000000001 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054237+0000", 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083394360000000004 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074935+0000", 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020697898999999999 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074966+0000", 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0806999999999998e-05 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075002+0000", 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5879e-05 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110111 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2441216~4096,write 2551808~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.026 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.990076106, 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093517948000000004, 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110111 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981582+0000", 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981596+0000", 2024-04-19T03:38:46.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3873000000000001e-05 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981604+0000", 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8420000000000005e-06 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981611+0000", 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0879999999999997e-06 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053316+0000", 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071704618999999997 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053403+0000", 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6757999999999998e-05 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053574+0000", 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017118400000000001 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.057921+0000", 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043469090000000004 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075014+0000", 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017093168999999998 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075063+0000", 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9208e-05 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075101+0000", 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7808999999999997e-05 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110132 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2691072~4096,write 2813952~4096,write 2932736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.983952247, 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093537876000000006, 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.032 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110132 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:46.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987706+0000", 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987718+0000", 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987729+0000", 2024-04-19T03:38:46.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1590000000000001e-05 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987738+0000", 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4780000000000008e-06 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054265+0000", 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066526945000000004 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054370+0000", 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105499 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054556+0000", 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185761 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058085+0000", 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003529089 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081142+0000", 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023057281999999998 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081197+0000", 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4978000000000001e-05 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081245+0000", 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7345999999999997e-05 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.037 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110152 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1605632~4096,write 1675264~4096,write 1921024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.976599466, 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.094148551999999996, 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110152 2024-04-19T03:38:46.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995059+0000", 2024-04-19T03:38:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995075+0000", 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6583e-05 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995086+0000", 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995108+0000", 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1087999999999999e-05 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058217+0000", 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.063109928999999995 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058309+0000", 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1687999999999994e-05 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058434+0000", 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012497800000000001 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.068998+0000", 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010564053 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089103+0000", 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020104899999999998 2024-04-19T03:38:46.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089158+0000", 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4880000000000003e-05 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089208+0000", 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0241000000000002e-05 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.043 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110160 4.27 4:e68799fb:::100000001f8.00000018:head [write 2277376~4096,write 2322432~4096,write 2445312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.974123483, 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.10998324299999999, 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110160 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997535+0000", 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997549+0000", 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4514e-05 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997561+0000", 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1701e-05 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997569+0000", 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7610000000000007e-06 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095749+0000", 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.098180607000000003 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095831+0000", 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1689999999999999e-05 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107325+0000", 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011493512000000001 2024-04-19T03:38:46.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107444+0000", 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011904 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107519+0000", 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5278999999999995e-05 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.048 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110172 4.36 4:6fa85f86:::100000001f8.00000013:head [write 663552~4096,write 688128~4096,write 921600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.967222125999999, 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084877683999999995, 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110172 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:46.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004436+0000", 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004456+0000", 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0098999999999998e-05 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004470+0000", 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4117999999999999e-05 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004480+0000", 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9809999999999998e-06 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063606+0000", 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059126074000000001 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063696+0000", 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0105999999999994e-05 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063813+0000", 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116574 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075044+0000", 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011231507999999999 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089219+0000", 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014175304999999999 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089265+0000", 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5853999999999998e-05 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089315+0000", 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9366999999999997e-05 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110174 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3280896~4096,write 3293184~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.967132626, 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084998899000000003, 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.054 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110174 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004539+0000", 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3473e-05 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004550+0000", 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0438999999999999e-05 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004558+0000", 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0139999999999998e-06 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069043+0000", 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064484737 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069127+0000", 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3905000000000004e-05 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069337+0000", 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000210471 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081133+0000", 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011795684000000001 2024-04-19T03:38:46.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089438+0000", 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083048649999999998 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089484+0000", 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6832999999999997e-05 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089525+0000", 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1026000000000003e-05 2024-04-19T03:38:46.059 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110212 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3047424~8192,write 3063808~4096,write 3076096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.953768877, 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093266469000000005, 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110212 2024-04-19T03:38:46.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017889+0000", 2024-04-19T03:38:46.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017905+0000", 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5617e-05 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017915+0000", 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0215e-05 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017923+0000", 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6990000000000003e-06 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097726+0000", 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079803221999999993 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097839+0000", 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112575 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.098019+0000", 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180392 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111092+0000", 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013072587 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111104+0000", 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.236e-05 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111134+0000", 2024-04-19T03:38:46.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9513999999999999e-05 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111157+0000", 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3156999999999999e-05 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110221 4.36 4:6da220e6:::100000001f8.0000003f:head [write 4096~4096,write 24576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.950101423, 2024-04-19T03:38:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084587624, 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110221 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021557+0000", 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021581+0000", 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4346999999999999e-05 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021594+0000", 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2602999999999999e-05 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021602+0000", 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078747+0000", 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.057145174999999999 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078838+0000", 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0402999999999995e-05 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078969+0000", 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013092900000000001 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084690+0000", 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057209870000000003 2024-04-19T03:38:46.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106035+0000", 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021345425000000001 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106092+0000", 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6842999999999998e-05 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106145+0000", 2024-04-19T03:38:46.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3536999999999999e-05 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110231 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2793472~4096,write 2838528~4096,write 3112960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.945855261, 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083514087000000001, 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110231 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025803+0000", 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025813+0000", 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6220000000000004e-06 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025820+0000", 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5509999999999996e-06 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025825+0000", 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3029999999999999e-06 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084726+0000", 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058900606000000001 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084812+0000", 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6182999999999998e-05 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084984+0000", 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017231700000000001 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089351+0000", 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043671459999999997 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109218+0000", 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019866681000000001 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109263+0000", 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5621000000000002e-05 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109318+0000", 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4435999999999999e-05 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.076 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110234 4.6 4:616d4c41:::100000001f8.00000034:head [write 3207168~8192,write 3223552~4096,write 3342336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.944501698, 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085527898000000005, 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110234 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:46.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027172+0000", 2024-04-19T03:38:46.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5939000000000001e-05 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027184+0000", 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1139e-05 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027191+0000", 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089455+0000", 2024-04-19T03:38:46.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.062263753999999998 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089534+0000", 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8744000000000004e-05 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089690+0000", 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156203 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102714+0000", 2024-04-19T03:38:46.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013023798 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112600+0000", 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0098863189999999993 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112649+0000", 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8986000000000002e-05 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112685+0000", 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6251000000000002e-05 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110414 4.36 4:6fa85f86:::100000001f8.00000013:head [write 348160~4096,write 409600~4096,write 438272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.868660916, 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085383260000000002, 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:46.082 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110414 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102997+0000", 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103011+0000", 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4224e-05 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103023+0000", 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2024e-05 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103032+0000", 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6049999999999998e-06 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164051+0000", 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.06101939 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164139+0000", 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7497999999999995e-05 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164269+0000", 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013044700000000001 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.177794+0000", 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013525099 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188243+0000", 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010448834000000001 2024-04-19T03:38:46.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188329+0000", 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6120999999999998e-05 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188381+0000", 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2030000000000002e-05 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:46.087 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:46.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:46.090 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:46.091 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:46.088+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:46.190 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:46.189+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:46.217 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:46.217 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:38:46.217 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:46.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:46.252 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:46.273 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:46.273 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:46.277 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:46.277 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:46.291 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:46.290+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:46.307 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-19T03:38:46.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-19T03:38:46.354 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:46.355 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:46.364 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:46.408 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:46.407+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:46.492 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:46.492 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:46.492 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:46.491+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:46.502 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:46.593 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:46.592+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:46.655 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:46.655 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:46.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:46.711 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:46.710+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:46.792 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-19T03:38:46.793 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-19T03:38:46.793 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-19T03:38:46.795 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:46.793+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:46.809 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:46.809 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:46.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:38:46.820 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-04-19T03:38:46.904 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:46.903+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:46.997 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:46.995+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:47.006 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:47.006 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:47.017 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:47.098 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:47.097+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:47.146 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:47.146 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:47.156 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:47.199 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:47.198+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:38:47.226 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:38:46.876195+0000","last_up_change":"2024-04-19T03:36:28.360929+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":40482},{"type":"v1","addr":"172.21.15.129:6801","nonce":40482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":40482},{"type":"v1","addr":"172.21.15.129:6803","nonce":40482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":40482},{"type":"v1","addr":"172.21.15.129:6807","nonce":40482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":40482},{"type":"v1","addr":"172.21.15.129:6805","nonce":40482}]},"public_addr":"172.21.15.129:6801/40482","cluster_addr":"172.21.15.129:6803/40482","heartbeat_back_addr":"172.21.15.129:6807/40482","heartbeat_front_addr":"172.21.15.129:6805/40482","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":19}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:38:47.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:35:52.932739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:35:54.326287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:35:58.002172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:35:58.844614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:38:47.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:38:47.300 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:47.299+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:47.322 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:47.322 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:47.332 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:47.401 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:47.400+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:47.460 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:47.460 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:47.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:47.511 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:47.510+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:47.603 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:47.602+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:47.611 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2024-04-19T03:38:47.621 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:47.621 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:47.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:38:47.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:47.704 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:47.703+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:47.776 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:47.776 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:47.787 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:47.828 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:47.827+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:47.906 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:47.905+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:47.973 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:47.973 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:47.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:47.992 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-19T03:38:48.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T03:38:48.029 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:48.028+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:48.109 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:48.108+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:48.116 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:48.116 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:48.126 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:48.211 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:48.210+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:48.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:48.293 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:48.294 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:48.304 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:48.310 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:48.309+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:48.378 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-19T03:38:48.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T03:38:48.411 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:48.410+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:48.445 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:48.466 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:48.466 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:48.470 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:48.471 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:48.473 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:48.473 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:48.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:48.473 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:48.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.473 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.239044223, 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:48.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.478 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.237888888999997, 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:48.483 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.236457993000002, 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:48.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.489 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.235595025000002, 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:48.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:48.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.235161832999999, 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.494 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:48.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:48.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.233713796000004, 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.499 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:48.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:48.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.504 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.233038624999999, 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.505 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.506 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.507 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.508 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.231548054999998, 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:48.510 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:48.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:48.512 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.231145947000002, 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.513 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.514 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.515 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.516 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.231102573000001, 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:48.517 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:48.518 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:48.519 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:48.520 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.521 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.231070658, 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.522 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.523 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.525 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.229629359, 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:48.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.527 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:48.528 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.529 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.530 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.531 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.22937392, 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:48.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:48.534 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:48.535 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.228680979000004, 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.536 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.537 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.539 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.540 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 34.391942710999999, 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.541 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.542 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.543 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.544 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.545 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.546 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 34.391248867000002, 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.547 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:48.548 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.549 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.550 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.551 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 34.390846566, 2024-04-19T03:38:48.552 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.553 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.554 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:48.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:48.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:48.557 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 34.388242712, 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.558 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.559 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.560 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.562 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:48.563 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 34.387884006999997, 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.564 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.565 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:48.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:48.567 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:48.568 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122534 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1925120~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 7.8107498980000001, 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.084175462000000006, 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:48.569 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122534 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:48.570 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660781+0000", 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660793+0000", 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1924e-05 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660802+0000", 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.346e-06 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:48.571 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660809+0000", 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.866e-06 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688450+0000", 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027640688 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688513+0000", 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2966000000000007e-05 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:48.572 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688602+0000", 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9671000000000003e-05 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.698279+0000", 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096766579999999994 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744874+0000", 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.046594407999999997 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744917+0000", 2024-04-19T03:38:48.573 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3127999999999998e-05 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744957+0000", 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0568000000000002e-05 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:48.574 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:48.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:48.577 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:48.574+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:48.676 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:48.676+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:48.730 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:48.730 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:48.730 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:38:48.730 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:48.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:48.763 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-04-19T03:38:48.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-19T03:38:48.785 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:48.784+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:48.878 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:48.877+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:48.884 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:48.884 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:48.884 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:48.884 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:48.884 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:48.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:48.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:38:48.978 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:48.978+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:49.079 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:49.078+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:49.085 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.839627958000001, 2024-04-19T03:38:49.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:49.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.837007337000003, 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:49.091 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:49.096 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.834563916, 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.097 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:49.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.102 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.833796270999997, 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.823204066999999, 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.108 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:49.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:49.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:49.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:49.114 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 35.820502943999998, 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:49.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:49.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 34.952407414, 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:49.120 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:49.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:49.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4:fde182c5:::100000001f8.00000039:head [write 57344~4096,write 999424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 17.445957794000002, 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100832459, 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.126 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:49.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726148+0000", 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089264587000000006 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726232+0000", 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4432999999999996e-05 2024-04-19T03:38:49.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726387+0000", 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015492899999999999 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.730073+0000", 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036859179999999998 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737597+0000", 2024-04-19T03:38:49.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075243239999999998 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737645+0000", 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7920999999999997e-05 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737683+0000", 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7849999999999998e-05 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110110 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2383872~4096,write 2453504~4096,write 2482176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.101276854, 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093470530999999996, 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110110 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981530+0000", 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981548+0000", 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.827e-05 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981562+0000", 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3745e-05 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981572+0000", 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9210000000000004e-06 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045614+0000", 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064041782000000005 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045699+0000", 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4690000000000004e-05 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045898+0000", 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019934600000000001 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054237+0000", 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083394360000000004 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074935+0000", 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020697898999999999 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074966+0000", 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0806999999999998e-05 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075002+0000", 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5879e-05 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110111 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2441216~4096,write 2551808~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.101225249000001, 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093517948000000004, 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.137 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110111 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981582+0000", 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981596+0000", 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3873000000000001e-05 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981604+0000", 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8420000000000005e-06 2024-04-19T03:38:49.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981611+0000", 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0879999999999997e-06 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053316+0000", 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071704618999999997 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053403+0000", 2024-04-19T03:38:49.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6757999999999998e-05 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053574+0000", 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017118400000000001 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.057921+0000", 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043469090000000004 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075014+0000", 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017093168999999998 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075063+0000", 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9208e-05 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075101+0000", 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7808999999999997e-05 2024-04-19T03:38:49.142 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110132 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2691072~4096,write 2813952~4096,write 2932736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.09510139, 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093537876000000006, 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.143 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110132 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987706+0000", 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987718+0000", 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987729+0000", 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1590000000000001e-05 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987738+0000", 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4780000000000008e-06 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054265+0000", 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066526945000000004 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054370+0000", 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105499 2024-04-19T03:38:49.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054556+0000", 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185761 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058085+0000", 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003529089 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081142+0000", 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023057281999999998 2024-04-19T03:38:49.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081197+0000", 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4978000000000001e-05 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081245+0000", 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7345999999999997e-05 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.148 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110152 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1605632~4096,write 1675264~4096,write 1921024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.087748609, 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.094148551999999996, 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110152 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995059+0000", 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995075+0000", 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6583e-05 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995086+0000", 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995108+0000", 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1087999999999999e-05 2024-04-19T03:38:49.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058217+0000", 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.063109928999999995 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058309+0000", 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1687999999999994e-05 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058434+0000", 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012497800000000001 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.068998+0000", 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010564053 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089103+0000", 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020104899999999998 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089158+0000", 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4880000000000003e-05 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089208+0000", 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0241000000000002e-05 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110160 4.27 4:e68799fb:::100000001f8.00000018:head [write 2277376~4096,write 2322432~4096,write 2445312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.154 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.085272626, 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.10998324299999999, 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110160 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997535+0000", 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997549+0000", 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4514e-05 2024-04-19T03:38:49.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997561+0000", 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1701e-05 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997569+0000", 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7610000000000007e-06 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095749+0000", 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.098180607000000003 2024-04-19T03:38:49.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095831+0000", 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1689999999999999e-05 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107325+0000", 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011493512000000001 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107444+0000", 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011904 2024-04-19T03:38:49.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107519+0000", 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5278999999999995e-05 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110172 4.36 4:6fa85f86:::100000001f8.00000013:head [write 663552~4096,write 688128~4096,write 921600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.159 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.078371269, 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084877683999999995, 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110172 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:49.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004436+0000", 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004456+0000", 2024-04-19T03:38:49.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0098999999999998e-05 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004470+0000", 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4117999999999999e-05 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004480+0000", 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9809999999999998e-06 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063606+0000", 2024-04-19T03:38:49.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059126074000000001 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063696+0000", 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0105999999999994e-05 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063813+0000", 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116574 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075044+0000", 2024-04-19T03:38:49.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011231507999999999 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089219+0000", 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014175304999999999 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089265+0000", 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5853999999999998e-05 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089315+0000", 2024-04-19T03:38:49.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9366999999999997e-05 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110174 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3280896~4096,write 3293184~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.078281769, 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084998899000000003, 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.165 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110174 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004539+0000", 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3473e-05 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004550+0000", 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0438999999999999e-05 2024-04-19T03:38:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004558+0000", 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0139999999999998e-06 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069043+0000", 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064484737 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069127+0000", 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3905000000000004e-05 2024-04-19T03:38:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069337+0000", 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000210471 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081133+0000", 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011795684000000001 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089438+0000", 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083048649999999998 2024-04-19T03:38:49.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089484+0000", 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6832999999999997e-05 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089525+0000", 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1026000000000003e-05 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.170 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110212 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3047424~8192,write 3063808~4096,write 3076096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.06491802, 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093266469000000005, 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110212 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:49.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017889+0000", 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017905+0000", 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5617e-05 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017915+0000", 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0215e-05 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017923+0000", 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6990000000000003e-06 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097726+0000", 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079803221999999993 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097839+0000", 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112575 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.098019+0000", 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180392 2024-04-19T03:38:49.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111092+0000", 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013072587 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111104+0000", 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.236e-05 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111134+0000", 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9513999999999999e-05 2024-04-19T03:38:49.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111157+0000", 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3156999999999999e-05 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110221 4.36 4:6da220e6:::100000001f8.0000003f:head [write 4096~4096,write 24576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.061250566, 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084587624, 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.176 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110221 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:49.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021557+0000", 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021581+0000", 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4346999999999999e-05 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021594+0000", 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2602999999999999e-05 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021602+0000", 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078747+0000", 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.057145174999999999 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078838+0000", 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0402999999999995e-05 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078969+0000", 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013092900000000001 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084690+0000", 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057209870000000003 2024-04-19T03:38:49.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106035+0000", 2024-04-19T03:38:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021345425000000001 2024-04-19T03:38:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106092+0000", 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6842999999999998e-05 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106145+0000", 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3536999999999999e-05 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.182 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110231 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2793472~4096,write 2838528~4096,write 3112960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.057004404000001, 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083514087000000001, 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110231 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025803+0000", 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025813+0000", 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6220000000000004e-06 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025820+0000", 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5509999999999996e-06 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025825+0000", 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3029999999999999e-06 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084726+0000", 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058900606000000001 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084812+0000", 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6182999999999998e-05 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084984+0000", 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017231700000000001 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089351+0000", 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043671459999999997 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109218+0000", 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019866681000000001 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109263+0000", 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5621000000000002e-05 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109318+0000", 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4435999999999999e-05 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110234 4.6 4:616d4c41:::100000001f8.00000034:head [write 3207168~8192,write 3223552~4096,write 3342336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.055650841, 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085527898000000005, 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.188 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110234 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027172+0000", 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5939000000000001e-05 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027184+0000", 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1139e-05 2024-04-19T03:38:49.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027191+0000", 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089455+0000", 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.062263753999999998 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089534+0000", 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8744000000000004e-05 2024-04-19T03:38:49.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089690+0000", 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156203 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102714+0000", 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013023798 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112600+0000", 2024-04-19T03:38:49.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0098863189999999993 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112649+0000", 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8986000000000002e-05 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112685+0000", 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6251000000000002e-05 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110414 4.36 4:6fa85f86:::100000001f8.00000013:head [write 348160~4096,write 409600~4096,write 438272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.979810059, 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085383260000000002, 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110414 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:49.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102997+0000", 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103011+0000", 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4224e-05 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103023+0000", 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2024e-05 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103032+0000", 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6049999999999998e-06 2024-04-19T03:38:49.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164051+0000", 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.06101939 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164139+0000", 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7497999999999995e-05 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164269+0000", 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013044700000000001 2024-04-19T03:38:49.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.177794+0000", 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013525099 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188243+0000", 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010448834000000001 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188329+0000", 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6120999999999998e-05 2024-04-19T03:38:49.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188381+0000", 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2030000000000002e-05 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:49.199 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2024-04-19T03:38:49.202 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:49.202 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:49.199+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:49.202 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-04-19T03:38:49.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:38:49.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-19T03:38:49.244 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:38:49.244 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[43762]: fuse finished with error 0 and tester_r 0 2024-04-19T03:38:49.303 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:49.302+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:49.371 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:49.371 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:49.371 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:38:49.371 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:49.381 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:49.403 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:49.401+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:49.504 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:49.503+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:49.508 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:49.509 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:49.509 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:49.509 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:49.509 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:49.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:49.605 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:49.604+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.453558710999999, 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:49.688 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:49.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:49.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.452403377000003, 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:49.699 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.450972481000001, 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:49.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:49.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:49.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.450109513000001, 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.449676320999998, 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.709 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.448228284000002, 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.714 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:49.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.447553112999998, 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.720 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:49.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.724 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.446062542999996, 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:49.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:49.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.445660435000001, 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:49.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:49.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:49.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.733 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.445617061, 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:49.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.445585145999999, 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:49.738 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.742 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.444143846999999, 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:49.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.443888407999999, 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.748 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:49.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.443195467000002, 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.606457198999998, 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:49.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.605763355000001, 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:49.763 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:49.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.605361053999999, 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.769 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:49.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:49.774 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.602757199999999, 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:49.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:49.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:49.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.602398495000003, 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:49.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:49.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122534 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1925120~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:49.786 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 9.0252643859999999, 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.084175462000000006, 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122534 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660781+0000", 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:49.788 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660793+0000", 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1924e-05 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660802+0000", 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.346e-06 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660809+0000", 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.866e-06 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.789 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688450+0000", 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027640688 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688513+0000", 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2966000000000007e-05 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688602+0000", 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9671000000000003e-05 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.790 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.698279+0000", 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096766579999999994 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744874+0000", 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.046594407999999997 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744917+0000", 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3127999999999998e-05 2024-04-19T03:38:49.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744957+0000", 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0568000000000002e-05 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:49.792 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:49.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:49.795 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:49.792+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:49.894 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~141s 2024-04-19T03:38:49.895 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:49.894+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:38:49.948 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:49.948 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:49.948 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:38:49.948 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:49.960 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:50.003 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:50.002+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:50.098 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:50.096+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:50.102 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:50.102 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:50.102 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:50.102 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:50.102 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:50.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:50.198 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:50.197+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:50.299 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:50.298+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:50.302 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:50.302 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:50.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:50.302 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:50.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.302 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.056949940000003, 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:50.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:50.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:50.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:50.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:50.310 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.310 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.310 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.310 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:50.310 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:50.310 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.054329318999997, 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.315 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.051885898000002, 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.316 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:50.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.051118252999999, 2024-04-19T03:38:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.040526049, 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.037824925999999, 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.332 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:50.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:50.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:50.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.169729396000001, 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.338 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4:fde182c5:::100000001f8.00000039:head [write 57344~4096,write 999424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:50.343 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.663279776, 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100832459, 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:50.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726148+0000", 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089264587000000006 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726232+0000", 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4432999999999996e-05 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726387+0000", 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015492899999999999 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.730073+0000", 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036859179999999998 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737597+0000", 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075243239999999998 2024-04-19T03:38:50.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737645+0000", 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7920999999999997e-05 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737683+0000", 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7849999999999998e-05 2024-04-19T03:38:50.349 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110110 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2383872~4096,write 2453504~4096,write 2482176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.318598836, 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093470530999999996, 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110110 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981530+0000", 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981548+0000", 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.827e-05 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981562+0000", 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3745e-05 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981572+0000", 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9210000000000004e-06 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045614+0000", 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064041782000000005 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045699+0000", 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4690000000000004e-05 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045898+0000", 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019934600000000001 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054237+0000", 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083394360000000004 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074935+0000", 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020697898999999999 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074966+0000", 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0806999999999998e-05 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075002+0000", 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5879e-05 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110111 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2441216~4096,write 2551808~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.318547231, 2024-04-19T03:38:50.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093517948000000004, 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110111 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981582+0000", 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981596+0000", 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3873000000000001e-05 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981604+0000", 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8420000000000005e-06 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981611+0000", 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0879999999999997e-06 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053316+0000", 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071704618999999997 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053403+0000", 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6757999999999998e-05 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053574+0000", 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017118400000000001 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.057921+0000", 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043469090000000004 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075014+0000", 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017093168999999998 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075063+0000", 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9208e-05 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075101+0000", 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7808999999999997e-05 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.360 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110132 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2691072~4096,write 2813952~4096,write 2932736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.312423372, 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093537876000000006, 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110132 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987706+0000", 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987718+0000", 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987729+0000", 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1590000000000001e-05 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987738+0000", 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4780000000000008e-06 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054265+0000", 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066526945000000004 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054370+0000", 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105499 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054556+0000", 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185761 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058085+0000", 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003529089 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081142+0000", 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023057281999999998 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081197+0000", 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4978000000000001e-05 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081245+0000", 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7345999999999997e-05 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110152 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1605632~4096,write 1675264~4096,write 1921024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.305070591, 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.094148551999999996, 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.366 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110152 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995059+0000", 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995075+0000", 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6583e-05 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995086+0000", 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995108+0000", 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1087999999999999e-05 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058217+0000", 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.063109928999999995 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058309+0000", 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1687999999999994e-05 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058434+0000", 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012497800000000001 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.068998+0000", 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010564053 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089103+0000", 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020104899999999998 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089158+0000", 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4880000000000003e-05 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089208+0000", 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0241000000000002e-05 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110160 4.27 4:e68799fb:::100000001f8.00000018:head [write 2277376~4096,write 2322432~4096,write 2445312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.302594608, 2024-04-19T03:38:50.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.10998324299999999, 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110160 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997535+0000", 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997549+0000", 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4514e-05 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997561+0000", 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1701e-05 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997569+0000", 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7610000000000007e-06 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095749+0000", 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.098180607000000003 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095831+0000", 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1689999999999999e-05 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107325+0000", 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011493512000000001 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107444+0000", 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011904 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107519+0000", 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5278999999999995e-05 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110172 4.36 4:6fa85f86:::100000001f8.00000013:head [write 663552~4096,write 688128~4096,write 921600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.295693250999999, 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084877683999999995, 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110172 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004436+0000", 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004456+0000", 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0098999999999998e-05 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004470+0000", 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4117999999999999e-05 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004480+0000", 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9809999999999998e-06 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063606+0000", 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059126074000000001 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063696+0000", 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0105999999999994e-05 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063813+0000", 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116574 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075044+0000", 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011231507999999999 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089219+0000", 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014175304999999999 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089265+0000", 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5853999999999998e-05 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089315+0000", 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9366999999999997e-05 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110174 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3280896~4096,write 3293184~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.295603751, 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084998899000000003, 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110174 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004539+0000", 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3473e-05 2024-04-19T03:38:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004550+0000", 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0438999999999999e-05 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004558+0000", 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0139999999999998e-06 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069043+0000", 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064484737 2024-04-19T03:38:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069127+0000", 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3905000000000004e-05 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069337+0000", 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000210471 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081133+0000", 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011795684000000001 2024-04-19T03:38:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089438+0000", 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083048649999999998 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089484+0000", 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6832999999999997e-05 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089525+0000", 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1026000000000003e-05 2024-04-19T03:38:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110212 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3047424~8192,write 3063808~4096,write 3076096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.282240002, 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093266469000000005, 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110212 2024-04-19T03:38:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017889+0000", 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017905+0000", 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5617e-05 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017915+0000", 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0215e-05 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017923+0000", 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6990000000000003e-06 2024-04-19T03:38:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097726+0000", 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079803221999999993 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097839+0000", 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112575 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.098019+0000", 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180392 2024-04-19T03:38:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111092+0000", 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013072587 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111104+0000", 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.236e-05 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111134+0000", 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9513999999999999e-05 2024-04-19T03:38:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111157+0000", 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3156999999999999e-05 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110221 4.36 4:6da220e6:::100000001f8.0000003f:head [write 4096~4096,write 24576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.278572548, 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084587624, 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110221 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021557+0000", 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021581+0000", 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4346999999999999e-05 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021594+0000", 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2602999999999999e-05 2024-04-19T03:38:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021602+0000", 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078747+0000", 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.057145174999999999 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078838+0000", 2024-04-19T03:38:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0402999999999995e-05 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078969+0000", 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013092900000000001 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084690+0000", 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057209870000000003 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106035+0000", 2024-04-19T03:38:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021345425000000001 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106092+0000", 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6842999999999998e-05 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106145+0000", 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3536999999999999e-05 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110231 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2793472~4096,write 2838528~4096,write 3112960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.274326386, 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083514087000000001, 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110231 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025803+0000", 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025813+0000", 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6220000000000004e-06 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025820+0000", 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5509999999999996e-06 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025825+0000", 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3029999999999999e-06 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084726+0000", 2024-04-19T03:38:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058900606000000001 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084812+0000", 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6182999999999998e-05 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084984+0000", 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017231700000000001 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089351+0000", 2024-04-19T03:38:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043671459999999997 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109218+0000", 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019866681000000001 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109263+0000", 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5621000000000002e-05 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109318+0000", 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4435999999999999e-05 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110234 4.6 4:616d4c41:::100000001f8.00000034:head [write 3207168~8192,write 3223552~4096,write 3342336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.272972823, 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085527898000000005, 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110234 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027172+0000", 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5939000000000001e-05 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027184+0000", 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1139e-05 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027191+0000", 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089455+0000", 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.062263753999999998 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089534+0000", 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8744000000000004e-05 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089690+0000", 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156203 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102714+0000", 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013023798 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112600+0000", 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0098863189999999993 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112649+0000", 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8986000000000002e-05 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112685+0000", 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6251000000000002e-05 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110414 4.36 4:6fa85f86:::100000001f8.00000013:head [write 348160~4096,write 409600~4096,write 438272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:50.408 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.197132041, 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085383260000000002, 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110414 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102997+0000", 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103011+0000", 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4224e-05 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103023+0000", 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2024e-05 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103032+0000", 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6049999999999998e-06 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164051+0000", 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.06101939 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164139+0000", 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7497999999999995e-05 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164269+0000", 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013044700000000001 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:50.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.177794+0000", 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013525099 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188243+0000", 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010448834000000001 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188329+0000", 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6120999999999998e-05 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:50.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188381+0000", 2024-04-19T03:38:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2030000000000002e-05 2024-04-19T03:38:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:50.414 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:50.414 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:50.415 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:50.416 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:50.414+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:50.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:50.516 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:50.515+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:50.556 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:50.557 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:50.557 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:38:50.557 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:50.568 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:50.618 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:50.616+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:50.643 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:50.664 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:50.668 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:50.668 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:50.718 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:50.717+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:50.736 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:50.736 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:50.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:50.819 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:50.818+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:50.873 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:50.873 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:50.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:50.920 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:50.919+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:51.020 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:51.019+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:51.037 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:51.037 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:51.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:51.121 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:51.120+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:51.191 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:51.192 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:51.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:51.246 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:51.245+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:51.323 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:51.321+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:51.345 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:51.345 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:51.358 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:51.424 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:51.423+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:51.487 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:51.488 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:51.497 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:51.541 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:51.540+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:51.624 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:51.624 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:51.625 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:51.624+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:51.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:51.726 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:51.725+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:51.801 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:51.801 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:51.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:51.828 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:51.827+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:51.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:38:51.928 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:51.927+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:51.964 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:51.965 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:51.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:52.030 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:52.029+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:52.131 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:52.130+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:52.163 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:52.164 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:52.175 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:52.235 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:52.233+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:52.334 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:52.333+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:52.360 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:52.361 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:52.372 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:52.435 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:52.434+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:52.508 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:52.509 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:52.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:52.560 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:52.559+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:52.638 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:52.636+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:52.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:38:52.685 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:52.686 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:52.696 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:52.739 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:52.738+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:52.823 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:52.823 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:52.834 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:52.841 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:52.862 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:52.865 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:52.866 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:52.879 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:52.878+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:52.906 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:38:52.940 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:52.939+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:52.989 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:52.989 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:38:52.989 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:53.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:53.042 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:53.041+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:53.142 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:53.141+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:53.187 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:53.187 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:53.187 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:53.188 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:53.188 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:53.199 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:53.243 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:53.242+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:53.344 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:53.344 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.098590729999998, 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.345 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:53.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:53.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:53.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.095970109, 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:53.356 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.093526687999997, 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:53.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:53.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:53.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:53.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:53.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:53.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:53.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:53.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:53.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.092759043000001, 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:53.363 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:53.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.082166839000003, 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:53.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:53.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.079465716000001, 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 39.211370186000003, 2024-04-19T03:38:53.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4:fde182c5:::100000001f8.00000039:head [write 57344~4096,write 999424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.704920565999998, 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100832459, 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726148+0000", 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089264587000000006 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726232+0000", 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4432999999999996e-05 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726387+0000", 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015492899999999999 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.730073+0000", 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036859179999999998 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737597+0000", 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075243239999999998 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737645+0000", 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7920999999999997e-05 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737683+0000", 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7849999999999998e-05 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110110 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2383872~4096,write 2453504~4096,write 2482176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.360239625999998, 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093470530999999996, 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.390 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110110 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981530+0000", 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981548+0000", 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.827e-05 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981562+0000", 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3745e-05 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981572+0000", 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9210000000000004e-06 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045614+0000", 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064041782000000005 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045699+0000", 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4690000000000004e-05 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045898+0000", 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019934600000000001 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054237+0000", 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083394360000000004 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074935+0000", 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020697898999999999 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074966+0000", 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0806999999999998e-05 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075002+0000", 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5879e-05 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110111 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2441216~4096,write 2551808~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.360188020999999, 2024-04-19T03:38:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093517948000000004, 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110111 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981582+0000", 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981596+0000", 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3873000000000001e-05 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981604+0000", 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8420000000000005e-06 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981611+0000", 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0879999999999997e-06 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053316+0000", 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071704618999999997 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053403+0000", 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6757999999999998e-05 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053574+0000", 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017118400000000001 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.057921+0000", 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043469090000000004 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075014+0000", 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017093168999999998 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075063+0000", 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9208e-05 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075101+0000", 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7808999999999997e-05 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110132 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2691072~4096,write 2813952~4096,write 2932736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.354064162, 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093537876000000006, 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110132 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987706+0000", 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987718+0000", 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987729+0000", 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1590000000000001e-05 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987738+0000", 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4780000000000008e-06 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054265+0000", 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066526945000000004 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054370+0000", 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105499 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054556+0000", 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185761 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058085+0000", 2024-04-19T03:38:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003529089 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081142+0000", 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023057281999999998 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081197+0000", 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4978000000000001e-05 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081245+0000", 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7345999999999997e-05 2024-04-19T03:38:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110152 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1605632~4096,write 1675264~4096,write 1921024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.346711380999999, 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.094148551999999996, 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110152 2024-04-19T03:38:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995059+0000", 2024-04-19T03:38:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995075+0000", 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6583e-05 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995086+0000", 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995108+0000", 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1087999999999999e-05 2024-04-19T03:38:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058217+0000", 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.063109928999999995 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058309+0000", 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1687999999999994e-05 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058434+0000", 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012497800000000001 2024-04-19T03:38:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.068998+0000", 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010564053 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089103+0000", 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020104899999999998 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089158+0000", 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4880000000000003e-05 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089208+0000", 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0241000000000002e-05 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110160 4.27 4:e68799fb:::100000001f8.00000018:head [write 2277376~4096,write 2322432~4096,write 2445312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.344235397999999, 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.10998324299999999, 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110160 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997535+0000", 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997549+0000", 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4514e-05 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997561+0000", 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1701e-05 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997569+0000", 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7610000000000007e-06 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095749+0000", 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.098180607000000003 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095831+0000", 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1689999999999999e-05 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107325+0000", 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011493512000000001 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107444+0000", 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011904 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107519+0000", 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5278999999999995e-05 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110172 4.36 4:6fa85f86:::100000001f8.00000013:head [write 663552~4096,write 688128~4096,write 921600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.337334040999998, 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084877683999999995, 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110172 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004436+0000", 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004456+0000", 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0098999999999998e-05 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004470+0000", 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4117999999999999e-05 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004480+0000", 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9809999999999998e-06 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063606+0000", 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059126074000000001 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063696+0000", 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0105999999999994e-05 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063813+0000", 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116574 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075044+0000", 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011231507999999999 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089219+0000", 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014175304999999999 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089265+0000", 2024-04-19T03:38:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5853999999999998e-05 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089315+0000", 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9366999999999997e-05 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110174 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3280896~4096,write 3293184~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.337244541, 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084998899000000003, 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110174 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004539+0000", 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3473e-05 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004550+0000", 2024-04-19T03:38:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0438999999999999e-05 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004558+0000", 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0139999999999998e-06 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069043+0000", 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064484737 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069127+0000", 2024-04-19T03:38:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3905000000000004e-05 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069337+0000", 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000210471 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081133+0000", 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011795684000000001 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089438+0000", 2024-04-19T03:38:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083048649999999998 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089484+0000", 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6832999999999997e-05 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089525+0000", 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1026000000000003e-05 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110212 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3047424~8192,write 3063808~4096,write 3076096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.323880792000001, 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093266469000000005, 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110212 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017889+0000", 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017905+0000", 2024-04-19T03:38:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5617e-05 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017915+0000", 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0215e-05 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017923+0000", 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6990000000000003e-06 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097726+0000", 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079803221999999993 2024-04-19T03:38:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097839+0000", 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112575 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.098019+0000", 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180392 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111092+0000", 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013072587 2024-04-19T03:38:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111104+0000", 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.236e-05 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111134+0000", 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9513999999999999e-05 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111157+0000", 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3156999999999999e-05 2024-04-19T03:38:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110221 4.36 4:6da220e6:::100000001f8.0000003f:head [write 4096~4096,write 24576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.320213337999999, 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084587624, 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110221 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021557+0000", 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021581+0000", 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4346999999999999e-05 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021594+0000", 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2602999999999999e-05 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021602+0000", 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2024-04-19T03:38:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078747+0000", 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.057145174999999999 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078838+0000", 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0402999999999995e-05 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078969+0000", 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013092900000000001 2024-04-19T03:38:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084690+0000", 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057209870000000003 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106035+0000", 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021345425000000001 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106092+0000", 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6842999999999998e-05 2024-04-19T03:38:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106145+0000", 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3536999999999999e-05 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110231 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2793472~4096,write 2838528~4096,write 3112960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.315967176000001, 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083514087000000001, 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110231 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025803+0000", 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025813+0000", 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6220000000000004e-06 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025820+0000", 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5509999999999996e-06 2024-04-19T03:38:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025825+0000", 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3029999999999999e-06 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084726+0000", 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058900606000000001 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084812+0000", 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6182999999999998e-05 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084984+0000", 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017231700000000001 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089351+0000", 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043671459999999997 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109218+0000", 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019866681000000001 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109263+0000", 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5621000000000002e-05 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109318+0000", 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4435999999999999e-05 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110234 4.6 4:616d4c41:::100000001f8.00000034:head [write 3207168~8192,write 3223552~4096,write 3342336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.314613612999999, 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085527898000000005, 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110234 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027172+0000", 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5939000000000001e-05 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027184+0000", 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1139e-05 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027191+0000", 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089455+0000", 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.062263753999999998 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089534+0000", 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8744000000000004e-05 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089690+0000", 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156203 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102714+0000", 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013023798 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112600+0000", 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0098863189999999993 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112649+0000", 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8986000000000002e-05 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112685+0000", 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6251000000000002e-05 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110414 4.36 4:6fa85f86:::100000001f8.00000013:head [write 348160~4096,write 409600~4096,write 438272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.238772830999999, 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085383260000000002, 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110414 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102997+0000", 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103011+0000", 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4224e-05 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103023+0000", 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2024e-05 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103032+0000", 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6049999999999998e-06 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164051+0000", 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.06101939 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164139+0000", 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7497999999999995e-05 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164269+0000", 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013044700000000001 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.177794+0000", 2024-04-19T03:38:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013525099 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188243+0000", 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010448834000000001 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188329+0000", 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6120999999999998e-05 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188381+0000", 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2030000000000002e-05 2024-04-19T03:38:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:53.453 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:53.453 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:53.342+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:53.454 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:53.456 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:53.455+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:53.557 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:53.556+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:53.588 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:53.588 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:53.588 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:38:53.588 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:53.599 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:53.657 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:53.657+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:53.726 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:53.726 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:53.727 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:53.727 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:53.727 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:53.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:53.758 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:53.757+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:53.859 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:53.858+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:53.907 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:53.907 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:53.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:53.907 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:53.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.907 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.907 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:53.907 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.672488534999999, 2024-04-19T03:38:53.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:53.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:53.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:53.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:53.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:53.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.671333201000003, 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.914 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:53.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:53.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:53.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:53.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:53.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:53.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:53.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:53.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:53.921 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.669902305000001, 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.922 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:53.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:53.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:53.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:53.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.669039337000001, 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:53.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:53.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:53.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.668606144999998, 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:53.939 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:53.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:53.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.667158108000002, 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.944 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:53.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.949 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.666482936999998, 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.953 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.664992366999996, 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.957 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.664590259000001, 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:53.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:53.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:53.961 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.664546885, 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.962 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.664514969999999, 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.966 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:53.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:53.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.663073670999999, 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.970 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:53.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:53.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:53.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:53.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.662818231999999, 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.662125291000002, 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.984 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.825387022999998, 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:53.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:53.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.824693179, 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.990 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.824290877999999, 2024-04-19T03:38:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.821687023999999, 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.821328319000003, 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122534 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1925120~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 13.24419421, 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.084175462000000006, 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122534 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660781+0000", 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660793+0000", 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1924e-05 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660802+0000", 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.346e-06 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660809+0000", 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.866e-06 2024-04-19T03:38:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688450+0000", 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027640688 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688513+0000", 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2966000000000007e-05 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688602+0000", 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9671000000000003e-05 2024-04-19T03:38:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.698279+0000", 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096766579999999994 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744874+0000", 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.046594407999999997 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744917+0000", 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3127999999999998e-05 2024-04-19T03:38:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744957+0000", 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0568000000000002e-05 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:54.017 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:54.019 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:54.017+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:54.019 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:54.120 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:54.119+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:54.170 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:54.171 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:54.171 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2024-04-19T03:38:54.171 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:54.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:54.227 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:54.226+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:54.322 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:54.321+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:54.327 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:54.327 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2024-04-19T03:38:54.327 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2024-04-19T03:38:54.327 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2024-04-19T03:38:54.327 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:54.339 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:54.423 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:54.423+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:54.524 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:54.523+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:54.526 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62835 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1052672~4096,write 1200128~4096,write 1208320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.281163446999997, 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.091072181000000002, 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.527 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62835 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243180+0000", 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243179+0000", 2024-04-19T03:38:54.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243215+0000", 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5315999999999999e-05 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243229+0000", 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3856000000000001e-05 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.243236+0000", 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245366+0000", 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002129662 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245456+0000", 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9946999999999998e-05 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245577+0000", 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121172 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248430+0000", 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028524459999999998 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334163+0000", 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085733107000000003 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334214+0000", 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1252999999999999e-05 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334252+0000", 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8565000000000001e-05 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62840 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1052672~4096,write 1122304~4096,write 1167360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:54.532 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.278542825999999, 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.088579167, 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62840 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245801+0000", 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245800+0000", 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245816+0000", 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6069000000000001e-05 2024-04-19T03:38:54.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245828+0000", 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1844e-05 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.245836+0000", 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9829999999999996e-06 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247061+0000", 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012248840000000001 2024-04-19T03:38:54.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247134+0000", 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3263999999999995e-05 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.247244+0000", 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011033500000000001 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252279+0000", 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050349569999999996 2024-04-19T03:38:54.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334300+0000", 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.082020579999999996 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334344+0000", 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.443e-05 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.334380+0000", 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5775000000000002e-05 2024-04-19T03:38:54.537 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62846 4.6 4:616d4c41:::100000001f8.00000034:head [write 1961984~4096,write 1970176~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.276099404999997, 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087745156000000005, 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.538 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62846 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248244+0000", 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248243+0000", 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248261+0000", 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7377e-05 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248281+0000", 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9809e-05 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248291+0000", 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248429+0000", 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000137997 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248477+0000", 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7660000000000001e-05 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.248570+0000", 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3471e-05 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252283+0000", 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037130050000000001 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335933+0000", 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083649348999999998 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335963+0000", 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0151e-05 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.335989+0000", 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6650999999999999e-05 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62848 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 212992~4096,write 249856~4096,write 602112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.27533176, 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.087087390000000001, 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.543 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62848 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249012+0000", 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249011+0000", 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249025+0000", 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4168999999999999e-05 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249039+0000", 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3963e-05 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.249047+0000", 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7710000000000006e-06 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250501+0000", 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014536429999999999 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250564+0000", 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3408e-05 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.250716+0000", 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015193499999999999 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.252945+0000", 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002229488 2024-04-19T03:38:54.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336040+0000", 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.08309503 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336075+0000", 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4678999999999998e-05 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.336099+0000", 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4303000000000001e-05 2024-04-19T03:38:54.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62874 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3018752~4096,write 3108864~4096,write 3231744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.264739556000002, 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089072812000000001, 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.549 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62874 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259604+0000", 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259603+0000", 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259618+0000", 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4914e-05 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259629+0000", 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0959e-05 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.259637+0000", 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4429999999999997e-06 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.260964+0000", 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001327843 2024-04-19T03:38:54.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261032+0000", 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.261132+0000", 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9967e-05 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.264737+0000", 2024-04-19T03:38:54.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036052889999999998 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348619+0000", 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083881617000000006 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348651+0000", 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2716000000000003e-05 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348677+0000", 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5622e-05 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:62880 4.6 4:616d4c41:::100000001f8.00000034:head [write 3682304~4096,write 3723264~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.262038433000001, 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.086512613000000002, 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.555 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 62880 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262305+0000", 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262304+0000", 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262318+0000", 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.324e-05 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262331+0000", 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3515e-05 2024-04-19T03:38:54.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262340+0000", 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8699999999999998e-06 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262603+0000", 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026341199999999998 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262685+0000", 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1879000000000007e-05 2024-04-19T03:38:54.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.262922+0000", 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023674199999999999 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.265239+0000", 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023173180000000001 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348729+0000", 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083489204999999997 2024-04-19T03:38:54.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348777+0000", 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8381000000000003e-05 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:13.348818+0000", 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1e-05 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.561 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:64789 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1650688~4096,write 1867776~4096,write 1908736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:54.561 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:54.561 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.393942903000003, 2024-04-19T03:38:54.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.097042074000000006, 2024-04-19T03:38:54.561 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.561 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 64789 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130401+0000", 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130400+0000", 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130414+0000", 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3694e-05 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130420+0000", 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:38:54.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.130425+0000", 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.741e-06 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214822+0000", 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084396895 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.214892+0000", 2024-04-19T03:38:54.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9853999999999999e-05 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.215028+0000", 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000136661 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.220515+0000", 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054861420000000003 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227349+0000", 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068340950000000001 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227403+0000", 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4786e-05 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:14.227443+0000", 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9499999999999998e-05 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:102701 4.3f 4:fde182c5:::100000001f8.00000039:head [write 57344~4096,write 999424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.887493283000001, 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.100832459, 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 102701 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.567 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636850+0000", 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636862+0000", 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2044e-05 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636875+0000", 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3526999999999999e-05 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.636883+0000", 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8609999999999998e-06 2024-04-19T03:38:54.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726148+0000", 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.089264587000000006 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726232+0000", 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4432999999999996e-05 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.726387+0000", 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015492899999999999 2024-04-19T03:38:54.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.730073+0000", 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036859179999999998 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737597+0000", 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0075243239999999998 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737645+0000", 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7920999999999997e-05 2024-04-19T03:38:54.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:31.737683+0000", 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7849999999999998e-05 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110110 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2383872~4096,write 2453504~4096,write 2482176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.542812343000001, 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093470530999999996, 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.572 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110110 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981531+0000", 2024-04-19T03:38:54.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981530+0000", 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981548+0000", 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.827e-05 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981562+0000", 2024-04-19T03:38:54.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3745e-05 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981572+0000", 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9210000000000004e-06 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045614+0000", 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064041782000000005 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045699+0000", 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4690000000000004e-05 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.045898+0000", 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019934600000000001 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054237+0000", 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083394360000000004 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074935+0000", 2024-04-19T03:38:54.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020697898999999999 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.074966+0000", 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0806999999999998e-05 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075002+0000", 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5879e-05 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110111 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2441216~4096,write 2551808~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.542760737999998, 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093517948000000004, 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110111 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981583+0000", 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981582+0000", 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981596+0000", 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3873000000000001e-05 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981604+0000", 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8420000000000005e-06 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.981611+0000", 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0879999999999997e-06 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053316+0000", 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.071704618999999997 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053403+0000", 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6757999999999998e-05 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.053574+0000", 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017118400000000001 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.057921+0000", 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043469090000000004 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075014+0000", 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017093168999999998 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075063+0000", 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9208e-05 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075101+0000", 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7808999999999997e-05 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110132 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2691072~4096,write 2813952~4096,write 2932736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.536636879, 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093537876000000006, 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.583 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110132 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987707+0000", 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987706+0000", 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987718+0000", 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987729+0000", 2024-04-19T03:38:54.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1590000000000001e-05 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.987738+0000", 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4780000000000008e-06 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054265+0000", 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.066526945000000004 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054370+0000", 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105499 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.054556+0000", 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000185761 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058085+0000", 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003529089 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081142+0000", 2024-04-19T03:38:54.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.023057281999999998 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081197+0000", 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4978000000000001e-05 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081245+0000", 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7345999999999997e-05 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110152 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1605632~4096,write 1675264~4096,write 1921024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.529284098000002, 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.094148551999999996, 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110152 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995060+0000", 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995059+0000", 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995075+0000", 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6583e-05 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995086+0000", 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0991e-05 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.995108+0000", 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1087999999999999e-05 2024-04-19T03:38:54.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058217+0000", 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.063109928999999995 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058309+0000", 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1687999999999994e-05 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.058434+0000", 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012497800000000001 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.068998+0000", 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010564053 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089103+0000", 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020104899999999998 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089158+0000", 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4880000000000003e-05 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089208+0000", 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0241000000000002e-05 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110160 4.27 4:e68799fb:::100000001f8.00000018:head [write 2277376~4096,write 2322432~4096,write 2445312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:54.594 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.526808115000001, 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.10998324299999999, 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110160 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997536+0000", 2024-04-19T03:38:54.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997535+0000", 2024-04-19T03:38:54.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997549+0000", 2024-04-19T03:38:54.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4514e-05 2024-04-19T03:38:54.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997561+0000", 2024-04-19T03:38:54.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1701e-05 2024-04-19T03:38:54.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:34.997569+0000", 2024-04-19T03:38:54.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7610000000000007e-06 2024-04-19T03:38:54.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095749+0000", 2024-04-19T03:38:54.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.098180607000000003 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.095831+0000", 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1689999999999999e-05 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107325+0000", 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011493512000000001 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107444+0000", 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011904 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.107519+0000", 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5278999999999995e-05 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110172 4.36 4:6fa85f86:::100000001f8.00000013:head [write 663552~4096,write 688128~4096,write 921600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.602 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.519906758000001, 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084877683999999995, 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110172 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004437+0000", 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004436+0000", 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004456+0000", 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0098999999999998e-05 2024-04-19T03:38:54.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004470+0000", 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4117999999999999e-05 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004480+0000", 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9809999999999998e-06 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063606+0000", 2024-04-19T03:38:54.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.059126074000000001 2024-04-19T03:38:54.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063696+0000", 2024-04-19T03:38:54.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0105999999999994e-05 2024-04-19T03:38:54.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.063813+0000", 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000116574 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.075044+0000", 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011231507999999999 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089219+0000", 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014175304999999999 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089265+0000", 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5853999999999998e-05 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089315+0000", 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9366999999999997e-05 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110174 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3280896~4096,write 3293184~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:54.608 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.519817258, 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084998899000000003, 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110174 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004526+0000", 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004539+0000", 2024-04-19T03:38:54.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3473e-05 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004550+0000", 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0438999999999999e-05 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.004558+0000", 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0139999999999998e-06 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069043+0000", 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.064484737 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069127+0000", 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3905000000000004e-05 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.069337+0000", 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000210471 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.081133+0000", 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011795684000000001 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089438+0000", 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083048649999999998 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089484+0000", 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6832999999999997e-05 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089525+0000", 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1026000000000003e-05 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110212 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3047424~8192,write 3063808~4096,write 3076096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.506453509, 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.093266469000000005, 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.614 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110212 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017890+0000", 2024-04-19T03:38:54.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017889+0000", 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017905+0000", 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5617e-05 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017915+0000", 2024-04-19T03:38:54.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0215e-05 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.017923+0000", 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6990000000000003e-06 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097726+0000", 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.079803221999999993 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.097839+0000", 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112575 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.098019+0000", 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000180392 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111092+0000", 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013072587 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111104+0000", 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.236e-05 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111134+0000", 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9513999999999999e-05 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.111157+0000", 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3156999999999999e-05 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110221 4.36 4:6da220e6:::100000001f8.0000003f:head [write 4096~4096,write 24576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.502786055000001, 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.084587624, 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110221 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021558+0000", 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021557+0000", 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021581+0000", 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4346999999999999e-05 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021594+0000", 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2602999999999999e-05 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.021602+0000", 2024-04-19T03:38:54.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078747+0000", 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.057145174999999999 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078838+0000", 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0402999999999995e-05 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.078969+0000", 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013092900000000001 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084690+0000", 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057209870000000003 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106035+0000", 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.021345425000000001 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106092+0000", 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6842999999999998e-05 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.106145+0000", 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3536999999999999e-05 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110231 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2793472~4096,write 2838528~4096,write 3112960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.498539893, 2024-04-19T03:38:54.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.083514087000000001, 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110231 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025804+0000", 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025803+0000", 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025813+0000", 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6220000000000004e-06 2024-04-19T03:38:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025820+0000", 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5509999999999996e-06 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.025825+0000", 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3029999999999999e-06 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084726+0000", 2024-04-19T03:38:54.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.058900606000000001 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084812+0000", 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6182999999999998e-05 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.084984+0000", 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017231700000000001 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089351+0000", 2024-04-19T03:38:54.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0043671459999999997 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109218+0000", 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019866681000000001 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109263+0000", 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5621000000000002e-05 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.109318+0000", 2024-04-19T03:38:54.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4435999999999999e-05 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110234 4.6 4:616d4c41:::100000001f8.00000034:head [write 3207168~8192,write 3223552~4096,write 3342336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.497186330000002, 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085527898000000005, 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110234 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027157+0000", 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027172+0000", 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5939000000000001e-05 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027184+0000", 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1139e-05 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.027191+0000", 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089455+0000", 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.062263753999999998 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089534+0000", 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8744000000000004e-05 2024-04-19T03:38:54.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.089690+0000", 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156203 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102714+0000", 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013023798 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112600+0000", 2024-04-19T03:38:54.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0098863189999999993 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112649+0000", 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8986000000000002e-05 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.112685+0000", 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6251000000000002e-05 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4526.0:110414 4.36 4:6fa85f86:::100000001f8.00000013:head [write 348160~4096,write 409600~4096,write 438272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.421345548000001, 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.085383260000000002, 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4526", 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 110414 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2024-04-19T03:38:54.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102998+0000", 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.102997+0000", 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103011+0000", 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4224e-05 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103023+0000", 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2024e-05 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.103032+0000", 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6049999999999998e-06 2024-04-19T03:38:54.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164051+0000", 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.06101939 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164139+0000", 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7497999999999995e-05 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.164269+0000", 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013044700000000001 2024-04-19T03:38:54.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.177794+0000", 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013525099 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188243+0000", 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010448834000000001 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188329+0000", 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6120999999999998e-05 2024-04-19T03:38:54.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2024-04-19T03:38:35.188381+0000", 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2030000000000002e-05 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-19T03:38:54.642 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-19T03:38:54.643 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:54.642+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:54.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:54.745 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:54.743+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:54.784 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:54.784 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:54.784 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-19T03:38:54.784 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:54.794 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:54.846 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:54.844+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:54.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:38:54.920 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-19T03:38:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-19T03:38:54.921 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-19T03:38:54.921 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:54.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:38:54.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:54.975 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:54.974+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:55.047 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:55.046+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:55.050 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-04-19T03:38:55.059 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62814 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3108864~4096,write 3170304~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.825593619000003, 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.081245950999999997, 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.060 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62814 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232487+0000", 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232501+0000", 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4609e-05 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232513+0000", 2024-04-19T03:38:55.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1929999999999999e-05 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.232520+0000", 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3749999999999997e-06 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234673+0000", 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0021522659999999999 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.234751+0000", 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7830000000000005e-05 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313613+0000", 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078862288000000003 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313660+0000", 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7213999999999999e-05 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313733+0000", 2024-04-19T03:38:55.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3386000000000005e-05 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62815 4.37 4:ef395e89:::100000001f8.00000020:head [write 2097152~4096,write 2318336~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.824438284999999, 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077423652999999995, 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.065 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62815 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233643+0000", 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233642+0000", 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233655+0000", 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3551e-05 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233666+0000", 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1201e-05 2024-04-19T03:38:55.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233674+0000", 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233734+0000", 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0089e-05 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233814+0000", 2024-04-19T03:38:55.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0216999999999994e-05 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.233970+0000", 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155148 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242220+0000", 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082508340000000003 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.310978+0000", 2024-04-19T03:38:55.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068757709 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311026+0000", 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8115000000000003e-05 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311066+0000", 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0281000000000003e-05 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62817 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 172032~4096,write 262144~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.823007388999997, 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.076149026999999994, 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62817 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235074+0000", 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235073+0000", 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235105+0000", 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2478000000000003e-05 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235118+0000", 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2510000000000001e-05 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235125+0000", 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236646+0000", 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001520925 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236719+0000", 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.3061999999999999e-05 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236837+0000", 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000118255 2024-04-19T03:38:55.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242262+0000", 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0054245350000000003 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311141+0000", 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068878841999999996 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311188+0000", 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6859e-05 2024-04-19T03:38:55.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311223+0000", 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5049000000000003e-05 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62818 4.3b e58/14 4:dcc0c15f:::100000001f8.0000001a:head v 58'964, mlcod=58'962)", 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.822144420999997, 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075104862999999994, 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.076 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235937+0000", 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235936+0000", 2024-04-19T03:38:55.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235956+0000", 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9466999999999998e-05 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235964+0000", 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.7579999999999998e-06 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.235971+0000", 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4280000000000001e-06 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236028+0000", 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7354e-05 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236049+0000", 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0639999999999999e-05 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311007+0000", 2024-04-19T03:38:55.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074958151000000001 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311042+0000", 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4690000000000002e-05 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62820 4.11 4:893be98d:::100000001f8.00000001:head [write 3276800~8192,write 3293184~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.821711229000002, 2024-04-19T03:38:55.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079033813999999994, 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62820 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236370+0000", 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236369+0000", 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236407+0000", 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8334999999999998e-05 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236420+0000", 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2981e-05 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.236428+0000", 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1559999999999995e-06 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238117+0000", 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001688656 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238216+0000", 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8920999999999997e-05 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315287+0000", 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077071255000000005 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315333+0000", 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6131000000000003e-05 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.315404+0000", 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0392e-05 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62824 4.37 4:eff9002a:::100000001f8.00000003:head [write 741376~4096 in=4096b,write 770048~4096 in=4096b,write 856064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.820263191999999, 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.079742574999999996, 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.085 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62824 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237818+0000", 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237817+0000", 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237852+0000", 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4663999999999999e-05 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237861+0000", 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.781e-06 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.237870+0000", 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.1510000000000004e-06 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242310+0000", 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044408770000000002 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242381+0000", 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0755999999999998e-05 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242475+0000", 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4228000000000007e-05 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.302326+0000", 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.059850992999999998 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317399+0000", 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015072198 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317448+0000", 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9041e-05 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317560+0000", 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00011285600000000001 2024-04-19T03:38:55.090 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62825 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1979, mlcod=58'1976)", 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.819588021000001, 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075111676000000002, 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238493+0000", 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238492+0000", 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238506+0000", 2024-04-19T03:38:55.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3868e-05 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238516+0000", 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.312e-06 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238522+0000", 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.348e-06 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238552+0000", 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0457999999999999e-05 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.238566+0000", 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3192e-05 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313576+0000", 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075010131999999993 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.313605+0000", 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9026e-05 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62827 4.14 e58/14 4:2b28d75f:::100000001f8.00000016:head v 58'954, mlcod=58'952)", 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.818097451, 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077597511999999993, 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239984+0000", 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239983+0000", 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239992+0000", 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9700000000000005e-06 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239996+0000", 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8820000000000003e-06 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.239999+0000", 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8150000000000002e-06 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240029+0000", 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.9980000000000001e-05 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240042+0000", 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317556+0000", 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077514088999999994 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317581+0000", 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5208999999999999e-05 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62828 4.15 e58/14 4:aada5e43:::100000001f8.00000028:head v 58'1013, mlcod=58'1011)", 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.817695342999997, 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077623929999999994, 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240386+0000", 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240385+0000", 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240405+0000", 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0013999999999998e-05 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240413+0000", 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2300000000000008e-06 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240420+0000", 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.251e-06 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240455+0000", 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5235999999999999e-05 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240467+0000", 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2306999999999999e-05 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.317978+0000", 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077510342999999995 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318010+0000", 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2070000000000003e-05 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62829 4.6 e58/14 4:616d4c41:::100000001f8.00000034:head v 58'3899, mlcod=58'3895)", 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.817651969000003, 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.07761738, 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.103 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240429+0000", 2024-04-19T03:38:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240445+0000", 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.5860000000000001e-05 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240452+0000", 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.0199999999999997e-06 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240456+0000", 2024-04-19T03:38:55.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0380000000000001e-06 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240614+0000", 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015837499999999999 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240626+0000", 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1902999999999999e-05 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318021+0000", 2024-04-19T03:38:55.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077395190000000003 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318046+0000", 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5306000000000001e-05 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62826 4.28 e58/14 4:153ae410:::100000001f8.0000003b:head v 58'1980, mlcod=58'1976)", 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.817620054000002, 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078176077999999996, 2024-04-19T03:38:55.107 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240461+0000", 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240469+0000", 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0590000000000003e-06 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240474+0000", 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240478+0000", 2024-04-19T03:38:55.109 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240507+0000", 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8804999999999999e-05 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.240524+0000", 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6803000000000002e-05 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318612+0000", 2024-04-19T03:38:55.110 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078088115 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318637+0000", 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5092e-05 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62832 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 745472~4096 in=4096b,write 991232~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.816178755000003, 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.089431753000000003, 2024-04-19T03:38:55.111 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62832 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.112 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241902+0000", 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241901+0000", 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241916+0000", 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4594e-05 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.113 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241928+0000", 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2863e-05 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.241937+0000", 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296188+0000", 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.054250806999999998 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296267+0000", 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9146000000000004e-05 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.296403+0000", 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013591800000000001 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311134+0000", 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014730762999999999 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.115 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331246+0000", 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.020112601000000001 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331294+0000", 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.7839000000000001e-05 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.331334+0000", 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9925000000000001e-05 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.116 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_repop(client.4526.0:62830 4.6 e58/14 4:62d56fc8:::100000001f8.0000001c:head v 58'3900, mlcod=58'3895)", 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.815923316000003, 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075906882999999994, 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.117 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242158+0000", 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242157+0000", 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242171+0000", 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3916e-05 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.118 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242178+0000", 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.187e-06 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242183+0000", 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0470000000000001e-06 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242446+0000", 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00026278400000000001 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242460+0000", 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.4243999999999999e-05 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318049+0000", 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.075588428999999999 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.318065+0000", 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6001000000000001e-05 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.120 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:62834 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 139264~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 41.815230374999999, 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.091185975000000002, 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 62834 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.121 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242851+0000", 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242850+0000", 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242863+0000", 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.3232e-05 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242874+0000", 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0797e-05 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.242882+0000", 2024-04-19T03:38:55.123 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.943e-06 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311251+0000", 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.068369113999999995 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.311357+0000", 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010662000000000001 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333702+0000", 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.022344507 2024-04-19T03:38:55.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.333743+0000", 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1343e-05 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:13.334037+0000", 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00029338900000000002 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.125 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64679 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3117056~4096,write 3289088~4096,write 3612672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.978492107000001, 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.078718377000000006, 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64679 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.126 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079589+0000", 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079588+0000", 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.127 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079621+0000", 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2576000000000001e-05 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079631+0000", 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0403e-05 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079639+0000", 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.128 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079706+0000", 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7274000000000007e-05 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079799+0000", 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.2866000000000002e-05 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.079962+0000", 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016313800000000001 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.129 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086609+0000", 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0066470330000000001 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158169+0000", 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071560215999999996 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158259+0000", 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9441e-05 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.130 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158307+0000", 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8545999999999999e-05 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64681 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3739648~4096,write 3817472~4096,write 3981312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.977798262999997, 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077844631999999997, 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.131 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64681 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080283+0000", 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080282+0000", 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080323+0000", 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1060999999999999e-05 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080331+0000", 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.3489999999999992e-06 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.133 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080337+0000", 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0090000000000004e-06 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080380+0000", 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2200000000000003e-05 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080457+0000", 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7081000000000003e-05 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080624+0000", 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016747100000000001 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085260+0000", 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046356770000000004 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158070+0000", 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.072810347999999997 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.135 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158104+0000", 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4050000000000001e-05 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158127+0000", 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3149000000000001e-05 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64682 4.23 4:c6f90462:::100000001f8.00000037:head [write 1499136~4096,write 1552384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:55.136 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.977395962000003, 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.077765524000000003, 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64682 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.137 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080685+0000", 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080684+0000", 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080704+0000", 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9811999999999999e-05 2024-04-19T03:38:55.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080713+0000", 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.3819999999999993e-06 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080721+0000", 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.4050000000000003e-06 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080761+0000", 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0408999999999999e-05 2024-04-19T03:38:55.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080829+0000", 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7408000000000002e-05 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.080955+0000", 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012621999999999999 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.085241+0000", 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042864089999999997 2024-04-19T03:38:55.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158366+0000", 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.073124963000000001 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158413+0000", 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6740999999999999e-05 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158451+0000", 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7617999999999998e-05 2024-04-19T03:38:55.141 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64690 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1507328~4096,write 2023424~4096,write 2064384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.974792108000003, 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074954124999999996, 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64690 2024-04-19T03:38:55.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083289+0000", 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083288+0000", 2024-04-19T03:38:55.143 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083320+0000", 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2159999999999997e-05 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083332+0000", 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1921e-05 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083339+0000", 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7859999999999999e-06 2024-04-19T03:38:55.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083374+0000", 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4492000000000001e-05 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083446+0000", 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2787999999999995e-05 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083580+0000", 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000133277 2024-04-19T03:38:55.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.087927+0000", 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004346941 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158167+0000", 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.070240918999999999 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158212+0000", 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4524999999999998e-05 2024-04-19T03:38:55.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158243+0000", 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1134999999999999e-05 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:64691 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2437120~8192,write 2465792~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.974433402999999, 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.074770970000000006, 2024-04-19T03:38:55.147 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 64691 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083648+0000", 2024-04-19T03:38:55.148 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083647+0000", 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083701+0000", 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.3829999999999998e-05 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083711+0000", 2024-04-19T03:38:55.149 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0798999999999999e-05 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.083717+0000", 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084758+0000", 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001040839 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.150 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084834+0000", 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5916999999999998e-05 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.084989+0000", 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015512800000000001 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.086830+0000", 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0018412019999999999 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.151 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158347+0000", 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.071517135999999995 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158387+0000", 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9425999999999998e-05 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:14.158419+0000", 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1841999999999998e-05 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4526.0:122534 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1925120~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 14.397299294, 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.084175462000000006, 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4526", 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "192.168.0.1:0/371913714", 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 122534 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.153 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660782+0000", 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660781+0000", 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.154 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660793+0000", 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1924e-05 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660802+0000", 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.346e-06 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.660809+0000", 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.866e-06 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.155 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688450+0000", 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.027640688 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688513+0000", 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2966000000000007e-05 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.688602+0000", 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.9671000000000003e-05 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.156 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.698279+0000", 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0096766579999999994 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744874+0000", 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.046594407999999997 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744917+0000", 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3127999999999998e-05 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-19T03:38:55.157 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-19T03:38:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-19T03:38:40.744957+0000", 2024-04-19T03:38:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.0568000000000002e-05 2024-04-19T03:38:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-19T03:38:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-19T03:38:55.158 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-19T03:38:55.159 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1: {} 2024-04-19T03:38:55.160 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:38:55.160 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:55.159+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:55.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:38:55.161 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:38:55.161 INFO:teuthology.orchestra.run.smithi005.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:38:55.161 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-19T03:38:55.162 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:38:55.260 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:55.259+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:55.313 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:55.313 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:55.324 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:38:55.346 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-19T03:38:55.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:38:55.346 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-19T03:38:55.366 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:55.365+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:55.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:38:55.377 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-19T03:38:55.439 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-19T03:38:55.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:38:55.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-19T03:38:55.461 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-04-19T03:38:55.459+0000 7f3b5ff46700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40321) UID: 0 2024-04-19T03:38:55.511 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:55.511 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:55.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:38:55.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-19T03:38:55.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-19T03:38:55.562 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-19T03:38:55.561+0000 7f83d421b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40276) UID: 0 2024-04-19T03:38:55.600 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-19T03:38:55.610 INFO:tasks.thrashosds:joining thrashosds 2024-04-19T03:38:55.708 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:55.708 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:55.719 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:38:55.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~147s 2024-04-19T03:38:55.849 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:55.849 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:55.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:38:55.913 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-04-19T03:38:55.987 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:55.988 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:55.998 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:38:56.124 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-19T03:38:56.125 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:38:57.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:38:58.379 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-04-19T03:38:58.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:38:59.386 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-04-19T03:39:01.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2024-04-19T03:39:07.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~158s 2024-04-19T03:39:09.320 DEBUG:teuthology.orchestra.console.smithi129:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  nt GE v1. PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 72 61 GUID: 00000000 0000 0000 0000 0CC47AD91938 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.129 M : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.129 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:72:61)... Configuring (net0 0c:c4:7a:88:72:61).... Configuring (net0 0c:c4:7a:88:72:61)..... Configuring (net0 0c:c4:7a:88:72:61)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)  Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6>              The selected entry will be started automatically in 5s.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6*            The selected entry will be started automatically in 4s.   Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 4.18.0-513.9.1.el8_9.x86_64 (mockbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-20) (GCC)) #1 SMP Thu Nov 16 10:29:04 EST 2023 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec0fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f73000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.047 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ec1 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34850000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D48F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ec0fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29109 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ec1000-0x78f72fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f73000-0x798acfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228741 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1755076K/33437996K available (14341K kernel code, 5952K rwdata, 8520K rodata, 2608K init, 26336K bss, 949692K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 40939 entries in 160 pages [ 0.000000] ftrace: allocated 160 pages with 2 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001004] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003005] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013037] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014484] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32737d98d1a, max_idle_ns: 440795362231 ns [ 0.020000] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.09 BogoMIPS (lpj=3500047) [ 0.021001] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025022] LSM support for eBPF active [ 0.030543] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033917] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034077] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035077] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.037095] CPU0: Thermal monitoring enabled (TM1) [ 0.038055] process: using mwait in idle threads [ 0.039002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.040000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.041002] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.042001] Spectre V2 : Mitigation: Retpolines [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.044000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.045000] Speculative Store Bypass: Vulnerable [ 0.046004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.048000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050749] Freeing SMP alternatives memory: 36K [ 0.051197] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.154517] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.156100] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.157001] ... version: 3 [ 0.158000] ... bit width: 48 [ 0.159000] ... generic registers: 4 [ 0.160000] ... value mask: 0000ffffffffffff [ 0.161000] ... max period: 00007fffffffffff [ 0.162000] ... fixed-purpose events: 3 [ 0.163000] ... event mask: 000000070000000f [ 0.164030] rcu: Hierarchical SRCU implementation. [ 0.166058] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.167016] smp: Bringing up secondary CPUs ... [ 0.168071] x86: Booting SMP configuration: [ 0.169001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.172117] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.174001] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.175001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.176093] #5 #6 #7 [ 0.177549] smp: Brought up 1 node, 8 CPUs [ 0.179001] smpboot: Max logical packages: 1 [ 0.180001] smpboot: Total of 8 processors activated (56000.75 BogoMIPS) [ 0.223020] node 0 deferred pages initialised in 41ms [ 0.229241] devtmpfs: initialized [ 0.230041] x86/mm: Memory block size: 128MB [ 0.233615] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 0.242084] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.252007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.259059] pinctrl core: initialized pinctrl subsystem [ 0.264121] NET: Registered protocol family 16 [ 0.269079] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.276012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.284010] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.292019] audit: initializing netlink subsys (disabled) [ 0.297010] audit: type=2000 audit(1713497919.297:1): state=initialized audit_enabled=0 res=1 [ 0.306002] cpuidle: using governor menu [ 0.309029] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.317002] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.324051] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.333001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.340013] PCI: Using configuration type 1 for base access [ 0.347012] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.353002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.360023] cryptd: max_cpu_qlen set to 1000 [ 0.364050] ACPI: Added _OSI(Module Device) [ 0.369002] ACPI: Added _OSI(Processor Device) [ 0.373006] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.378001] ACPI: Added _OSI(Processor Aggregator Device) [ 0.383002] ACPI: Added _OSI(Linux-Dell-Video) [ 0.388003] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.393001] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.426960] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.436036] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.446097] ACPI: Dynamic OEM Table Load: [ 0.467203] ACPI: Interpreter enabled [ 0.471011] ACPI: PM: (supports S0 S4 S5) [ 0.475000] ACPI: Using IOAPIC for interrupt routing [ 0.480021] HEST: Enabling Firmware First mode for corrected errors. [ 0.486056] HEST: Table parsing has been initialized. [ 0.491002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.500616] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.531901] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.538003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.548716] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.557373] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.565000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.573037] PCI host bridge to bus 0000:ff [ 0.577002] pci_bus 0000:ff: root bus resource [bus ff] [ 0.582010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.588043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.594033] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.600032] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.606033] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.612032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.619035] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.625032] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.631032] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.637030] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.643031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.649031] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.655031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.661033] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.667030] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.673034] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.679027] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.685032] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.691031] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.697022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.703037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.709061] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.715043] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.721037] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.727046] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.733043] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.739041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.745034] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.751034] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.757043] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.763042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.769043] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.775042] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.781034] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.788024] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.794034] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.800034] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.806044] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.812043] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.818044] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.824043] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.830043] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.836034] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.842035] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.848037] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.854033] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.860033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.866035] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.872037] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.878032] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.884031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.890034] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.896027] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.902036] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.908033] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.917351] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.923003] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.933087] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.941225] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.949001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.957523] PCI host bridge to bus 0000:00 [ 0.961001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.968000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.975000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.982000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.990000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.997000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.005001] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.010025] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.016100] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.022042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.029087] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.035041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.041085] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.047020] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.053091] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.059007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.066068] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.072007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.079078] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.085007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.092077] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.098007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.105077] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.111008] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.117067] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.123008] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.130042] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.136007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.143078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.149007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.156073] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.162067] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.168083] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.174059] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.180005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.187076] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.193160] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.199012] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.204006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.210006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.215006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.221007] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.227006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.233029] pci 0000:00:11.4: PME# supported from D3hot [ 1.238074] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.244014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.251050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.257090] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.263014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.270052] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.276061] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.282014] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.289051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.295060] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.301013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.307073] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.313071] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.319066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.326078] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.332067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.338056] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.344037] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.350084] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.356013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.362073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.369076] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.375159] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.381009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.386005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.392005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.398005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.403005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.409005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.415023] pci 0000:00:1f.2: PME# supported from D3hot [ 1.420063] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.426013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.433016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.439168] acpiphp: Slot [1] registered [ 1.443014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.448125] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.454009] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.461016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.467003] pci 0000:02:00.0: enabling Extended Tags [ 1.472064] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.477003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.484126] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.490010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.498004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.503010] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.510004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.517038] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.523015] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.530001] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.541008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.548000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.558081] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.564010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.572004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.577009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.584004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.591039] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.597014] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.605000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.615008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.622001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.632081] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.637002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.644001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.650002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.658030] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.663060] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.669065] pci 0000:05:00.0: enabling Extended Tags [ 1.674070] pci 0000:05:00.0: supports D1 D2 [ 1.678000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.685089] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.690002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.696002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.703040] pci_bus 0000:06: extended config space not accessible [ 1.709033] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.715023] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.722012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.728012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.733097] pci 0000:06:00.0: supports D1 D2 [ 1.738000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.744111] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.750007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.756003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.762070] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.768017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.775018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.780009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.787119] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.793035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.800000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.810021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.818000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.828096] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.834018] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.840018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.846009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.852116] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.858034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.866000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.876018] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.883000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.893152] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.898002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.904002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.911003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.918463] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.925036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.931034] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.937035] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.943034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.949001] ACPI: PCI: Interrupt link LNKE disabled [ 1.953042] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.959001] ACPI: PCI: Interrupt link LNKF disabled [ 1.964047] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.970001] ACPI: PCI: Interrupt link LNKG disabled [ 1.975035] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.981000] ACPI: PCI: Interrupt link LNKH disabled [ 1.986181] iommu: Default domain type: Passthrough [ 1.991071] SCSI subsystem initialized [ 1.995016] ACPI: bus type USB registered [ 1.999006] usbcore: registered new interface driver usbfs [ 2.004006] usbcore: registered new interface driver hub [ 2.010005] usbcore: registered new device driver usb [ 2.015020] pps_core: LinuxPPS API ver. 1 registered [ 2.020000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.029004] PTP clock support registered [ 2.033017] EDAC MC: Ver: 3.0.0 [ 2.036113] PCI: Using ACPI for IRQ routing [ 2.045387] NetLabel: Initializing [ 2.049001] NetLabel: domain hash size = 128 [ 2.053000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.059011] NetLabel: unlabeled traffic allowed by default [ 2.065021] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.066000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.079001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.085000] vgaarb: loaded [ 2.088045] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.094001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.102029] clocksource: Switched to clocksource tsc-early [ 2.118211] VFS: Disk quotas dquot_6.6.0 [ 2.122140] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.129067] pnp: PnP ACPI init [ 2.132510] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.138426] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.144342] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.150255] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.156172] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.162084] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.167993] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.174599] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.181202] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.187805] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.194410] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.201013] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.207618] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.214407] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.220326] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.226234] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.232146] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.238056] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.244785] pnp: PnP ACPI: found 5 devices [ 2.254378] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.263278] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.274750] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.282568] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.287530] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.292492] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.299273] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.306835] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.314742] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.322391] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.330382] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.337939] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.345846] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.353488] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.361479] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.369037] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.376940] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.384584] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.392575] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.400132] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.408036] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.415680] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.423672] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.428630] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.434715] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.441490] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.449224] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.454195] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.459155] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.465241] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.472032] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.477249] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.483335] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.490115] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.497853] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.505679] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.513420] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.521245] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.526209] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.532295] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.539079] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.546811] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.555839] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.562011] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.568181] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.575044] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.581909] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.588774] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.595637] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.601894] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.607457] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.613715] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.620927] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.626490] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.632747] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.638313] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.644572] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.650134] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.656391] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.663710] NET: Registered protocol family 2 [ 2.668273] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.677542] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.686409] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.694827] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.702412] TCP: Hash tables configured (established 262144 bind 65536) [ 2.709130] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.716870] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.723892] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.731362] NET: Registered protocol family 1 [ 2.735722] NET: Registered protocol family 44 [ 2.740247] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.764122] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16275 usecs [ 2.788132] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 16217 usecs [ 2.795539] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.801990] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.810375] Unpacking initramfs... [ 3.098277] Freeing initrd memory: 28480K [ 3.102348] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.108780] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.116698] ACPI: bus type thunderbolt registered [ 3.123042] Initialise system trusted keyrings [ 3.127494] Key type blacklist registered [ 3.131528] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.139426] zbud: loaded [ 3.142278] pstore: using deflate compression [ 3.146823] Platform Keyring initialized [ 3.189481] NET: Registered protocol family 38 [ 3.193922] Key type asymmetric registered [ 3.198013] Asymmetric key parser 'x509' registered [ 3.202883] Running certificate verification selftests [ 3.233486] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.244381] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.251810] io scheduler mq-deadline registered [ 3.256340] io scheduler kyber registered [ 3.260371] io scheduler bfq registered [ 3.264262] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.271468] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.277374] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.283269] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.289163] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.295047] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.300912] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.306786] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.314099] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.322488] ACPI: Power Button [PWRB] [ 3.326181] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.333596] ACPI: Power Button [PWRF] [ 3.338297] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.345801] pstore: Registered erst as persistent store backend [ 3.351870] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 3.359342] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.386192] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.414092] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.421749] Non-volatile memory driver v1.3 [ 3.426338] rdac: device handler registered [ 3.430584] hp_sw: device handler registered [ 3.434851] emc: device handler registered [ 3.439007] alua: device handler registered [ 3.443253] libphy: Fixed MDIO Bus: probed [ 3.447610] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.452890] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.460286] ehci-pci 0000:00:1d.0: debug port 2 [ 3.468728] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.481057] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.486847] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.495101] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.502313] usb usb1: Product: EHCI Host Controller [ 3.507182] usb usb1: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.514393] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.519110] hub 1-0:1.0: USB hub found [ 3.522871] hub 1-0:1.0: 2 ports detected [ 3.527023] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.532286] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.540724] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.549998] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.550024] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.555260] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.560486] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.567817] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.575214] ehci-pci 0000:00:1a.0: debug port 2 [ 3.581480] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.589910] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.594230] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.606032] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.607094] usb usb2: Product: xHCI Host Controller [ 3.617699] usb usb2: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.624911] usb usb2: SerialNumber: 0000:00:14.0 [ 3.629659] hub 2-0:1.0: USB hub found [ 3.633427] hub 2-0:1.0: 15 ports detected [ 3.640218] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.648477] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.655687] usb usb4: Product: EHCI Host Controller [ 3.660556] usb usb4: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.667771] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.672520] hub 4-0:1.0: USB hub found [ 3.676324] hub 4-0:1.0: 2 ports detected [ 3.680463] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.688719] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.695935] usb usb3: Product: xHCI Host Controller [ 3.700807] usb usb3: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.708016] usb usb3: SerialNumber: 0000:00:14.0 [ 3.712764] hub 3-0:1.0: USB hub found [ 3.716523] hub 3-0:1.0: 6 ports detected [ 3.722234] usbcore: registered new interface driver usbserial_generic [ 3.728762] usbserial: USB Serial support registered for generic [ 3.734789] i8042: PNP: No PS/2 controller found. [ 3.739540] mousedev: PS/2 mouse device common for all mice [ 3.745171] rtc_cmos 00:00: RTC can wake from S4 [ 3.749996] rtc_cmos 00:00: registered as rtc0 [ 3.754450] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.762232] intel_pstate: Intel P-state driver initializing [ 3.768949] hid: raw HID events driver (C) Jiri Kosina [ 3.772035] usb 1-new high-speed USB device number 2 using ehci-pci [ 3.774121] usbcore: registered new interface driver usbhid [ 3.786165] usbhid: USB HID core driver [ 3.790083] drop_monitor: Initializing network drop monitor service [ 3.796386] Initializing XFRM netlink socket [ 3.800723] NET: Registered protocol family 10 [ 3.805391] Segment Routing with IPv6 [ 3.809067] NET: Registered protocol family 17 [ 3.813575] mpls_gso: MPLS GSO support [ 3.817774] microcode: Microcode Update Driver: v2.2. [ 3.817827] resctrl: L3 allocation detected [ 3.827048] resctrl: L3 monitoring detected [ 3.831232] AVX2 version of gcm_enc/dec engaged. [ 3.835842] AES CTR mode by8 optimization enabled [ 3.850696] sched_clock: Marking stable (3850690965, 0)->(5653297251, -1802606286) [ 3.858337] registered taskstats version 1 [ 3.862579] Loading compiled-in X.509 certificates [ 3.867637] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 3b1bc9a9bf3bdfe93ac380c73845d894639c5bcf' [ 3.878511] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.890339] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.893034] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.900977] zswap: loaded using pool lzo/zbud [ .908410] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.920118] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.920125] page_owner is disabled [ 3.927249] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 3.933936] Key type big_key registered [ 3.937439] hub 1-1:1.0: USB hub found [ 3.942643] Key type encrypted registered [ 3.948795] ima: No TPM chip found, activating TPM-bypass! [ 3.949039] hub 1-1:1.0: 8 ports detected [ 3.954277] ima: Allocated hash algorithm: sha256 [ 3.962984] ima: No architecture policies found [ 3.967513] evm: Initialising EVM extended attributes: [ 3.972646] evm: security.selinux [ 3.975958] evm: security.ima [ 3.978921] evm: security.capability [ 3.982494] evm: HMAC attrs: 0x1 [ 3.985975] rtc_cmos 00:00: setting system clock to 2024-04-19 03:38:44 UTC (1713497924) [ 3.995228] Freeing unused decrypted memory: 2036K [ 4.000352] Freeing unused kernel image (initmem) memory: 2608K [ 4.016087] Write protecting the kernel read-only data: 26624k [ 4.022296] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 4.029178] Freeing unused kernel image (rodata/data gap) memory: 1720K [ 4.033229] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.044056] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.051815] hub 2-12:1.0: USB hub found [ 4.055725] hub 2-12:1.0: 4 ports detected [ 4.059934] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.067407] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.090508] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.097937] hub 4-1:1.0: USB hub found [ 4.101783] hub 4-1:1.0: 6 ports detected [ 4.102066] systemd[1]: Detected architecture x86-64. [ 4.110854] systemd[1]: Running in initial RAM disk. [ 4.127092] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.133273] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.143462] clocksource: Switched to clocksource tsc Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 4.159114] systemd[1]: Set hostname to . [ 4.195872] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.209102] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 4.221258] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.233143] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 4.243172] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.255851] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... Startin Startinof required st…ce nodes for the current kernel... [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. [ OK ] Started Memstrack Anylazing Service. Starting Create Volatile Files and Directories... [ OK ] Reached target Slices. Starting Journal Service... [ OK ] Reached target Swap. [ 4.356037] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ Oal Console. [[ OK ] Start[ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Journal Service. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started drac[ 4.466476] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.474912] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Starting udev Kernel Device Manager... [ 4.487245] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.550220] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.563331] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.575082] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... [ OK ] Reached target System Initialization. Starting dr[ 4.646705] dca service started, version 1.12.1 acut initqueue hook... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Started Forward Password Requests to Plymouth Directory Watch.[ 4.669213] nvme nvme0: pci function 0000:02:00.0 [ OK ] Reached target Basic Syst[ 4.677900] nvme nvme0: 8/0/0 default/read/poll queues em. [ 4.685093] nvme0n1: detected capacity change from 0 to 400088457216 [ 4.685403] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.699532] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.707345] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.707896] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.712741] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.718836] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.723072] scsi host0: ahci [ 4.733208] scsi host1: ahci [ 4.733299] scsi host2: ahci [ 4.739101] scsi host3: ahci [ 4.742016] ACPI: bus type drm_connector registered [ 4.742107] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 4.742113] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 4.742118] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 [ 4.742125] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 4.742735] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.742738] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.758333] scsi host4: ahci [ 4.780387] igb 0000:07:00.0: added PHC on eth0 [ 4.788032] scsi host5: ahci [ 4.795491] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.795493] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:38 [ 4.798512] scsi host6: ahci [ 4.802973] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.805960] scsi host7: ahci [ 4.812685] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.819947] scsi host8: ahci [ 4.841316] scsi host9: ahci [ 4.841410] ast 0000:06:00.0: [drm] P2A bridge disabled, using default configuration [ 4.844242] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.851938] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.859322] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.859324] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.864388] ast 0000:06:00.0: [drm] Using analog VGA [ 4.871766] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.879151] ast 0000:06:00.0: [drm] dram MCLK=396 Mhz type=1 bus_width=16 [ 4.879230] igb 0000:07:00.1: added PHC on eth1 [ 4.879232] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.879233] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:39 [ 4.879308] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.879308] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.884110] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.885336] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.892206] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.898271] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.956352] fbcon: astdrmfb (fb0) is primary device [ 5.005727] Console: switching to colour frame buffer device 128x48 [ 5.009476] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.052910] ata2: SATA link down (SStatus 0 SControl 300) [ 5.057507] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.063035] ata4: SATA link down (SStatus 0 SControl 300) [ 5.074888] ata1: SATA link down (SStatus 0 SControl 300) [ 5.074911] ata3: SATA link down (SStatus 0 SControl 300) [ 5.260990] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.267181] ata8: SATA link down (SStatus 0 SControl 300) [ 5.272588] ata6: SATA link down (SStatus 0 SControl 300) [ 5.277996] ata7: SATA link down (SStatus 0 SControl 300) [ 5.283404] ata10: SATA link down (SStatus 0 SControl 300) [ 5.288915] ata9: SATA link down (SStatus 0 SControl 300) [ 5.295083] ata5.00: NCQ Send/Recv Log not supported [ 5.300050] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max U 5.306305] atars, multi 16: LB), AA [ 5.314750] ata5.00: NCQ Send/Recv Log not supported [ 5.319716] ata5.00: configured for UDMA/133 [ 5.324138] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.336725] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.345768] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.353427] sd 4:0:0:0: [sda] Write Protect is off [ 5.358224] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.385237] sda: sda1 [ 5.387837] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.868339] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.878616] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.887129] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.893306] ixgbe 0000:03:00.0: 0c:c4:7a:88:72:60 [ 5.901081] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.907710] libphy: ixgbe-mdio: probed [ 6.067272] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.077545] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.086066] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.093103] ixgbe 0000:03:00.1: 0c:c4:7a:88:72:61 [ 6.100814] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.107392] libphy: ixgbe-mdio: probed [ 6.112053] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.123311] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…588-86c5-4fa7-ad82-5a8bfe76a5e8... [ OK ] Started File System Check on /dev/d…0b588-86c5-4fa7-ad82-5a8bfe76a5e8. Mounting /sysroot... [ 6.290133] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. Starting Plymouth switch root service... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. Starting Setup Virtual Console... [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Coldplug all Devices. Stopping udev Kernel Device Manager... [ OK ] Stopped target Slices. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.631367] printk: systemd: 16 output lines suppressed due to ratelimiting [ 7.254677] SELinux: policy capability network_peer_controls=1 [ 7.260594] SELinux: policy capability open_perms=1 [ 7.265558] SELinux: policy capability extended_socket_class=1 [ 7.271467] SELinux: policy capability always_check_network=0 [ 7.277292] SELinux: policy capability cgroup_seclabel=1 [ 7.282683] SELinux: policy capability nnp_nosuid_transition=1 [ 7.311085] audit: type=1403 audit(1713497927.824:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.312710] systemd[1]: Successfully loaded SELinux policy in 227.584ms. [ 7.409909] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.545ms. [ 7.440588] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.475097] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 7.494717] systemd[1]: Set hostname to . [ 8.585488] systemd[1]: systemd-journald.service: Succeeded. [ 8.591815] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.597984] systemd[1]: Stopped Switch Root. [ OK [[ 8.602738] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.614266] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.624884] systemd[1]: Stopped Journal Service. [ OK [[ 8.630734] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... Mounting POSIX Message Queue File System... [ OK ] Created slice system-getty.slice. [ OK ] Listening on udev Kernel Socket. Starting Remount Root and Kernel File Systems... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Created slice system-serial\x2dgetty.slice. [ 8.682053] EXT4-fs (sda1): re-mounted. Opts: (null) Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on RPCbind Server Activation Socket. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Load Kernel Modules... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped Plymouth switch root service. Mounting Kernel Debug File System... [ OK ] Reached target Swap. Mounting Huge Pages File System... [ OK ] Listening on LVM2 poll daemon socket. Starting udev Coldplug all Devices... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on Process Core Dump Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Started Journa[ 8.884663] device-mapper: uevent: version 1.0.3 l Service. [[[ 8.890414] fuse: init (API version 7.34) 0;32m OK ][ 8.890430] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com Mounted POSIX Message Queue File System. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge Pages File System. Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load Kernel Modules. Starting Apply Kernel Variables... Mounting FUSE Control File System... [ OK ] Mounted FUSE Control File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Restore /run/initramfs on shutdown... Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting RPC Bind... Starting Security Auditing Service... [ OK ] Started udev Kernel Device Manager. [ 9.520531] RPC: Registered named UNIX socket transport module. [ 9.526447] RPC: Registered udp transport module. [ 9.531151] RPC: Registered tcp transport module. [ 9.535850] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 9.667956] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.682938] igb 0000:07:00.0: DCA enabled [ 9.687363] igb 0000:07:00.1: DCA enabled [ 9.742268] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 9.754907] IPMI message handler: version 39.2 [ 9.761988] ipmi device interface [ 9.781364] ipmi_si: IPMI System Interface driver [ 9.786442] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.792803] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.800311] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.806232] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.812199] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.821814] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.823339] power_meter ACPI000D:00: Found ACPI power meter. [ 9.834405] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.834428] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 9.880905] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.889602] ipmi_si: Adding ACPI-specified kcs state machine [ 9.895323] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.947059] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.987114] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ 10.002770] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer Starti[ 10.011738] RAPL PMU: hw unit of domain package 2^-14 Joules ng LVM event act[ 10.018783] RAPL PMU: hw unit of domain dram 2^-16 Joules ivation on device 259:0... [ 10.026915] iTCO_vendor_support: vendor-support=0 [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdo[ 10.051991] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 wn. [ [ 10.059560] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) OK ] Reache[ 10.060438] ipmi_si IPI0001:00: IPMI kcs interface initialized d target System [ 10.067693] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) Initialization. [ OK ] Started CUPS Scheduler. [ OK [[ 10.088525] ipmi_ssif: IPMI SSIF Interface driver 0m] Reached target Paths. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Listening on CUPS Scheduler. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting VDO volume services... Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started irqbalance daemon. [ OK ] Started Machine Check Exception Logging Daemon. [ OK ] Started D-Bus System Message Bus. Starting Resets System Activity Logs... Starting Avahi mDNS/DNS-SD Stack... Starting Kernel Samepage Merging... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. Starting NTP client/server... Starting System Security Services Daemon... [ OK ] Reached target sshd-keygen.target. Starting Network Manager... Starting Authorization Manager... [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Updates mlocate database every day. [ OK ] Reached target Timers. [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 10.400506] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.411485] EDAC sbridge: Ver: 1.1.2 [ 10.496791] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 10.504831] XFS (dm-4): Mounting V5 Filesystem [ 10.513787] XFS (dm-4): Ending clean mount [ 10.599676] intel_rapl_common: Found RAPL domain package [ 10.604991] intel_rapl_common: Found RAPL domain dram [ 10.610060] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging. [ OK ] Mounted /var/lib/ceph. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Enable periodic update of entitlement certificates.... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started NTP client/server. [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Hostname Service. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started OpenSSH server daemon. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 12.675431] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.731783] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.739939] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ OK ] Started Authorization Manager. [ 12.798780] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.816042] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.858988] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.967919] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.975741] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 13.018743] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 13.127931] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 13.243315] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting Login Service... Starting Permit User Sessions... Starting CUPS Scheduler... [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ 13.447098] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.454944] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Login Service. [ OK ] Started VDO volume services. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (11s / no limit) [** ] A start job is running for Network …nager Wait Online (11s / no limit) [*** ] A start job is running for Network …nager Wait Online (12s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Nagios Remote Plugin Executor. [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. + myips=172.21.15.129 + attempts=1 + sleep 1 + '[' 172.21.15.129 '!=' '' ']' + set -e + '[' -n 172.21.15.129 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.129 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.129 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi129.front.sepia.ceph.com + '[' -n smithi129.front.sepia.ceph.com ']' + hostname smithi129.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi129 + echo smithi129 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.129 smithi129.front.sepia.ceph.com smithi129\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-19T03:39:09.321 DEBUG:teuthology.orchestra.console.smithi129:expect after: smithi129 login: 2024-04-19T03:39:09.375 DEBUG:teuthology.orchestra.console.smithi129:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  nt GE v1. PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 72 61 GUID: 00000000 0000 0000 0000 0CC47AD91938 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.129 M : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.129 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:72:61)... Configuring (net0 0c:c4:7a:88:72:61).... Configuring (net0 0c:c4:7a:88:72:61)..... Configuring (net0 0c:c4:7a:88:72:61)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)  Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6>              The selected entry will be started automatically in 5s.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6*            The selected entry will be started automatically in 4s.   Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 4.18.0-513.9.1.el8_9.x86_64 (mockbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-20) (GCC)) #1 SMP Thu Nov 16 10:29:04 EST 2023 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec0fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f73000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.047 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ec1 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34850000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D48F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ec0fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29109 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ec1000-0x78f72fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f73000-0x798acfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228741 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1755076K/33437996K available (14341K kernel code, 5952K rwdata, 8520K rodata, 2608K init, 26336K bss, 949692K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 40939 entries in 160 pages [ 0.000000] ftrace: allocated 160 pages with 2 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001004] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003005] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013037] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014484] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32737d98d1a, max_idle_ns: 440795362231 ns [ 0.020000] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.09 BogoMIPS (lpj=3500047) [ 0.021001] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025022] LSM support for eBPF active [ 0.030543] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033917] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034077] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035077] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.037095] CPU0: Thermal monitoring enabled (TM1) [ 0.038055] process: using mwait in idle threads [ 0.039002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.040000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.041002] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.042001] Spectre V2 : Mitigation: Retpolines [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.044000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.045000] Speculative Store Bypass: Vulnerable [ 0.046004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.048000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050749] Freeing SMP alternatives memory: 36K [ 0.051197] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.154517] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.156100] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.157001] ... version: 3 [ 0.158000] ... bit width: 48 [ 0.159000] ... generic registers: 4 [ 0.160000] ... value mask: 0000ffffffffffff [ 0.161000] ... max period: 00007fffffffffff [ 0.162000] ... fixed-purpose events: 3 [ 0.163000] ... event mask: 000000070000000f [ 0.164030] rcu: Hierarchical SRCU implementation. [ 0.166058] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.167016] smp: Bringing up secondary CPUs ... [ 0.168071] x86: Booting SMP configuration: [ 0.169001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.172117] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.174001] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.175001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.176093] #5 #6 #7 [ 0.177549] smp: Brought up 1 node, 8 CPUs [ 0.179001] smpboot: Max logical packages: 1 [ 0.180001] smpboot: Total of 8 processors activated (56000.75 BogoMIPS) [ 0.223020] node 0 deferred pages initialised in 41ms [ 0.229241] devtmpfs: initialized [ 0.230041] x86/mm: Memory block size: 128MB [ 0.233615] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 0.242084] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.252007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.259059] pinctrl core: initialized pinctrl subsystem [ 0.264121] NET: Registered protocol family 16 [ 0.269079] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.276012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.284010] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.292019] audit: initializing netlink subsys (disabled) [ 0.297010] audit: type=2000 audit(1713497919.297:1): state=initialized audit_enabled=0 res=1 [ 0.306002] cpuidle: using governor menu [ 0.309029] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.317002] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.324051] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.333001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.340013] PCI: Using configuration type 1 for base access [ 0.347012] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.353002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.360023] cryptd: max_cpu_qlen set to 1000 [ 0.364050] ACPI: Added _OSI(Module Device) [ 0.369002] ACPI: Added _OSI(Processor Device) [ 0.373006] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.378001] ACPI: Added _OSI(Processor Aggregator Device) [ 0.383002] ACPI: Added _OSI(Linux-Dell-Video) [ 0.388003] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.393001] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.426960] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.436036] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.446097] ACPI: Dynamic OEM Table Load: [ 0.467203] ACPI: Interpreter enabled [ 0.471011] ACPI: PM: (supports S0 S4 S5) [ 0.475000] ACPI: Using IOAPIC for interrupt routing [ 0.480021] HEST: Enabling Firmware First mode for corrected errors. [ 0.486056] HEST: Table parsing has been initialized. [ 0.491002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.500616] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.531901] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.538003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.548716] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.557373] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.565000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.573037] PCI host bridge to bus 0000:ff [ 0.577002] pci_bus 0000:ff: root bus resource [bus ff] [ 0.582010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.588043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.594033] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.600032] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.606033] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.612032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.619035] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.625032] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.631032] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.637030] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.643031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.649031] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.655031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.661033] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.667030] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.673034] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.679027] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.685032] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.691031] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.697022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.703037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.709061] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.715043] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.721037] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.727046] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.733043] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.739041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.745034] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.751034] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.757043] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.763042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.769043] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.775042] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.781034] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.788024] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.794034] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.800034] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.806044] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.812043] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.818044] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.824043] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.830043] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.836034] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.842035] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.848037] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.854033] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.860033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.866035] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.872037] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.878032] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.884031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.890034] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.896027] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.902036] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.908033] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.917351] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.923003] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.933087] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.941225] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.949001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.957523] PCI host bridge to bus 0000:00 [ 0.961001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.968000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.975000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.982000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.990000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.997000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.005001] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.010025] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.016100] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.022042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.029087] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.035041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.041085] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.047020] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.053091] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.059007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.066068] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.072007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.079078] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.085007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.092077] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.098007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.105077] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.111008] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.117067] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.123008] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.130042] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.136007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.143078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.149007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.156073] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.162067] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.168083] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.174059] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.180005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.187076] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.193160] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.199012] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.204006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.210006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.215006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.221007] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.227006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.233029] pci 0000:00:11.4: PME# supported from D3hot [ 1.238074] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.244014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.251050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.257090] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.263014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.270052] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.276061] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.282014] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.289051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.295060] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.301013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.307073] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.313071] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.319066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.326078] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.332067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.338056] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.344037] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.350084] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.356013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.362073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.369076] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.375159] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.381009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.386005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.392005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.398005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.403005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.409005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.415023] pci 0000:00:1f.2: PME# supported from D3hot [ 1.420063] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.426013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.433016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.439168] acpiphp: Slot [1] registered [ 1.443014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.448125] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.454009] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.461016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.467003] pci 0000:02:00.0: enabling Extended Tags [ 1.472064] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.477003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.484126] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.490010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.498004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.503010] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.510004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.517038] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.523015] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.530001] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.541008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.548000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.558081] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.564010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.572004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.577009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.584004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.591039] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.597014] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.605000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.615008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.622001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.632081] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.637002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.644001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.650002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.658030] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.663060] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.669065] pci 0000:05:00.0: enabling Extended Tags [ 1.674070] pci 0000:05:00.0: supports D1 D2 [ 1.678000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.685089] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.690002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.696002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.703040] pci_bus 0000:06: extended config space not accessible [ 1.709033] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.715023] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.722012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.728012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.733097] pci 0000:06:00.0: supports D1 D2 [ 1.738000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.744111] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.750007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.756003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.762070] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.768017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.775018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.780009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.787119] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.793035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.800000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.810021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.818000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.828096] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.834018] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.840018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.846009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.852116] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.858034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.866000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.876018] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.883000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.893152] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.898002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.904002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.911003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.918463] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.925036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.931034] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.937035] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.943034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.949001] ACPI: PCI: Interrupt link LNKE disabled [ 1.953042] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.959001] ACPI: PCI: Interrupt link LNKF disabled [ 1.964047] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.970001] ACPI: PCI: Interrupt link LNKG disabled [ 1.975035] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.981000] ACPI: PCI: Interrupt link LNKH disabled [ 1.986181] iommu: Default domain type: Passthrough [ 1.991071] SCSI subsystem initialized [ 1.995016] ACPI: bus type USB registered [ 1.999006] usbcore: registered new interface driver usbfs [ 2.004006] usbcore: registered new interface driver hub [ 2.010005] usbcore: registered new device driver usb [ 2.015020] pps_core: LinuxPPS API ver. 1 registered [ 2.020000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.029004] PTP clock support registered [ 2.033017] EDAC MC: Ver: 3.0.0 [ 2.036113] PCI: Using ACPI for IRQ routing [ 2.045387] NetLabel: Initializing [ 2.049001] NetLabel: domain hash size = 128 [ 2.053000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.059011] NetLabel: unlabeled traffic allowed by default [ 2.065021] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.066000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.079001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.085000] vgaarb: loaded [ 2.088045] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.094001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.102029] clocksource: Switched to clocksource tsc-early [ 2.118211] VFS: Disk quotas dquot_6.6.0 [ 2.122140] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.129067] pnp: PnP ACPI init [ 2.132510] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.138426] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.144342] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.150255] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.156172] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.162084] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.167993] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.174599] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.181202] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.187805] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.194410] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.201013] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.207618] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.214407] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.220326] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.226234] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.232146] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.238056] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.244785] pnp: PnP ACPI: found 5 devices [ 2.254378] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.263278] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.274750] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.282568] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.287530] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.292492] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.299273] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.306835] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.314742] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.322391] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.330382] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.337939] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.345846] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.353488] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.361479] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.369037] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.376940] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.384584] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.392575] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.400132] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.408036] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.415680] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.423672] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.428630] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.434715] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.441490] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.449224] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.454195] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.459155] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.465241] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.472032] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.477249] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.483335] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.490115] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.497853] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.505679] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.513420] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.521245] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.526209] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.532295] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.539079] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.546811] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.555839] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.562011] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.568181] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.575044] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.581909] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.588774] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.595637] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.601894] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.607457] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.613715] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.620927] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.626490] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.632747] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.638313] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.644572] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.650134] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.656391] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.663710] NET: Registered protocol family 2 [ 2.668273] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.677542] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.686409] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.694827] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.702412] TCP: Hash tables configured (established 262144 bind 65536) [ 2.709130] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.716870] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.723892] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.731362] NET: Registered protocol family 1 [ 2.735722] NET: Registered protocol family 44 [ 2.740247] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.764122] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16275 usecs [ 2.788132] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 16217 usecs [ 2.795539] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.801990] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.810375] Unpacking initramfs... [ 3.098277] Freeing initrd memory: 28480K [ 3.102348] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.108780] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.116698] ACPI: bus type thunderbolt registered [ 3.123042] Initialise system trusted keyrings [ 3.127494] Key type blacklist registered [ 3.131528] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.139426] zbud: loaded [ 3.142278] pstore: using deflate compression [ 3.146823] Platform Keyring initialized [ 3.189481] NET: Registered protocol family 38 [ 3.193922] Key type asymmetric registered [ 3.198013] Asymmetric key parser 'x509' registered [ 3.202883] Running certificate verification selftests [ 3.233486] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.244381] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.251810] io scheduler mq-deadline registered [ 3.256340] io scheduler kyber registered [ 3.260371] io scheduler bfq registered [ 3.264262] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.271468] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.277374] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.283269] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.289163] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.295047] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.300912] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.306786] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.314099] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.322488] ACPI: Power Button [PWRB] [ 3.326181] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.333596] ACPI: Power Button [PWRF] [ 3.338297] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.345801] pstore: Registered erst as persistent store backend [ 3.351870] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 3.359342] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.386192] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.414092] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.421749] Non-volatile memory driver v1.3 [ 3.426338] rdac: device handler registered [ 3.430584] hp_sw: device handler registered [ 3.434851] emc: device handler registered [ 3.439007] alua: device handler registered [ 3.443253] libphy: Fixed MDIO Bus: probed [ 3.447610] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.452890] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.460286] ehci-pci 0000:00:1d.0: debug port 2 [ 3.468728] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.481057] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.486847] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.495101] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.502313] usb usb1: Product: EHCI Host Controller [ 3.507182] usb usb1: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.514393] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.519110] hub 1-0:1.0: USB hub found [ 3.522871] hub 1-0:1.0: 2 ports detected [ 3.527023] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.532286] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.540724] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.549998] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.550024] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.555260] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.560486] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.567817] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.575214] ehci-pci 0000:00:1a.0: debug port 2 [ 3.581480] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.589910] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.594230] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.606032] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.607094] usb usb2: Product: xHCI Host Controller [ 3.617699] usb usb2: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.624911] usb usb2: SerialNumber: 0000:00:14.0 [ 3.629659] hub 2-0:1.0: USB hub found [ 3.633427] hub 2-0:1.0: 15 ports detected [ 3.640218] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.648477] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.655687] usb usb4: Product: EHCI Host Controller [ 3.660556] usb usb4: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.667771] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.672520] hub 4-0:1.0: USB hub found [ 3.676324] hub 4-0:1.0: 2 ports detected [ 3.680463] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.688719] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.695935] usb usb3: Product: xHCI Host Controller [ 3.700807] usb usb3: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.708016] usb usb3: SerialNumber: 0000:00:14.0 [ 3.712764] hub 3-0:1.0: USB hub found [ 3.716523] hub 3-0:1.0: 6 ports detected [ 3.722234] usbcore: registered new interface driver usbserial_generic [ 3.728762] usbserial: USB Serial support registered for generic [ 3.734789] i8042: PNP: No PS/2 controller found. [ 3.739540] mousedev: PS/2 mouse device common for all mice [ 3.745171] rtc_cmos 00:00: RTC can wake from S4 [ 3.749996] rtc_cmos 00:00: registered as rtc0 [ 3.754450] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.762232] intel_pstate: Intel P-state driver initializing [ 3.768949] hid: raw HID events driver (C) Jiri Kosina [ 3.772035] usb 1-new high-speed USB device number 2 using ehci-pci [ 3.774121] usbcore: registered new interface driver usbhid [ 3.786165] usbhid: USB HID core driver [ 3.790083] drop_monitor: Initializing network drop monitor service [ 3.796386] Initializing XFRM netlink socket [ 3.800723] NET: Registered protocol family 10 [ 3.805391] Segment Routing with IPv6 [ 3.809067] NET: Registered protocol family 17 [ 3.813575] mpls_gso: MPLS GSO support [ 3.817774] microcode: Microcode Update Driver: v2.2. [ 3.817827] resctrl: L3 allocation detected [ 3.827048] resctrl: L3 monitoring detected [ 3.831232] AVX2 version of gcm_enc/dec engaged. [ 3.835842] AES CTR mode by8 optimization enabled [ 3.850696] sched_clock: Marking stable (3850690965, 0)->(5653297251, -1802606286) [ 3.858337] registered taskstats version 1 [ 3.862579] Loading compiled-in X.509 certificates [ 3.867637] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 3b1bc9a9bf3bdfe93ac380c73845d894639c5bcf' [ 3.878511] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.890339] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.893034] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.900977] zswap: loaded using pool lzo/zbud [ .908410] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.920118] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.920125] page_owner is disabled [ 3.927249] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 3.933936] Key type big_key registered [ 3.937439] hub 1-1:1.0: USB hub found [ 3.942643] Key type encrypted registered [ 3.948795] ima: No TPM chip found, activating TPM-bypass! [ 3.949039] hub 1-1:1.0: 8 ports detected [ 3.954277] ima: Allocated hash algorithm: sha256 [ 3.962984] ima: No architecture policies found [ 3.967513] evm: Initialising EVM extended attributes: [ 3.972646] evm: security.selinux [ 3.975958] evm: security.ima [ 3.978921] evm: security.capability [ 3.982494] evm: HMAC attrs: 0x1 [ 3.985975] rtc_cmos 00:00: setting system clock to 2024-04-19 03:38:44 UTC (1713497924) [ 3.995228] Freeing unused decrypted memory: 2036K [ 4.000352] Freeing unused kernel image (initmem) memory: 2608K [ 4.016087] Write protecting the kernel read-only data: 26624k [ 4.022296] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 4.029178] Freeing unused kernel image (rodata/data gap) memory: 1720K [ 4.033229] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.044056] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.051815] hub 2-12:1.0: USB hub found [ 4.055725] hub 2-12:1.0: 4 ports detected [ 4.059934] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.067407] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.090508] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.097937] hub 4-1:1.0: USB hub found [ 4.101783] hub 4-1:1.0: 6 ports detected [ 4.102066] systemd[1]: Detected architecture x86-64. [ 4.110854] systemd[1]: Running in initial RAM disk. [ 4.127092] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.133273] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.143462] clocksource: Switched to clocksource tsc Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 4.159114] systemd[1]: Set hostname to . [ 4.195872] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.209102] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 4.221258] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.233143] systemd[1]: Reached target Timers. [ OK ] Reached target Timers. [ 4.243172] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.255851] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... Startin Startinof required st…ce nodes for the current kernel... [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. [ OK ] Started Memstrack Anylazing Service. Starting Create Volatile Files and Directories... [ OK ] Reached target Slices. Starting Journal Service... [ OK ] Reached target Swap. [ 4.356037] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ Oal Console. [[ OK ] Start[ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Journal Service. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started drac[ 4.466476] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.474912] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Starting udev Kernel Device Manager... [ 4.487245] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.550220] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.563331] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.575082] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... [ OK ] Reached target System Initialization. Starting dr[ 4.646705] dca service started, version 1.12.1 acut initqueue hook... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Started Forward Password Requests to Plymouth Directory Watch.[ 4.669213] nvme nvme0: pci function 0000:02:00.0 [ OK ] Reached target Basic Syst[ 4.677900] nvme nvme0: 8/0/0 default/read/poll queues em. [ 4.685093] nvme0n1: detected capacity change from 0 to 400088457216 [ 4.685403] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.699532] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.707345] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.707896] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.712741] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.718836] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.723072] scsi host0: ahci [ 4.733208] scsi host1: ahci [ 4.733299] scsi host2: ahci [ 4.739101] scsi host3: ahci [ 4.742016] ACPI: bus type drm_connector registered [ 4.742107] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 4.742113] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 4.742118] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 [ 4.742125] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 4.742735] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.742738] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.758333] scsi host4: ahci [ 4.780387] igb 0000:07:00.0: added PHC on eth0 [ 4.788032] scsi host5: ahci [ 4.795491] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.795493] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:38 [ 4.798512] scsi host6: ahci [ 4.802973] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.805960] scsi host7: ahci [ 4.812685] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.819947] scsi host8: ahci [ 4.841316] scsi host9: ahci [ 4.841410] ast 0000:06:00.0: [drm] P2A bridge disabled, using default configuration [ 4.844242] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.851938] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.859322] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.859324] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.864388] ast 0000:06:00.0: [drm] Using analog VGA [ 4.871766] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.879151] ast 0000:06:00.0: [drm] dram MCLK=396 Mhz type=1 bus_width=16 [ 4.879230] igb 0000:07:00.1: added PHC on eth1 [ 4.879232] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.879233] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:19:39 [ 4.879308] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.879308] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.884110] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.885336] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.892206] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.898271] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.956352] fbcon: astdrmfb (fb0) is primary device [ 5.005727] Console: switching to colour frame buffer device 128x48 [ 5.009476] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.052910] ata2: SATA link down (SStatus 0 SControl 300) [ 5.057507] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.063035] ata4: SATA link down (SStatus 0 SControl 300) [ 5.074888] ata1: SATA link down (SStatus 0 SControl 300) [ 5.074911] ata3: SATA link down (SStatus 0 SControl 300) [ 5.260990] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.267181] ata8: SATA link down (SStatus 0 SControl 300) [ 5.272588] ata6: SATA link down (SStatus 0 SControl 300) [ 5.277996] ata7: SATA link down (SStatus 0 SControl 300) [ 5.283404] ata10: SATA link down (SStatus 0 SControl 300) [ 5.288915] ata9: SATA link down (SStatus 0 SControl 300) [ 5.295083] ata5.00: NCQ Send/Recv Log not supported [ 5.300050] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max U 5.306305] atars, multi 16: LB), AA [ 5.314750] ata5.00: NCQ Send/Recv Log not supported [ 5.319716] ata5.00: configured for UDMA/133 [ 5.324138] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.336725] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.345768] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.353427] sd 4:0:0:0: [sda] Write Protect is off [ 5.358224] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.385237] sda: sda1 [ 5.387837] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.868339] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.878616] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.887129] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.893306] ixgbe 0000:03:00.0: 0c:c4:7a:88:72:60 [ 5.901081] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.907710] libphy: ixgbe-mdio: probed [ 6.067272] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.077545] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.086066] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.093103] ixgbe 0000:03:00.1: 0c:c4:7a:88:72:61 [ 6.100814] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.107392] libphy: ixgbe-mdio: probed [ 6.112053] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.123311] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…588-86c5-4fa7-ad82-5a8bfe76a5e8... [ OK ] Started File System Check on /dev/d…0b588-86c5-4fa7-ad82-5a8bfe76a5e8. Mounting /sysroot... [ 6.290133] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Timers. Starting Plymouth switch root service... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. Starting Setup Virtual Console... [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Coldplug all Devices. Stopping udev Kernel Device Manager... [ OK ] Stopped target Slices. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.631367] printk: systemd: 16 output lines suppressed due to ratelimiting [ 7.254677] SELinux: policy capability network_peer_controls=1 [ 7.260594] SELinux: policy capability open_perms=1 [ 7.265558] SELinux: policy capability extended_socket_class=1 [ 7.271467] SELinux: policy capability always_check_network=0 [ 7.277292] SELinux: policy capability cgroup_seclabel=1 [ 7.282683] SELinux: policy capability nnp_nosuid_transition=1 [ 7.311085] audit: type=1403 audit(1713497927.824:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.312710] systemd[1]: Successfully loaded SELinux policy in 227.584ms. [ 7.409909] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.545ms. [ 7.440588] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.475097] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 7.494717] systemd[1]: Set hostname to . [ 8.585488] systemd[1]: systemd-journald.service: Succeeded. [ 8.591815] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.597984] systemd[1]: Stopped Switch Root. [ OK [[ 8.602738] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.614266] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.624884] systemd[1]: Stopped Journal Service. [ OK [[ 8.630734] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... Mounting POSIX Message Queue File System... [ OK ] Created slice system-getty.slice. [ OK ] Listening on udev Kernel Socket. Starting Remount Root and Kernel File Systems... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Created slice system-serial\x2dgetty.slice. [ 8.682053] EXT4-fs (sda1): re-mounted. Opts: (null) Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on RPCbind Server Activation Socket. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Load Kernel Modules... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped Plymouth switch root service. Mounting Kernel Debug File System... [ OK ] Reached target Swap. Mounting Huge Pages File System... [ OK ] Listening on LVM2 poll daemon socket. Starting udev Coldplug all Devices... [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on Process Core Dump Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Started Journa[ 8.884663] device-mapper: uevent: version 1.0.3 l Service. [[[ 8.890414] fuse: init (API version 7.34) 0;32m OK ][ 8.890430] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com Mounted POSIX Message Queue File System. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge Pages File System. Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load Kernel Modules. Starting Apply Kernel Variables... Mounting FUSE Control File System... [ OK ] Mounted FUSE Control File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Restore /run/initramfs on shutdown... Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting RPC Bind... Starting Security Auditing Service... [ OK ] Started udev Kernel Device Manager. [ 9.520531] RPC: Registered named UNIX socket transport module. [ 9.526447] RPC: Registered udp transport module. [ 9.531151] RPC: Registered tcp transport module. [ 9.535850] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 9.667956] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.682938] igb 0000:07:00.0: DCA enabled [ 9.687363] igb 0000:07:00.1: DCA enabled [ 9.742268] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 9.754907] IPMI message handler: version 39.2 [ 9.761988] ipmi device interface [ 9.781364] ipmi_si: IPMI System Interface driver [ 9.786442] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.792803] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.800311] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.806232] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.812199] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.821814] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.823339] power_meter ACPI000D:00: Found ACPI power meter. [ 9.834405] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.834428] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 9.880905] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.889602] ipmi_si: Adding ACPI-specified kcs state machine [ 9.895323] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.947059] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.987114] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ 10.002770] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer Starti[ 10.011738] RAPL PMU: hw unit of domain package 2^-14 Joules ng LVM event act[ 10.018783] RAPL PMU: hw unit of domain dram 2^-16 Joules ivation on device 259:0... [ 10.026915] iTCO_vendor_support: vendor-support=0 [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdo[ 10.051991] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 wn. [ [ 10.059560] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) OK ] Reache[ 10.060438] ipmi_si IPI0001:00: IPMI kcs interface initialized d target System [ 10.067693] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) Initialization. [ OK ] Started CUPS Scheduler. [ OK [[ 10.088525] ipmi_ssif: IPMI SSIF Interface driver 0m] Reached target Paths. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Listening on CUPS Scheduler. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting VDO volume services... Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started irqbalance daemon. [ OK ] Started Machine Check Exception Logging Daemon. [ OK ] Started D-Bus System Message Bus. Starting Resets System Activity Logs... Starting Avahi mDNS/DNS-SD Stack... Starting Kernel Samepage Merging... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. Starting NTP client/server... Starting System Security Services Daemon... [ OK ] Reached target sshd-keygen.target. Starting Network Manager... Starting Authorization Manager... [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Updates mlocate database every day. [ OK ] Reached target Timers. [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 10.400506] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.411485] EDAC sbridge: Ver: 1.1.2 [ 10.496791] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 10.504831] XFS (dm-4): Mounting V5 Filesystem [ 10.513787] XFS (dm-4): Ending clean mount [ 10.599676] intel_rapl_common: Found RAPL domain package [ 10.604991] intel_rapl_common: Found RAPL domain dram [ 10.610060] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging. [ OK ] Mounted /var/lib/ceph. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Enable periodic update of entitlement certificates.... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started NTP client/server. [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Hostname Service. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started OpenSSH server daemon. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 12.675431] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.731783] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.739939] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ OK ] Started Authorization Manager. [ 12.798780] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.816042] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.858988] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.967919] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.975741] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 13.018743] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 13.127931] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 13.243315] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting Login Service... Starting Permit User Sessions... Starting CUPS Scheduler... [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ 13.447098] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.454944] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Login Service. [ OK ] Started VDO volume services. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (11s / no limit) [** ] A start job is running for Network …nager Wait Online (11s / no limit) [*** ] A start job is running for Network …nager Wait Online (12s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... Starting System Logging Service... Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Nagios Remote Plugin Executor. [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. + myips=172.21.15.129 + attempts=1 + sleep 1 + '[' 172.21.15.129 '!=' '' ']' + set -e + '[' -n 172.21.15.129 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.129 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.129 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi129.front.sepia.ceph.com + '[' -n smithi129.front.sepia.ceph.com ']' + hostname smithi129.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi129 + echo smithi129 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.129 smithi129.front.sepia.ceph.com smithi129\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi129 login: [disconnect] 2024-04-19T03:39:09.477 INFO:teuthology.misc:Re-opening connections... 2024-04-19T03:39:09.477 INFO:teuthology.misc:trying to connect to ubuntu@smithi129.front.sepia.ceph.com 2024-04-19T03:39:09.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-19T03:39:09.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:39:10.421 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-04-19T03:39:10.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-19T03:39:10.922 DEBUG:teuthology.misc:waited 1.4448645114898682 2024-04-19T03:39:11.922 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi129.front.sepia.ceph.com 2024-04-19T03:39:11.923 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi129.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-04-19T03:39:11.923 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-19T03:39:12.036 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:39:12.072 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-19T03:39:12.072 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-19T03:39:12.114 INFO:tasks.ceph.osd.2:Started 2024-04-19T03:39:12.114 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:39:12.249 INFO:teuthology.orchestra.run.smithi129.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-19T03:39:12.252 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T03:39:12.252 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-19T03:39:13.000 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:39:12.998+0000 7f67037087c0 -1 Falling back to public interface 2024-04-19T03:39:13.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-19T03:39:16.587 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:39:16.585+0000 7f67037087c0 -1 osd.2 19 log_to_monitors true 2024-04-19T03:39:17.253 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:39:17.389 INFO:teuthology.orchestra.run.smithi129.stderr:no valid command found; 10 closest matches: 2024-04-19T03:39:17.390 INFO:teuthology.orchestra.run.smithi129.stderr:0 2024-04-19T03:39:17.390 INFO:teuthology.orchestra.run.smithi129.stderr:1 2024-04-19T03:39:17.390 INFO:teuthology.orchestra.run.smithi129.stderr:2 2024-04-19T03:39:17.390 INFO:teuthology.orchestra.run.smithi129.stderr:abort 2024-04-19T03:39:17.390 INFO:teuthology.orchestra.run.smithi129.stderr:assert 2024-04-19T03:39:17.391 INFO:teuthology.orchestra.run.smithi129.stderr:bluefs debug_inject_read_zeros 2024-04-19T03:39:17.391 INFO:teuthology.orchestra.run.smithi129.stderr:bluefs files list 2024-04-19T03:39:17.391 INFO:teuthology.orchestra.run.smithi129.stderr:bluefs stats 2024-04-19T03:39:17.391 INFO:teuthology.orchestra.run.smithi129.stderr:bluestore allocator dump block 2024-04-19T03:39:17.391 INFO:teuthology.orchestra.run.smithi129.stderr:bluestore allocator fragmentation block 2024-04-19T03:39:17.391 INFO:teuthology.orchestra.run.smithi129.stderr:admin_socket: invalid command 2024-04-19T03:39:17.392 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T03:39:17.393 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-19T03:39:17.452 INFO:tasks.ceph.osd.2.smithi129.stderr:2024-04-19T03:39:17.451+0000 7f66ef698700 -1 osd.2 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T03:39:22.394 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:39:22.538 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-04-19T03:39:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-04-19T03:39:22.538 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-04-19T03:39:22.538 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-04-19T03:39:22.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T03:39:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T03:39:23.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T03:39:24.428 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T03:39:24.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T03:39:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T03:39:25.448 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T03:39:25.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:25.837 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-19T03:39:25.425767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795620,"kb_used_data":3768,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319900,"statfs":{"total":289910292480,"available":289095577600,"internally_reserved":0,"allocated":3858432,"data_stored":2741314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016955"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2056,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422626+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:22.422626+0000","last_peered":"2024-04-19T03:39:22.422626+0000","last_clean":"2024-04-19T03:39:22.422626+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:22.422626+0000","last_undegraded":"2024-04-19T03:39:22.422626+0000","last_fullsized":"2024-04-19T03:39:22.422626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422058+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:22.422058+0000","last_peered":"2024-04-19T03:39:22.422058+0000","last_clean":"2024-04-19T03:39:22.422058+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:22.422058+0000","last_undegraded":"2024-04-19T03:39:22.422058+0000","last_fullsized":"2024-04-19T03:39:22.422058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4061,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417980+0000","last_change":"2024-04-19T03:39:21.417980+0000","last_active":"2024-04-19T03:39:19.401011+0000","last_peered":"2024-04-19T03:39:17.390890+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.390099+0000","last_became_peered":"2024-04-19T03:36:29.390099+0000","last_unstale":"2024-04-19T03:39:21.417980+0000","last_undegraded":"2024-04-19T03:39:21.417980+0000","last_fullsized":"2024-04-19T03:39:21.417980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:42.792413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.792917+0000","last_change":"2024-04-19T03:39:19.419024+0000","last_active":"2024-04-19T03:39:20.792917+0000","last_peered":"2024-04-19T03:39:20.792917+0000","last_clean":"2024-04-19T03:39:20.792917+0000","last_became_active":"2024-04-19T03:39:19.417807+0000","last_became_peered":"2024-04-19T03:39:19.417807+0000","last_unstale":"2024-04-19T03:39:20.792917+0000","last_undegraded":"2024-04-19T03:39:20.792917+0000","last_fullsized":"2024-04-19T03:39:20.792917+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:48.505600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421783+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:22.421783+0000","last_peered":"2024-04-19T03:39:22.421783+0000","last_clean":"2024-04-19T03:39:22.421783+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:22.421783+0000","last_undegraded":"2024-04-19T03:39:22.421783+0000","last_fullsized":"2024-04-19T03:39:22.421783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.793497+0000","last_change":"2024-04-19T03:39:19.421767+0000","last_active":"2024-04-19T03:39:20.793497+0000","last_peered":"2024-04-19T03:39:20.793497+0000","last_clean":"2024-04-19T03:39:20.793497+0000","last_became_active":"2024-04-19T03:39:19.419382+0000","last_became_peered":"2024-04-19T03:39:19.419382+0000","last_unstale":"2024-04-19T03:39:20.793497+0000","last_undegraded":"2024-04-19T03:39:20.793497+0000","last_fullsized":"2024-04-19T03:39:20.793497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:24.971099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.762843+0000","last_change":"2024-04-19T03:39:19.421794+0000","last_active":"2024-04-19T03:39:20.762843+0000","last_peered":"2024-04-19T03:39:20.762843+0000","last_clean":"2024-04-19T03:39:20.762843+0000","last_became_active":"2024-04-19T03:39:19.420332+0000","last_became_peered":"2024-04-19T03:39:19.420332+0000","last_unstale":"2024-04-19T03:39:20.762843+0000","last_undegraded":"2024-04-19T03:39:20.762843+0000","last_fullsized":"2024-04-19T03:39:20.762843+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:58.338163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8109,"reported_epoch":79,"state":"peering","last_fresh":"2024-04-19T03:39:20.848454+0000","last_change":"2024-04-19T03:39:21.413503+0000","last_active":"2024-04-19T03:39:21.413503+0000","last_peered":"2024-04-19T03:39:20.848454+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:39:20.777376+0000","last_became_peered":"2024-04-19T03:39:20.777376+0000","last_unstale":"2024-04-19T03:39:20.848454+0000","last_undegraded":"2024-04-19T03:39:20.848454+0000","last_fullsized":"2024-04-19T03:39:20.397920+0000","mapping_epoch":80,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:18:32.130026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417737+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:22.417737+0000","last_peered":"2024-04-19T03:39:22.417737+0000","last_clean":"2024-04-19T03:39:22.417737+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:22.417737+0000","last_undegraded":"2024-04-19T03:39:22.417737+0000","last_fullsized":"2024-04-19T03:39:22.417737+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6163,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422441+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:22.422441+0000","last_peered":"2024-04-19T03:39:22.422441+0000","last_clean":"2024-04-19T03:39:22.422441+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:22.422441+0000","last_undegraded":"2024-04-19T03:39:22.422441+0000","last_fullsized":"2024-04-19T03:39:22.422441+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4007,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414383+0000","last_change":"2024-04-19T03:39:21.414383+0000","last_active":"2024-04-19T03:39:19.399755+0000","last_peered":"2024-04-19T03:39:17.390889+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.373192+0000","last_became_peered":"2024-04-19T03:36:29.373192+0000","last_unstale":"2024-04-19T03:39:21.414383+0000","last_undegraded":"2024-04-19T03:39:21.414383+0000","last_fullsized":"2024-04-19T03:39:21.414383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:49.295567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2168,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425823+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:22.425823+0000","last_peered":"2024-04-19T03:39:22.425823+0000","last_clean":"2024-04-19T03:39:22.425823+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:22.425823+0000","last_undegraded":"2024-04-19T03:39:22.425823+0000","last_fullsized":"2024-04-19T03:39:22.425823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2069,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421186+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:22.421186+0000","last_peered":"2024-04-19T03:39:22.421186+0000","last_clean":"2024-04-19T03:39:22.421186+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:22.421186+0000","last_undegraded":"2024-04-19T03:39:22.421186+0000","last_fullsized":"2024-04-19T03:39:22.421186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2140,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.419591+0000","last_change":"2024-04-19T03:39:21.419591+0000","last_active":"2024-04-19T03:39:19.401370+0000","last_peered":"2024-04-19T03:39:17.390391+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.383815+0000","last_became_peered":"2024-04-19T03:36:29.383815+0000","last_unstale":"2024-04-19T03:39:21.419591+0000","last_undegraded":"2024-04-19T03:39:21.419591+0000","last_fullsized":"2024-04-19T03:39:21.419591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:03:35.454941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2093,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417583+0000","last_change":"2024-04-19T03:39:21.417583+0000","last_active":"2024-04-19T03:39:19.400625+0000","last_peered":"2024-04-19T03:39:17.390203+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.389452+0000","last_became_peered":"2024-04-19T03:36:29.389452+0000","last_unstale":"2024-04-19T03:39:21.417583+0000","last_undegraded":"2024-04-19T03:39:21.417583+0000","last_fullsized":"2024-04-19T03:39:21.417583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:25:08.519003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2070,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.413454+0000","last_change":"2024-04-19T03:39:21.413454+0000","last_active":"2024-04-19T03:39:19.398248+0000","last_peered":"2024-04-19T03:39:17.389980+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.372165+0000","last_became_peered":"2024-04-19T03:36:29.372165+0000","last_unstale":"2024-04-19T03:39:21.413454+0000","last_undegraded":"2024-04-19T03:39:21.413454+0000","last_fullsized":"2024-04-19T03:39:21.413454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:02.026046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2057,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418300+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:22.418300+0000","last_peered":"2024-04-19T03:39:22.418300+0000","last_clean":"2024-04-19T03:39:22.418300+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:22.418300+0000","last_undegraded":"2024-04-19T03:39:22.418300+0000","last_fullsized":"2024-04-19T03:39:22.418300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422216+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:22.422216+0000","last_peered":"2024-04-19T03:39:22.422216+0000","last_clean":"2024-04-19T03:39:22.422216+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:22.422216+0000","last_undegraded":"2024-04-19T03:39:22.422216+0000","last_fullsized":"2024-04-19T03:39:22.422216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417698+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:22.417698+0000","last_peered":"2024-04-19T03:39:22.417698+0000","last_clean":"2024-04-19T03:39:22.417698+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:22.417698+0000","last_undegraded":"2024-04-19T03:39:22.417698+0000","last_fullsized":"2024-04-19T03:39:22.417698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4154,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414259+0000","last_change":"2024-04-19T03:39:21.414259+0000","last_active":"2024-04-19T03:39:19.399351+0000","last_peered":"2024-04-19T03:39:17.390607+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.372161+0000","last_became_peered":"2024-04-19T03:36:29.372161+0000","last_unstale":"2024-04-19T03:39:21.414259+0000","last_undegraded":"2024-04-19T03:39:21.414259+0000","last_fullsized":"2024-04-19T03:39:21.414259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:09.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.695055+0000","last_change":"2024-04-19T03:39:19.425914+0000","last_active":"2024-04-19T03:39:20.695055+0000","last_peered":"2024-04-19T03:39:20.695055+0000","last_clean":"2024-04-19T03:39:20.695055+0000","last_became_active":"2024-04-19T03:39:19.425552+0000","last_became_peered":"2024-04-19T03:39:19.425552+0000","last_unstale":"2024-04-19T03:39:20.695055+0000","last_undegraded":"2024-04-19T03:39:20.695055+0000","last_fullsized":"2024-04-19T03:39:20.695055+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:41.252438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425847+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:22.425847+0000","last_peered":"2024-04-19T03:39:22.425847+0000","last_clean":"2024-04-19T03:39:22.425847+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:22.425847+0000","last_undegraded":"2024-04-19T03:39:22.425847+0000","last_fullsized":"2024-04-19T03:39:22.425847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.426153+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:22.426153+0000","last_peered":"2024-04-19T03:39:22.426153+0000","last_clean":"2024-04-19T03:39:22.426153+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:22.426153+0000","last_undegraded":"2024-04-19T03:39:22.426153+0000","last_fullsized":"2024-04-19T03:39:22.426153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4098,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421455+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:22.421455+0000","last_peered":"2024-04-19T03:39:22.421455+0000","last_clean":"2024-04-19T03:39:22.421455+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:22.421455+0000","last_undegraded":"2024-04-19T03:39:22.421455+0000","last_fullsized":"2024-04-19T03:39:22.421455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2084,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425871+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:22.425871+0000","last_peered":"2024-04-19T03:39:22.425871+0000","last_clean":"2024-04-19T03:39:22.425871+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:22.425871+0000","last_undegraded":"2024-04-19T03:39:22.425871+0000","last_fullsized":"2024-04-19T03:39:22.425871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418038+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:22.418038+0000","last_peered":"2024-04-19T03:39:22.418038+0000","last_clean":"2024-04-19T03:39:22.418038+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:22.418038+0000","last_undegraded":"2024-04-19T03:39:22.418038+0000","last_fullsized":"2024-04-19T03:39:22.418038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2096,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417852+0000","last_change":"2024-04-19T03:39:21.417852+0000","last_active":"2024-04-19T03:39:19.405093+0000","last_peered":"2024-04-19T03:39:17.391549+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.390763+0000","last_became_peered":"2024-04-19T03:36:29.390763+0000","last_unstale":"2024-04-19T03:39:21.417852+0000","last_undegraded":"2024-04-19T03:39:21.417852+0000","last_fullsized":"2024-04-19T03:39:21.417852+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:00:17.140503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421096+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:22.421096+0000","last_peered":"2024-04-19T03:39:22.421096+0000","last_clean":"2024-04-19T03:39:22.421096+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:22.421096+0000","last_undegraded":"2024-04-19T03:39:22.421096+0000","last_fullsized":"2024-04-19T03:39:22.421096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422060+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:22.422060+0000","last_peered":"2024-04-19T03:39:22.422060+0000","last_clean":"2024-04-19T03:39:22.422060+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:22.422060+0000","last_undegraded":"2024-04-19T03:39:22.422060+0000","last_fullsized":"2024-04-19T03:39:22.422060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418269+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:22.418269+0000","last_peered":"2024-04-19T03:39:22.418269+0000","last_clean":"2024-04-19T03:39:22.418269+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:22.418269+0000","last_undegraded":"2024-04-19T03:39:22.418269+0000","last_fullsized":"2024-04-19T03:39:22.418269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417821+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:22.417821+0000","last_peered":"2024-04-19T03:39:22.417821+0000","last_clean":"2024-04-19T03:39:22.417821+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:22.417821+0000","last_undegraded":"2024-04-19T03:39:22.417821+0000","last_fullsized":"2024-04-19T03:39:22.417821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418584+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:22.418584+0000","last_peered":"2024-04-19T03:39:22.418584+0000","last_clean":"2024-04-19T03:39:22.418584+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:22.418584+0000","last_undegraded":"2024-04-19T03:39:22.418584+0000","last_fullsized":"2024-04-19T03:39:22.418584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422451+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:22.422451+0000","last_peered":"2024-04-19T03:39:22.422451+0000","last_clean":"2024-04-19T03:39:22.422451+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:22.422451+0000","last_undegraded":"2024-04-19T03:39:22.422451+0000","last_fullsized":"2024-04-19T03:39:22.422451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418530+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:22.418530+0000","last_peered":"2024-04-19T03:39:22.418530+0000","last_clean":"2024-04-19T03:39:22.418530+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:22.418530+0000","last_undegraded":"2024-04-19T03:39:22.418530+0000","last_fullsized":"2024-04-19T03:39:22.418530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418345+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:22.418345+0000","last_peered":"2024-04-19T03:39:22.418345+0000","last_clean":"2024-04-19T03:39:22.418345+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:22.418345+0000","last_undegraded":"2024-04-19T03:39:22.418345+0000","last_fullsized":"2024-04-19T03:39:22.418345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.712770+0000","last_change":"2024-04-19T03:39:19.422942+0000","last_active":"2024-04-19T03:39:20.712770+0000","last_peered":"2024-04-19T03:39:20.712770+0000","last_clean":"2024-04-19T03:39:20.712770+0000","last_became_active":"2024-04-19T03:39:19.420043+0000","last_became_peered":"2024-04-19T03:39:19.420043+0000","last_unstale":"2024-04-19T03:39:20.712770+0000","last_undegraded":"2024-04-19T03:39:20.712770+0000","last_fullsized":"2024-04-19T03:39:20.712770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:43.957699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6057,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.429203+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:22.429203+0000","last_peered":"2024-04-19T03:39:22.429203+0000","last_clean":"2024-04-19T03:39:22.429203+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:22.429203+0000","last_undegraded":"2024-04-19T03:39:22.429203+0000","last_fullsized":"2024-04-19T03:39:22.429203+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421942+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:22.421942+0000","last_peered":"2024-04-19T03:39:22.421942+0000","last_clean":"2024-04-19T03:39:22.421942+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:22.421942+0000","last_undegraded":"2024-04-19T03:39:22.421942+0000","last_fullsized":"2024-04-19T03:39:22.421942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418193+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:22.418193+0000","last_peered":"2024-04-19T03:39:22.418193+0000","last_clean":"2024-04-19T03:39:22.418193+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:22.418193+0000","last_undegraded":"2024-04-19T03:39:22.418193+0000","last_fullsized":"2024-04-19T03:39:22.418193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.793033+0000","last_change":"2024-04-19T03:39:19.432065+0000","last_active":"2024-04-19T03:39:20.793033+0000","last_peered":"2024-04-19T03:39:20.793033+0000","last_clean":"2024-04-19T03:39:20.793033+0000","last_became_active":"2024-04-19T03:39:19.420230+0000","last_became_peered":"2024-04-19T03:39:19.420230+0000","last_unstale":"2024-04-19T03:39:20.793033+0000","last_undegraded":"2024-04-19T03:39:20.793033+0000","last_fullsized":"2024-04-19T03:39:20.793033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:39.830013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4151,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414548+0000","last_change":"2024-04-19T03:39:21.414548+0000","last_active":"2024-04-19T03:39:19.401355+0000","last_peered":"2024-04-19T03:39:17.390440+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.389480+0000","last_became_peered":"2024-04-19T03:36:29.389480+0000","last_unstale":"2024-04-19T03:39:21.414548+0000","last_undegraded":"2024-04-19T03:39:21.414548+0000","last_fullsized":"2024-04-19T03:39:21.414548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:25.576886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.695194+0000","last_change":"2024-04-19T03:39:19.424767+0000","last_active":"2024-04-19T03:39:20.695194+0000","last_peered":"2024-04-19T03:39:20.695194+0000","last_clean":"2024-04-19T03:39:20.695194+0000","last_became_active":"2024-04-19T03:39:19.424119+0000","last_became_peered":"2024-04-19T03:39:19.424119+0000","last_unstale":"2024-04-19T03:39:20.695194+0000","last_undegraded":"2024-04-19T03:39:20.695194+0000","last_fullsized":"2024-04-19T03:39:20.695194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:17.100453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2052,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421734+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:22.421734+0000","last_peered":"2024-04-19T03:39:22.421734+0000","last_clean":"2024-04-19T03:39:22.421734+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:22.421734+0000","last_undegraded":"2024-04-19T03:39:22.421734+0000","last_fullsized":"2024-04-19T03:39:22.421734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418215+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:22.418215+0000","last_peered":"2024-04-19T03:39:22.418215+0000","last_clean":"2024-04-19T03:39:22.418215+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:22.418215+0000","last_undegraded":"2024-04-19T03:39:22.418215+0000","last_fullsized":"2024-04-19T03:39:22.418215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422360+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:22.422360+0000","last_peered":"2024-04-19T03:39:22.422360+0000","last_clean":"2024-04-19T03:39:22.422360+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:22.422360+0000","last_undegraded":"2024-04-19T03:39:22.422360+0000","last_fullsized":"2024-04-19T03:39:22.422360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421225+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:22.421225+0000","last_peered":"2024-04-19T03:39:22.421225+0000","last_clean":"2024-04-19T03:39:22.421225+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:22.421225+0000","last_undegraded":"2024-04-19T03:39:22.421225+0000","last_fullsized":"2024-04-19T03:39:22.421225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417979+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:22.417979+0000","last_peered":"2024-04-19T03:39:22.417979+0000","last_clean":"2024-04-19T03:39:22.417979+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:22.417979+0000","last_undegraded":"2024-04-19T03:39:22.417979+0000","last_fullsized":"2024-04-19T03:39:22.417979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776626+0000","last_change":"2024-04-19T03:39:19.426025+0000","last_active":"2024-04-19T03:39:20.776626+0000","last_peered":"2024-04-19T03:39:20.776626+0000","last_clean":"2024-04-19T03:39:20.776626+0000","last_became_active":"2024-04-19T03:39:19.425633+0000","last_became_peered":"2024-04-19T03:39:19.425633+0000","last_unstale":"2024-04-19T03:39:20.776626+0000","last_undegraded":"2024-04-19T03:39:20.776626+0000","last_fullsized":"2024-04-19T03:39:20.776626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:54.826770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2196,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.426153+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:22.426153+0000","last_peered":"2024-04-19T03:39:22.426153+0000","last_clean":"2024-04-19T03:39:22.426153+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:22.426153+0000","last_undegraded":"2024-04-19T03:39:22.426153+0000","last_fullsized":"2024-04-19T03:39:22.426153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.700248+0000","last_change":"2024-04-19T03:39:19.423254+0000","last_active":"2024-04-19T03:39:20.700248+0000","last_peered":"2024-04-19T03:39:20.700248+0000","last_clean":"2024-04-19T03:39:20.700248+0000","last_became_active":"2024-04-19T03:39:19.420608+0000","last_became_peered":"2024-04-19T03:39:19.420608+0000","last_unstale":"2024-04-19T03:39:20.700248+0000","last_undegraded":"2024-04-19T03:39:20.700248+0000","last_fullsized":"2024-04-19T03:39:20.700248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:51:19.679913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425324+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:22.425324+0000","last_peered":"2024-04-19T03:39:22.425324+0000","last_clean":"2024-04-19T03:39:22.425324+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:22.425324+0000","last_undegraded":"2024-04-19T03:39:22.425324+0000","last_fullsized":"2024-04-19T03:39:22.425324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422030+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:22.422030+0000","last_peered":"2024-04-19T03:39:22.422030+0000","last_clean":"2024-04-19T03:39:22.422030+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:22.422030+0000","last_undegraded":"2024-04-19T03:39:22.422030+0000","last_fullsized":"2024-04-19T03:39:22.422030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421492+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:22.421492+0000","last_peered":"2024-04-19T03:39:22.421492+0000","last_clean":"2024-04-19T03:39:22.421492+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:22.421492+0000","last_undegraded":"2024-04-19T03:39:22.421492+0000","last_fullsized":"2024-04-19T03:39:22.421492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.807853+0000","last_change":"2024-04-19T03:39:19.419541+0000","last_active":"2024-04-19T03:39:20.807853+0000","last_peered":"2024-04-19T03:39:20.807853+0000","last_clean":"2024-04-19T03:39:20.807853+0000","last_became_active":"2024-04-19T03:39:19.419126+0000","last_became_peered":"2024-04-19T03:39:19.419126+0000","last_unstale":"2024-04-19T03:39:20.807853+0000","last_undegraded":"2024-04-19T03:39:20.807853+0000","last_fullsized":"2024-04-19T03:39:20.807853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:32.179086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2049,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.416591+0000","last_change":"2024-04-19T03:39:21.416591+0000","last_active":"2024-04-19T03:39:19.397578+0000","last_peered":"2024-04-19T03:39:17.390075+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.372053+0000","last_became_peered":"2024-04-19T03:36:29.372053+0000","last_unstale":"2024-04-19T03:39:21.416591+0000","last_undegraded":"2024-04-19T03:39:21.416591+0000","last_fullsized":"2024-04-19T03:39:21.416591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:15.396828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.832336+0000","last_change":"2024-04-19T03:39:19.420641+0000","last_active":"2024-04-19T03:39:20.832336+0000","last_peered":"2024-04-19T03:39:20.832336+0000","last_clean":"2024-04-19T03:39:20.832336+0000","last_became_active":"2024-04-19T03:39:19.420142+0000","last_became_peered":"2024-04-19T03:39:19.420142+0000","last_unstale":"2024-04-19T03:39:20.832336+0000","last_undegraded":"2024-04-19T03:39:20.832336+0000","last_fullsized":"2024-04-19T03:39:20.832336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:07.098008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417556+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:22.417556+0000","last_peered":"2024-04-19T03:39:22.417556+0000","last_clean":"2024-04-19T03:39:22.417556+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:22.417556+0000","last_undegraded":"2024-04-19T03:39:22.417556+0000","last_fullsized":"2024-04-19T03:39:22.417556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417935+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:22.417935+0000","last_peered":"2024-04-19T03:39:22.417935+0000","last_clean":"2024-04-19T03:39:22.417935+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:22.417935+0000","last_undegraded":"2024-04-19T03:39:22.417935+0000","last_fullsized":"2024-04-19T03:39:22.417935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2076,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414647+0000","last_change":"2024-04-19T03:39:21.414647+0000","last_active":"2024-04-19T03:39:19.401036+0000","last_peered":"2024-04-19T03:39:17.390868+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.374335+0000","last_became_peered":"2024-04-19T03:36:29.374335+0000","last_unstale":"2024-04-19T03:39:21.414647+0000","last_undegraded":"2024-04-19T03:39:21.414647+0000","last_fullsized":"2024-04-19T03:39:21.414647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:01:56.554589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.793546+0000","last_change":"2024-04-19T03:39:19.420700+0000","last_active":"2024-04-19T03:39:20.793546+0000","last_peered":"2024-04-19T03:39:20.793546+0000","last_clean":"2024-04-19T03:39:20.793546+0000","last_became_active":"2024-04-19T03:39:19.419391+0000","last_became_peered":"2024-04-19T03:39:19.419391+0000","last_unstale":"2024-04-19T03:39:20.793546+0000","last_undegraded":"2024-04-19T03:39:20.793546+0000","last_fullsized":"2024-04-19T03:39:20.793546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:04.519906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2103,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414644+0000","last_change":"2024-04-19T03:39:21.414644+0000","last_active":"2024-04-19T03:39:19.404845+0000","last_peered":"2024-04-19T03:39:17.391343+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.389704+0000","last_became_peered":"2024-04-19T03:36:29.389704+0000","last_unstale":"2024-04-19T03:39:21.414644+0000","last_undegraded":"2024-04-19T03:39:21.414644+0000","last_fullsized":"2024-04-19T03:39:21.414644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:09.496570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421084+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:22.421084+0000","last_peered":"2024-04-19T03:39:22.421084+0000","last_clean":"2024-04-19T03:39:22.421084+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:22.421084+0000","last_undegraded":"2024-04-19T03:39:22.421084+0000","last_fullsized":"2024-04-19T03:39:22.421084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2113,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417458+0000","last_change":"2024-04-19T03:39:21.417458+0000","last_active":"2024-04-19T03:39:19.402862+0000","last_peered":"2024-04-19T03:39:17.391142+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.390577+0000","last_became_peered":"2024-04-19T03:36:29.390577+0000","last_unstale":"2024-04-19T03:39:21.417458+0000","last_undegraded":"2024-04-19T03:39:21.417458+0000","last_fullsized":"2024-04-19T03:39:21.417458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:41.874078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421213+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:22.421213+0000","last_peered":"2024-04-19T03:39:22.421213+0000","last_clean":"2024-04-19T03:39:22.421213+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:22.421213+0000","last_undegraded":"2024-04-19T03:39:22.421213+0000","last_fullsized":"2024-04-19T03:39:22.421213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418126+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:22.418126+0000","last_peered":"2024-04-19T03:39:22.418126+0000","last_clean":"2024-04-19T03:39:22.418126+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:22.418126+0000","last_undegraded":"2024-04-19T03:39:22.418126+0000","last_fullsized":"2024-04-19T03:39:22.418126+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417925+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:22.417925+0000","last_peered":"2024-04-19T03:39:22.417925+0000","last_clean":"2024-04-19T03:39:22.417925+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:22.417925+0000","last_undegraded":"2024-04-19T03:39:22.417925+0000","last_fullsized":"2024-04-19T03:39:22.417925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422048+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:22.422048+0000","last_peered":"2024-04-19T03:39:22.422048+0000","last_clean":"2024-04-19T03:39:22.422048+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:22.422048+0000","last_undegraded":"2024-04-19T03:39:22.422048+0000","last_fullsized":"2024-04-19T03:39:22.422048+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418187+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:22.418187+0000","last_peered":"2024-04-19T03:39:22.418187+0000","last_clean":"2024-04-19T03:39:22.418187+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:22.418187+0000","last_undegraded":"2024-04-19T03:39:22.418187+0000","last_fullsized":"2024-04-19T03:39:22.418187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421727+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:22.421727+0000","last_peered":"2024-04-19T03:39:22.421727+0000","last_clean":"2024-04-19T03:39:22.421727+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:22.421727+0000","last_undegraded":"2024-04-19T03:39:22.421727+0000","last_fullsized":"2024-04-19T03:39:22.421727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417785+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:22.417785+0000","last_peered":"2024-04-19T03:39:22.417785+0000","last_clean":"2024-04-19T03:39:22.417785+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:22.417785+0000","last_undegraded":"2024-04-19T03:39:22.417785+0000","last_fullsized":"2024-04-19T03:39:22.417785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421360+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:22.421360+0000","last_peered":"2024-04-19T03:39:22.421360+0000","last_clean":"2024-04-19T03:39:22.421360+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:22.421360+0000","last_undegraded":"2024-04-19T03:39:22.421360+0000","last_fullsized":"2024-04-19T03:39:22.421360+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417413+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:22.417413+0000","last_peered":"2024-04-19T03:39:22.417413+0000","last_clean":"2024-04-19T03:39:22.417413+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:22.417413+0000","last_undegraded":"2024-04-19T03:39:22.417413+0000","last_fullsized":"2024-04-19T03:39:22.417413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776717+0000","last_change":"2024-04-19T03:39:19.426047+0000","last_active":"2024-04-19T03:39:20.776717+0000","last_peered":"2024-04-19T03:39:20.776717+0000","last_clean":"2024-04-19T03:39:20.776717+0000","last_became_active":"2024-04-19T03:39:19.425609+0000","last_became_peered":"2024-04-19T03:39:19.425609+0000","last_unstale":"2024-04-19T03:39:20.776717+0000","last_undegraded":"2024-04-19T03:39:20.776717+0000","last_fullsized":"2024-04-19T03:39:20.776717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:20.346656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417921+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:22.417921+0000","last_peered":"2024-04-19T03:39:22.417921+0000","last_clean":"2024-04-19T03:39:22.417921+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:22.417921+0000","last_undegraded":"2024-04-19T03:39:22.417921+0000","last_fullsized":"2024-04-19T03:39:22.417921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8078,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422546+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:22.422546+0000","last_peered":"2024-04-19T03:39:22.422546+0000","last_clean":"2024-04-19T03:39:22.422546+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:22.422546+0000","last_undegraded":"2024-04-19T03:39:22.422546+0000","last_fullsized":"2024-04-19T03:39:22.422546+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.792909+0000","last_change":"2024-04-19T03:39:19.420389+0000","last_active":"2024-04-19T03:39:20.792909+0000","last_peered":"2024-04-19T03:39:20.792909+0000","last_clean":"2024-04-19T03:39:20.792909+0000","last_became_active":"2024-04-19T03:39:19.418907+0000","last_became_peered":"2024-04-19T03:39:19.418907+0000","last_unstale":"2024-04-19T03:39:20.792909+0000","last_undegraded":"2024-04-19T03:39:20.792909+0000","last_fullsized":"2024-04-19T03:39:20.792909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:10.315321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421297+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:22.421297+0000","last_peered":"2024-04-19T03:39:22.421297+0000","last_clean":"2024-04-19T03:39:22.421297+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:22.421297+0000","last_undegraded":"2024-04-19T03:39:22.421297+0000","last_fullsized":"2024-04-19T03:39:22.421297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418649+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:22.418649+0000","last_peered":"2024-04-19T03:39:22.418649+0000","last_clean":"2024-04-19T03:39:22.418649+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:22.418649+0000","last_undegraded":"2024-04-19T03:39:22.418649+0000","last_fullsized":"2024-04-19T03:39:22.418649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776343+0000","last_change":"2024-04-19T03:39:19.424877+0000","last_active":"2024-04-19T03:39:20.776343+0000","last_peered":"2024-04-19T03:39:20.776343+0000","last_clean":"2024-04-19T03:39:20.776343+0000","last_became_active":"2024-04-19T03:39:19.424216+0000","last_became_peered":"2024-04-19T03:39:19.424216+0000","last_unstale":"2024-04-19T03:39:20.776343+0000","last_undegraded":"2024-04-19T03:39:20.776343+0000","last_fullsized":"2024-04-19T03:39:20.776343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:16:03.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417905+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:22.417905+0000","last_peered":"2024-04-19T03:39:22.417905+0000","last_clean":"2024-04-19T03:39:22.417905+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:22.417905+0000","last_undegraded":"2024-04-19T03:39:22.417905+0000","last_fullsized":"2024-04-19T03:39:22.417905+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.808019+0000","last_change":"2024-04-19T03:39:19.420362+0000","last_active":"2024-04-19T03:39:20.808019+0000","last_peered":"2024-04-19T03:39:20.808019+0000","last_clean":"2024-04-19T03:39:20.808019+0000","last_became_active":"2024-04-19T03:39:19.419278+0000","last_became_peered":"2024-04-19T03:39:19.419278+0000","last_unstale":"2024-04-19T03:39:20.808019+0000","last_undegraded":"2024-04-19T03:39:20.808019+0000","last_fullsized":"2024-04-19T03:39:20.808019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:02.103259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421363+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:22.421363+0000","last_peered":"2024-04-19T03:39:22.421363+0000","last_clean":"2024-04-19T03:39:22.421363+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:22.421363+0000","last_undegraded":"2024-04-19T03:39:22.421363+0000","last_fullsized":"2024-04-19T03:39:22.421363+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.812540+0000","last_change":"2024-04-19T03:39:19.426867+0000","last_active":"2024-04-19T03:39:20.812540+0000","last_peered":"2024-04-19T03:39:20.812540+0000","last_clean":"2024-04-19T03:39:20.812540+0000","last_became_active":"2024-04-19T03:39:19.425825+0000","last_became_peered":"2024-04-19T03:39:19.425825+0000","last_unstale":"2024-04-19T03:39:20.812540+0000","last_undegraded":"2024-04-19T03:39:20.812540+0000","last_fullsized":"2024-04-19T03:39:20.812540+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:33.744870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418681+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:22.418681+0000","last_peered":"2024-04-19T03:39:22.418681+0000","last_clean":"2024-04-19T03:39:22.418681+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:22.418681+0000","last_undegraded":"2024-04-19T03:39:22.418681+0000","last_fullsized":"2024-04-19T03:39:22.418681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422170+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:22.422170+0000","last_peered":"2024-04-19T03:39:22.422170+0000","last_clean":"2024-04-19T03:39:22.422170+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:22.422170+0000","last_undegraded":"2024-04-19T03:39:22.422170+0000","last_fullsized":"2024-04-19T03:39:22.422170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418675+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:22.418675+0000","last_peered":"2024-04-19T03:39:22.418675+0000","last_clean":"2024-04-19T03:39:22.418675+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:22.418675+0000","last_undegraded":"2024-04-19T03:39:22.418675+0000","last_fullsized":"2024-04-19T03:39:22.418675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2055,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425829+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:22.425829+0000","last_peered":"2024-04-19T03:39:22.425829+0000","last_clean":"2024-04-19T03:39:22.425829+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:22.425829+0000","last_undegraded":"2024-04-19T03:39:22.425829+0000","last_fullsized":"2024-04-19T03:39:22.425829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.699995+0000","last_change":"2024-04-19T03:39:19.418696+0000","last_active":"2024-04-19T03:39:20.699995+0000","last_peered":"2024-04-19T03:39:20.699995+0000","last_clean":"2024-04-19T03:39:20.699995+0000","last_became_active":"2024-04-19T03:39:19.416023+0000","last_became_peered":"2024-04-19T03:39:19.416023+0000","last_unstale":"2024-04-19T03:39:20.699995+0000","last_undegraded":"2024-04-19T03:39:20.699995+0000","last_fullsized":"2024-04-19T03:39:20.699995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:03:24.163580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.809450+0000","last_change":"2024-04-19T03:39:19.423441+0000","last_active":"2024-04-19T03:39:20.809450+0000","last_peered":"2024-04-19T03:39:20.809450+0000","last_clean":"2024-04-19T03:39:20.809450+0000","last_became_active":"2024-04-19T03:39:19.421557+0000","last_became_peered":"2024-04-19T03:39:19.421557+0000","last_unstale":"2024-04-19T03:39:20.809450+0000","last_undegraded":"2024-04-19T03:39:20.809450+0000","last_fullsized":"2024-04-19T03:39:20.809450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:52.644757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421219+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:22.421219+0000","last_peered":"2024-04-19T03:39:22.421219+0000","last_clean":"2024-04-19T03:39:22.421219+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:22.421219+0000","last_undegraded":"2024-04-19T03:39:22.421219+0000","last_fullsized":"2024-04-19T03:39:22.421219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421724+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:22.421724+0000","last_peered":"2024-04-19T03:39:22.421724+0000","last_clean":"2024-04-19T03:39:22.421724+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:22.421724+0000","last_undegraded":"2024-04-19T03:39:22.421724+0000","last_fullsized":"2024-04-19T03:39:22.421724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421874+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:22.421874+0000","last_peered":"2024-04-19T03:39:22.421874+0000","last_clean":"2024-04-19T03:39:22.421874+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:22.421874+0000","last_undegraded":"2024-04-19T03:39:22.421874+0000","last_fullsized":"2024-04-19T03:39:22.421874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.832327+0000","last_change":"2024-04-19T03:39:19.423441+0000","last_active":"2024-04-19T03:39:20.832327+0000","last_peered":"2024-04-19T03:39:20.832327+0000","last_clean":"2024-04-19T03:39:20.832327+0000","last_became_active":"2024-04-19T03:39:19.422038+0000","last_became_peered":"2024-04-19T03:39:19.422038+0000","last_unstale":"2024-04-19T03:39:20.832327+0000","last_undegraded":"2024-04-19T03:39:20.832327+0000","last_fullsized":"2024-04-19T03:39:20.832327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:54.159938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2068,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.413561+0000","last_change":"2024-04-19T03:39:21.413561+0000","last_active":"2024-04-19T03:39:19.399820+0000","last_peered":"2024-04-19T03:39:17.390596+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.373442+0000","last_became_peered":"2024-04-19T03:36:29.373442+0000","last_unstale":"2024-04-19T03:39:21.413561+0000","last_undegraded":"2024-04-19T03:39:21.413561+0000","last_fullsized":"2024-04-19T03:39:21.413561+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:00.224961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422213+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:22.422213+0000","last_peered":"2024-04-19T03:39:22.422213+0000","last_clean":"2024-04-19T03:39:22.422213+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:22.422213+0000","last_undegraded":"2024-04-19T03:39:22.422213+0000","last_fullsized":"2024-04-19T03:39:22.422213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.792829+0000","last_change":"2024-04-19T03:39:19.422170+0000","last_active":"2024-04-19T03:39:20.792829+0000","last_peered":"2024-04-19T03:39:20.792829+0000","last_clean":"2024-04-19T03:39:20.792829+0000","last_became_active":"2024-04-19T03:39:19.421532+0000","last_became_peered":"2024-04-19T03:39:19.421532+0000","last_unstale":"2024-04-19T03:39:20.792829+0000","last_undegraded":"2024-04-19T03:39:20.792829+0000","last_fullsized":"2024-04-19T03:39:20.792829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:44.716256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417889+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:22.417889+0000","last_peered":"2024-04-19T03:39:22.417889+0000","last_clean":"2024-04-19T03:39:22.417889+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:22.417889+0000","last_undegraded":"2024-04-19T03:39:22.417889+0000","last_fullsized":"2024-04-19T03:39:22.417889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421507+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:22.421507+0000","last_peered":"2024-04-19T03:39:22.421507+0000","last_clean":"2024-04-19T03:39:22.421507+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:22.421507+0000","last_undegraded":"2024-04-19T03:39:22.421507+0000","last_fullsized":"2024-04-19T03:39:22.421507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418537+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:22.418537+0000","last_peered":"2024-04-19T03:39:22.418537+0000","last_clean":"2024-04-19T03:39:22.418537+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:22.418537+0000","last_undegraded":"2024-04-19T03:39:22.418537+0000","last_fullsized":"2024-04-19T03:39:22.418537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2117,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414810+0000","last_change":"2024-04-19T03:39:21.414810+0000","last_active":"2024-04-19T03:39:19.400814+0000","last_peered":"2024-04-19T03:39:17.390411+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.373880+0000","last_became_peered":"2024-04-19T03:36:29.373880+0000","last_unstale":"2024-04-19T03:39:21.414810+0000","last_undegraded":"2024-04-19T03:39:21.414810+0000","last_fullsized":"2024-04-19T03:39:21.414810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:01.028017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776527+0000","last_change":"2024-04-19T03:39:19.423562+0000","last_active":"2024-04-19T03:39:20.776527+0000","last_peered":"2024-04-19T03:39:20.776527+0000","last_clean":"2024-04-19T03:39:20.776527+0000","last_became_active":"2024-04-19T03:39:19.421810+0000","last_became_peered":"2024-04-19T03:39:19.421810+0000","last_unstale":"2024-04-19T03:39:20.776527+0000","last_undegraded":"2024-04-19T03:39:20.776527+0000","last_fullsized":"2024-04-19T03:39:20.776527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:34:19.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418045+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:22.418045+0000","last_peered":"2024-04-19T03:39:22.418045+0000","last_clean":"2024-04-19T03:39:22.418045+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:22.418045+0000","last_undegraded":"2024-04-19T03:39:22.418045+0000","last_fullsized":"2024-04-19T03:39:22.418045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2077,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425727+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:22.425727+0000","last_peered":"2024-04-19T03:39:22.425727+0000","last_clean":"2024-04-19T03:39:22.425727+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:22.425727+0000","last_undegraded":"2024-04-19T03:39:22.425727+0000","last_fullsized":"2024-04-19T03:39:22.425727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2093,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418045+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:22.418045+0000","last_peered":"2024-04-19T03:39:22.418045+0000","last_clean":"2024-04-19T03:39:22.418045+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:22.418045+0000","last_undegraded":"2024-04-19T03:39:22.418045+0000","last_fullsized":"2024-04-19T03:39:22.418045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.426357+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:22.426357+0000","last_peered":"2024-04-19T03:39:22.426357+0000","last_clean":"2024-04-19T03:39:22.426357+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:22.426357+0000","last_undegraded":"2024-04-19T03:39:22.426357+0000","last_fullsized":"2024-04-19T03:39:22.426357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481794,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47132,"kb_used_data":1548,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324708,"statfs":{"total":96636764160,"available":96588500992,"internally_reserved":0,"allocated":1585152,"data_stored":1203350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369752,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002088,"statfs":{"total":96636764160,"available":96258138112,"internally_reserved":0,"allocated":1581056,"data_stored":1206376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738412,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378736,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993104,"statfs":{"total":96636764160,"available":96248938496,"internally_reserved":0,"allocated":692224,"data_stored":331588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.432},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:25.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:26.249 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:26.251 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:26.264 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-19T03:39:25.425767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795620,"kb_used_data":3768,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319900,"statfs":{"total":289910292480,"available":289095577600,"internally_reserved":0,"allocated":3858432,"data_stored":2741314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016955"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2056,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422626+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:22.422626+0000","last_peered":"2024-04-19T03:39:22.422626+0000","last_clean":"2024-04-19T03:39:22.422626+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:22.422626+0000","last_undegraded":"2024-04-19T03:39:22.422626+0000","last_fullsized":"2024-04-19T03:39:22.422626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422058+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:22.422058+0000","last_peered":"2024-04-19T03:39:22.422058+0000","last_clean":"2024-04-19T03:39:22.422058+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:22.422058+0000","last_undegraded":"2024-04-19T03:39:22.422058+0000","last_fullsized":"2024-04-19T03:39:22.422058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4061,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417980+0000","last_change":"2024-04-19T03:39:21.417980+0000","last_active":"2024-04-19T03:39:19.401011+0000","last_peered":"2024-04-19T03:39:17.390890+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.390099+0000","last_became_peered":"2024-04-19T03:36:29.390099+0000","last_unstale":"2024-04-19T03:39:21.417980+0000","last_undegraded":"2024-04-19T03:39:21.417980+0000","last_fullsized":"2024-04-19T03:39:21.417980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:42.792413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.792917+0000","last_change":"2024-04-19T03:39:19.419024+0000","last_active":"2024-04-19T03:39:20.792917+0000","last_peered":"2024-04-19T03:39:20.792917+0000","last_clean":"2024-04-19T03:39:20.792917+0000","last_became_active":"2024-04-19T03:39:19.417807+0000","last_became_peered":"2024-04-19T03:39:19.417807+0000","last_unstale":"2024-04-19T03:39:20.792917+0000","last_undegraded":"2024-04-19T03:39:20.792917+0000","last_fullsized":"2024-04-19T03:39:20.792917+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:48.505600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421783+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:22.421783+0000","last_peered":"2024-04-19T03:39:22.421783+0000","last_clean":"2024-04-19T03:39:22.421783+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:22.421783+0000","last_undegraded":"2024-04-19T03:39:22.421783+0000","last_fullsized":"2024-04-19T03:39:22.421783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.793497+0000","last_change":"2024-04-19T03:39:19.421767+0000","last_active":"2024-04-19T03:39:20.793497+0000","last_peered":"2024-04-19T03:39:20.793497+0000","last_clean":"2024-04-19T03:39:20.793497+0000","last_became_active":"2024-04-19T03:39:19.419382+0000","last_became_peered":"2024-04-19T03:39:19.419382+0000","last_unstale":"2024-04-19T03:39:20.793497+0000","last_undegraded":"2024-04-19T03:39:20.793497+0000","last_fullsized":"2024-04-19T03:39:20.793497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:24.971099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.762843+0000","last_change":"2024-04-19T03:39:19.421794+0000","last_active":"2024-04-19T03:39:20.762843+0000","last_peered":"2024-04-19T03:39:20.762843+0000","last_clean":"2024-04-19T03:39:20.762843+0000","last_became_active":"2024-04-19T03:39:19.420332+0000","last_became_peered":"2024-04-19T03:39:19.420332+0000","last_unstale":"2024-04-19T03:39:20.762843+0000","last_undegraded":"2024-04-19T03:39:20.762843+0000","last_fullsized":"2024-04-19T03:39:20.762843+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:58.338163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8109,"reported_epoch":79,"state":"peering","last_fresh":"2024-04-19T03:39:20.848454+0000","last_change":"2024-04-19T03:39:21.413503+0000","last_active":"2024-04-19T03:39:21.413503+0000","last_peered":"2024-04-19T03:39:20.848454+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:39:20.777376+0000","last_became_peered":"2024-04-19T03:39:20.777376+0000","last_unstale":"2024-04-19T03:39:20.848454+0000","last_undegraded":"2024-04-19T03:39:20.848454+0000","last_fullsized":"2024-04-19T03:39:20.397920+0000","mapping_epoch":80,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:18:32.130026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417737+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:22.417737+0000","last_peered":"2024-04-19T03:39:22.417737+0000","last_clean":"2024-04-19T03:39:22.417737+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:22.417737+0000","last_undegraded":"2024-04-19T03:39:22.417737+0000","last_fullsized":"2024-04-19T03:39:22.417737+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6163,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422441+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:22.422441+0000","last_peered":"2024-04-19T03:39:22.422441+0000","last_clean":"2024-04-19T03:39:22.422441+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:22.422441+0000","last_undegraded":"2024-04-19T03:39:22.422441+0000","last_fullsized":"2024-04-19T03:39:22.422441+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4007,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414383+0000","last_change":"2024-04-19T03:39:21.414383+0000","last_active":"2024-04-19T03:39:19.399755+0000","last_peered":"2024-04-19T03:39:17.390889+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.373192+0000","last_became_peered":"2024-04-19T03:36:29.373192+0000","last_unstale":"2024-04-19T03:39:21.414383+0000","last_undegraded":"2024-04-19T03:39:21.414383+0000","last_fullsized":"2024-04-19T03:39:21.414383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:49.295567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2168,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425823+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:22.425823+0000","last_peered":"2024-04-19T03:39:22.425823+0000","last_clean":"2024-04-19T03:39:22.425823+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:22.425823+0000","last_undegraded":"2024-04-19T03:39:22.425823+0000","last_fullsized":"2024-04-19T03:39:22.425823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2069,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421186+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:22.421186+0000","last_peered":"2024-04-19T03:39:22.421186+0000","last_clean":"2024-04-19T03:39:22.421186+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:22.421186+0000","last_undegraded":"2024-04-19T03:39:22.421186+0000","last_fullsized":"2024-04-19T03:39:22.421186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2140,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.419591+0000","last_change":"2024-04-19T03:39:21.419591+0000","last_active":"2024-04-19T03:39:19.401370+0000","last_peered":"2024-04-19T03:39:17.390391+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.383815+0000","last_became_peered":"2024-04-19T03:36:29.383815+0000","last_unstale":"2024-04-19T03:39:21.419591+0000","last_undegraded":"2024-04-19T03:39:21.419591+0000","last_fullsized":"2024-04-19T03:39:21.419591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:03:35.454941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2093,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417583+0000","last_change":"2024-04-19T03:39:21.417583+0000","last_active":"2024-04-19T03:39:19.400625+0000","last_peered":"2024-04-19T03:39:17.390203+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.389452+0000","last_became_peered":"2024-04-19T03:36:29.389452+0000","last_unstale":"2024-04-19T03:39:21.417583+0000","last_undegraded":"2024-04-19T03:39:21.417583+0000","last_fullsized":"2024-04-19T03:39:21.417583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:25:08.519003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2070,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.413454+0000","last_change":"2024-04-19T03:39:21.413454+0000","last_active":"2024-04-19T03:39:19.398248+0000","last_peered":"2024-04-19T03:39:17.389980+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.372165+0000","last_became_peered":"2024-04-19T03:36:29.372165+0000","last_unstale":"2024-04-19T03:39:21.413454+0000","last_undegraded":"2024-04-19T03:39:21.413454+0000","last_fullsized":"2024-04-19T03:39:21.413454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:02.026046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2057,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418300+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:22.418300+0000","last_peered":"2024-04-19T03:39:22.418300+0000","last_clean":"2024-04-19T03:39:22.418300+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:22.418300+0000","last_undegraded":"2024-04-19T03:39:22.418300+0000","last_fullsized":"2024-04-19T03:39:22.418300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422216+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:22.422216+0000","last_peered":"2024-04-19T03:39:22.422216+0000","last_clean":"2024-04-19T03:39:22.422216+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:22.422216+0000","last_undegraded":"2024-04-19T03:39:22.422216+0000","last_fullsized":"2024-04-19T03:39:22.422216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417698+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:22.417698+0000","last_peered":"2024-04-19T03:39:22.417698+0000","last_clean":"2024-04-19T03:39:22.417698+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:22.417698+0000","last_undegraded":"2024-04-19T03:39:22.417698+0000","last_fullsized":"2024-04-19T03:39:22.417698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4154,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414259+0000","last_change":"2024-04-19T03:39:21.414259+0000","last_active":"2024-04-19T03:39:19.399351+0000","last_peered":"2024-04-19T03:39:17.390607+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.372161+0000","last_became_peered":"2024-04-19T03:36:29.372161+0000","last_unstale":"2024-04-19T03:39:21.414259+0000","last_undegraded":"2024-04-19T03:39:21.414259+0000","last_fullsized":"2024-04-19T03:39:21.414259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:09.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.695055+0000","last_change":"2024-04-19T03:39:19.425914+0000","last_active":"2024-04-19T03:39:20.695055+0000","last_peered":"2024-04-19T03:39:20.695055+0000","last_clean":"2024-04-19T03:39:20.695055+0000","last_became_active":"2024-04-19T03:39:19.425552+0000","last_became_peered":"2024-04-19T03:39:19.425552+0000","last_unstale":"2024-04-19T03:39:20.695055+0000","last_undegraded":"2024-04-19T03:39:20.695055+0000","last_fullsized":"2024-04-19T03:39:20.695055+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:41.252438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425847+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:22.425847+0000","last_peered":"2024-04-19T03:39:22.425847+0000","last_clean":"2024-04-19T03:39:22.425847+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:22.425847+0000","last_undegraded":"2024-04-19T03:39:22.425847+0000","last_fullsized":"2024-04-19T03:39:22.425847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.426153+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:22.426153+0000","last_peered":"2024-04-19T03:39:22.426153+0000","last_clean":"2024-04-19T03:39:22.426153+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:22.426153+0000","last_undegraded":"2024-04-19T03:39:22.426153+0000","last_fullsized":"2024-04-19T03:39:22.426153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4098,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421455+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:22.421455+0000","last_peered":"2024-04-19T03:39:22.421455+0000","last_clean":"2024-04-19T03:39:22.421455+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:22.421455+0000","last_undegraded":"2024-04-19T03:39:22.421455+0000","last_fullsized":"2024-04-19T03:39:22.421455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2084,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425871+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:22.425871+0000","last_peered":"2024-04-19T03:39:22.425871+0000","last_clean":"2024-04-19T03:39:22.425871+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:22.425871+0000","last_undegraded":"2024-04-19T03:39:22.425871+0000","last_fullsized":"2024-04-19T03:39:22.425871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418038+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:22.418038+0000","last_peered":"2024-04-19T03:39:22.418038+0000","last_clean":"2024-04-19T03:39:22.418038+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:22.418038+0000","last_undegraded":"2024-04-19T03:39:22.418038+0000","last_fullsized":"2024-04-19T03:39:22.418038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2096,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417852+0000","last_change":"2024-04-19T03:39:21.417852+0000","last_active":"2024-04-19T03:39:19.405093+0000","last_peered":"2024-04-19T03:39:17.391549+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.390763+0000","last_became_peered":"2024-04-19T03:36:29.390763+0000","last_unstale":"2024-04-19T03:39:21.417852+0000","last_undegraded":"2024-04-19T03:39:21.417852+0000","last_fullsized":"2024-04-19T03:39:21.417852+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:00:17.140503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421096+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:22.421096+0000","last_peered":"2024-04-19T03:39:22.421096+0000","last_clean":"2024-04-19T03:39:22.421096+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:22.421096+0000","last_undegraded":"2024-04-19T03:39:22.421096+0000","last_fullsized":"2024-04-19T03:39:22.421096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422060+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:22.422060+0000","last_peered":"2024-04-19T03:39:22.422060+0000","last_clean":"2024-04-19T03:39:22.422060+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:22.422060+0000","last_undegraded":"2024-04-19T03:39:22.422060+0000","last_fullsized":"2024-04-19T03:39:22.422060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418269+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:22.418269+0000","last_peered":"2024-04-19T03:39:22.418269+0000","last_clean":"2024-04-19T03:39:22.418269+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:22.418269+0000","last_undegraded":"2024-04-19T03:39:22.418269+0000","last_fullsized":"2024-04-19T03:39:22.418269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417821+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:22.417821+0000","last_peered":"2024-04-19T03:39:22.417821+0000","last_clean":"2024-04-19T03:39:22.417821+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:22.417821+0000","last_undegraded":"2024-04-19T03:39:22.417821+0000","last_fullsized":"2024-04-19T03:39:22.417821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418584+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:22.418584+0000","last_peered":"2024-04-19T03:39:22.418584+0000","last_clean":"2024-04-19T03:39:22.418584+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:22.418584+0000","last_undegraded":"2024-04-19T03:39:22.418584+0000","last_fullsized":"2024-04-19T03:39:22.418584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422451+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:22.422451+0000","last_peered":"2024-04-19T03:39:22.422451+0000","last_clean":"2024-04-19T03:39:22.422451+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:22.422451+0000","last_undegraded":"2024-04-19T03:39:22.422451+0000","last_fullsized":"2024-04-19T03:39:22.422451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418530+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:22.418530+0000","last_peered":"2024-04-19T03:39:22.418530+0000","last_clean":"2024-04-19T03:39:22.418530+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:22.418530+0000","last_undegraded":"2024-04-19T03:39:22.418530+0000","last_fullsized":"2024-04-19T03:39:22.418530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418345+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:22.418345+0000","last_peered":"2024-04-19T03:39:22.418345+0000","last_clean":"2024-04-19T03:39:22.418345+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:22.418345+0000","last_undegraded":"2024-04-19T03:39:22.418345+0000","last_fullsized":"2024-04-19T03:39:22.418345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.712770+0000","last_change":"2024-04-19T03:39:19.422942+0000","last_active":"2024-04-19T03:39:20.712770+0000","last_peered":"2024-04-19T03:39:20.712770+0000","last_clean":"2024-04-19T03:39:20.712770+0000","last_became_active":"2024-04-19T03:39:19.420043+0000","last_became_peered":"2024-04-19T03:39:19.420043+0000","last_unstale":"2024-04-19T03:39:20.712770+0000","last_undegraded":"2024-04-19T03:39:20.712770+0000","last_fullsized":"2024-04-19T03:39:20.712770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:43.957699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6057,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.429203+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:22.429203+0000","last_peered":"2024-04-19T03:39:22.429203+0000","last_clean":"2024-04-19T03:39:22.429203+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:22.429203+0000","last_undegraded":"2024-04-19T03:39:22.429203+0000","last_fullsized":"2024-04-19T03:39:22.429203+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421942+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:22.421942+0000","last_peered":"2024-04-19T03:39:22.421942+0000","last_clean":"2024-04-19T03:39:22.421942+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:22.421942+0000","last_undegraded":"2024-04-19T03:39:22.421942+0000","last_fullsized":"2024-04-19T03:39:22.421942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418193+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:22.418193+0000","last_peered":"2024-04-19T03:39:22.418193+0000","last_clean":"2024-04-19T03:39:22.418193+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:22.418193+0000","last_undegraded":"2024-04-19T03:39:22.418193+0000","last_fullsized":"2024-04-19T03:39:22.418193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.793033+0000","last_change":"2024-04-19T03:39:19.432065+0000","last_active":"2024-04-19T03:39:20.793033+0000","last_peered":"2024-04-19T03:39:20.793033+0000","last_clean":"2024-04-19T03:39:20.793033+0000","last_became_active":"2024-04-19T03:39:19.420230+0000","last_became_peered":"2024-04-19T03:39:19.420230+0000","last_unstale":"2024-04-19T03:39:20.793033+0000","last_undegraded":"2024-04-19T03:39:20.793033+0000","last_fullsized":"2024-04-19T03:39:20.793033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:39.830013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4151,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414548+0000","last_change":"2024-04-19T03:39:21.414548+0000","last_active":"2024-04-19T03:39:19.401355+0000","last_peered":"2024-04-19T03:39:17.390440+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.389480+0000","last_became_peered":"2024-04-19T03:36:29.389480+0000","last_unstale":"2024-04-19T03:39:21.414548+0000","last_undegraded":"2024-04-19T03:39:21.414548+0000","last_fullsized":"2024-04-19T03:39:21.414548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:25.576886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.695194+0000","last_change":"2024-04-19T03:39:19.424767+0000","last_active":"2024-04-19T03:39:20.695194+0000","last_peered":"2024-04-19T03:39:20.695194+0000","last_clean":"2024-04-19T03:39:20.695194+0000","last_became_active":"2024-04-19T03:39:19.424119+0000","last_became_peered":"2024-04-19T03:39:19.424119+0000","last_unstale":"2024-04-19T03:39:20.695194+0000","last_undegraded":"2024-04-19T03:39:20.695194+0000","last_fullsized":"2024-04-19T03:39:20.695194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:17.100453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2052,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421734+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:22.421734+0000","last_peered":"2024-04-19T03:39:22.421734+0000","last_clean":"2024-04-19T03:39:22.421734+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:22.421734+0000","last_undegraded":"2024-04-19T03:39:22.421734+0000","last_fullsized":"2024-04-19T03:39:22.421734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418215+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:22.418215+0000","last_peered":"2024-04-19T03:39:22.418215+0000","last_clean":"2024-04-19T03:39:22.418215+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:22.418215+0000","last_undegraded":"2024-04-19T03:39:22.418215+0000","last_fullsized":"2024-04-19T03:39:22.418215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422360+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:22.422360+0000","last_peered":"2024-04-19T03:39:22.422360+0000","last_clean":"2024-04-19T03:39:22.422360+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:22.422360+0000","last_undegraded":"2024-04-19T03:39:22.422360+0000","last_fullsized":"2024-04-19T03:39:22.422360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421225+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:22.421225+0000","last_peered":"2024-04-19T03:39:22.421225+0000","last_clean":"2024-04-19T03:39:22.421225+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:22.421225+0000","last_undegraded":"2024-04-19T03:39:22.421225+0000","last_fullsized":"2024-04-19T03:39:22.421225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417979+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:22.417979+0000","last_peered":"2024-04-19T03:39:22.417979+0000","last_clean":"2024-04-19T03:39:22.417979+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:22.417979+0000","last_undegraded":"2024-04-19T03:39:22.417979+0000","last_fullsized":"2024-04-19T03:39:22.417979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776626+0000","last_change":"2024-04-19T03:39:19.426025+0000","last_active":"2024-04-19T03:39:20.776626+0000","last_peered":"2024-04-19T03:39:20.776626+0000","last_clean":"2024-04-19T03:39:20.776626+0000","last_became_active":"2024-04-19T03:39:19.425633+0000","last_became_peered":"2024-04-19T03:39:19.425633+0000","last_unstale":"2024-04-19T03:39:20.776626+0000","last_undegraded":"2024-04-19T03:39:20.776626+0000","last_fullsized":"2024-04-19T03:39:20.776626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:54.826770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2196,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.426153+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:22.426153+0000","last_peered":"2024-04-19T03:39:22.426153+0000","last_clean":"2024-04-19T03:39:22.426153+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:22.426153+0000","last_undegraded":"2024-04-19T03:39:22.426153+0000","last_fullsized":"2024-04-19T03:39:22.426153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.700248+0000","last_change":"2024-04-19T03:39:19.423254+0000","last_active":"2024-04-19T03:39:20.700248+0000","last_peered":"2024-04-19T03:39:20.700248+0000","last_clean":"2024-04-19T03:39:20.700248+0000","last_became_active":"2024-04-19T03:39:19.420608+0000","last_became_peered":"2024-04-19T03:39:19.420608+0000","last_unstale":"2024-04-19T03:39:20.700248+0000","last_undegraded":"2024-04-19T03:39:20.700248+0000","last_fullsized":"2024-04-19T03:39:20.700248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:51:19.679913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425324+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:22.425324+0000","last_peered":"2024-04-19T03:39:22.425324+0000","last_clean":"2024-04-19T03:39:22.425324+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:22.425324+0000","last_undegraded":"2024-04-19T03:39:22.425324+0000","last_fullsized":"2024-04-19T03:39:22.425324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422030+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:22.422030+0000","last_peered":"2024-04-19T03:39:22.422030+0000","last_clean":"2024-04-19T03:39:22.422030+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:22.422030+0000","last_undegraded":"2024-04-19T03:39:22.422030+0000","last_fullsized":"2024-04-19T03:39:22.422030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421492+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:22.421492+0000","last_peered":"2024-04-19T03:39:22.421492+0000","last_clean":"2024-04-19T03:39:22.421492+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:22.421492+0000","last_undegraded":"2024-04-19T03:39:22.421492+0000","last_fullsized":"2024-04-19T03:39:22.421492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.807853+0000","last_change":"2024-04-19T03:39:19.419541+0000","last_active":"2024-04-19T03:39:20.807853+0000","last_peered":"2024-04-19T03:39:20.807853+0000","last_clean":"2024-04-19T03:39:20.807853+0000","last_became_active":"2024-04-19T03:39:19.419126+0000","last_became_peered":"2024-04-19T03:39:19.419126+0000","last_unstale":"2024-04-19T03:39:20.807853+0000","last_undegraded":"2024-04-19T03:39:20.807853+0000","last_fullsized":"2024-04-19T03:39:20.807853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:32.179086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2049,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.416591+0000","last_change":"2024-04-19T03:39:21.416591+0000","last_active":"2024-04-19T03:39:19.397578+0000","last_peered":"2024-04-19T03:39:17.390075+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.372053+0000","last_became_peered":"2024-04-19T03:36:29.372053+0000","last_unstale":"2024-04-19T03:39:21.416591+0000","last_undegraded":"2024-04-19T03:39:21.416591+0000","last_fullsized":"2024-04-19T03:39:21.416591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:15.396828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.832336+0000","last_change":"2024-04-19T03:39:19.420641+0000","last_active":"2024-04-19T03:39:20.832336+0000","last_peered":"2024-04-19T03:39:20.832336+0000","last_clean":"2024-04-19T03:39:20.832336+0000","last_became_active":"2024-04-19T03:39:19.420142+0000","last_became_peered":"2024-04-19T03:39:19.420142+0000","last_unstale":"2024-04-19T03:39:20.832336+0000","last_undegraded":"2024-04-19T03:39:20.832336+0000","last_fullsized":"2024-04-19T03:39:20.832336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:07.098008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417556+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:22.417556+0000","last_peered":"2024-04-19T03:39:22.417556+0000","last_clean":"2024-04-19T03:39:22.417556+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:22.417556+0000","last_undegraded":"2024-04-19T03:39:22.417556+0000","last_fullsized":"2024-04-19T03:39:22.417556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417935+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:22.417935+0000","last_peered":"2024-04-19T03:39:22.417935+0000","last_clean":"2024-04-19T03:39:22.417935+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:22.417935+0000","last_undegraded":"2024-04-19T03:39:22.417935+0000","last_fullsized":"2024-04-19T03:39:22.417935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2076,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414647+0000","last_change":"2024-04-19T03:39:21.414647+0000","last_active":"2024-04-19T03:39:19.401036+0000","last_peered":"2024-04-19T03:39:17.390868+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.374335+0000","last_became_peered":"2024-04-19T03:36:29.374335+0000","last_unstale":"2024-04-19T03:39:21.414647+0000","last_undegraded":"2024-04-19T03:39:21.414647+0000","last_fullsized":"2024-04-19T03:39:21.414647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:01:56.554589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.793546+0000","last_change":"2024-04-19T03:39:19.420700+0000","last_active":"2024-04-19T03:39:20.793546+0000","last_peered":"2024-04-19T03:39:20.793546+0000","last_clean":"2024-04-19T03:39:20.793546+0000","last_became_active":"2024-04-19T03:39:19.419391+0000","last_became_peered":"2024-04-19T03:39:19.419391+0000","last_unstale":"2024-04-19T03:39:20.793546+0000","last_undegraded":"2024-04-19T03:39:20.793546+0000","last_fullsized":"2024-04-19T03:39:20.793546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:04.519906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2103,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414644+0000","last_change":"2024-04-19T03:39:21.414644+0000","last_active":"2024-04-19T03:39:19.404845+0000","last_peered":"2024-04-19T03:39:17.391343+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.389704+0000","last_became_peered":"2024-04-19T03:36:29.389704+0000","last_unstale":"2024-04-19T03:39:21.414644+0000","last_undegraded":"2024-04-19T03:39:21.414644+0000","last_fullsized":"2024-04-19T03:39:21.414644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:09.496570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421084+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:22.421084+0000","last_peered":"2024-04-19T03:39:22.421084+0000","last_clean":"2024-04-19T03:39:22.421084+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:22.421084+0000","last_undegraded":"2024-04-19T03:39:22.421084+0000","last_fullsized":"2024-04-19T03:39:22.421084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2113,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417458+0000","last_change":"2024-04-19T03:39:21.417458+0000","last_active":"2024-04-19T03:39:19.402862+0000","last_peered":"2024-04-19T03:39:17.391142+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.390577+0000","last_became_peered":"2024-04-19T03:36:29.390577+0000","last_unstale":"2024-04-19T03:39:21.417458+0000","last_undegraded":"2024-04-19T03:39:21.417458+0000","last_fullsized":"2024-04-19T03:39:21.417458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:41.874078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421213+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:22.421213+0000","last_peered":"2024-04-19T03:39:22.421213+0000","last_clean":"2024-04-19T03:39:22.421213+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:22.421213+0000","last_undegraded":"2024-04-19T03:39:22.421213+0000","last_fullsized":"2024-04-19T03:39:22.421213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418126+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:22.418126+0000","last_peered":"2024-04-19T03:39:22.418126+0000","last_clean":"2024-04-19T03:39:22.418126+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:22.418126+0000","last_undegraded":"2024-04-19T03:39:22.418126+0000","last_fullsized":"2024-04-19T03:39:22.418126+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417925+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:22.417925+0000","last_peered":"2024-04-19T03:39:22.417925+0000","last_clean":"2024-04-19T03:39:22.417925+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:22.417925+0000","last_undegraded":"2024-04-19T03:39:22.417925+0000","last_fullsized":"2024-04-19T03:39:22.417925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422048+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:22.422048+0000","last_peered":"2024-04-19T03:39:22.422048+0000","last_clean":"2024-04-19T03:39:22.422048+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:22.422048+0000","last_undegraded":"2024-04-19T03:39:22.422048+0000","last_fullsized":"2024-04-19T03:39:22.422048+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418187+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:22.418187+0000","last_peered":"2024-04-19T03:39:22.418187+0000","last_clean":"2024-04-19T03:39:22.418187+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:22.418187+0000","last_undegraded":"2024-04-19T03:39:22.418187+0000","last_fullsized":"2024-04-19T03:39:22.418187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421727+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:22.421727+0000","last_peered":"2024-04-19T03:39:22.421727+0000","last_clean":"2024-04-19T03:39:22.421727+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:22.421727+0000","last_undegraded":"2024-04-19T03:39:22.421727+0000","last_fullsized":"2024-04-19T03:39:22.421727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417785+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:22.417785+0000","last_peered":"2024-04-19T03:39:22.417785+0000","last_clean":"2024-04-19T03:39:22.417785+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:22.417785+0000","last_undegraded":"2024-04-19T03:39:22.417785+0000","last_fullsized":"2024-04-19T03:39:22.417785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421360+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:22.421360+0000","last_peered":"2024-04-19T03:39:22.421360+0000","last_clean":"2024-04-19T03:39:22.421360+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:22.421360+0000","last_undegraded":"2024-04-19T03:39:22.421360+0000","last_fullsized":"2024-04-19T03:39:22.421360+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417413+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:22.417413+0000","last_peered":"2024-04-19T03:39:22.417413+0000","last_clean":"2024-04-19T03:39:22.417413+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:22.417413+0000","last_undegraded":"2024-04-19T03:39:22.417413+0000","last_fullsized":"2024-04-19T03:39:22.417413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776717+0000","last_change":"2024-04-19T03:39:19.426047+0000","last_active":"2024-04-19T03:39:20.776717+0000","last_peered":"2024-04-19T03:39:20.776717+0000","last_clean":"2024-04-19T03:39:20.776717+0000","last_became_active":"2024-04-19T03:39:19.425609+0000","last_became_peered":"2024-04-19T03:39:19.425609+0000","last_unstale":"2024-04-19T03:39:20.776717+0000","last_undegraded":"2024-04-19T03:39:20.776717+0000","last_fullsized":"2024-04-19T03:39:20.776717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:20.346656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417921+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:22.417921+0000","last_peered":"2024-04-19T03:39:22.417921+0000","last_clean":"2024-04-19T03:39:22.417921+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:22.417921+0000","last_undegraded":"2024-04-19T03:39:22.417921+0000","last_fullsized":"2024-04-19T03:39:22.417921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8078,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422546+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:22.422546+0000","last_peered":"2024-04-19T03:39:22.422546+0000","last_clean":"2024-04-19T03:39:22.422546+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:22.422546+0000","last_undegraded":"2024-04-19T03:39:22.422546+0000","last_fullsized":"2024-04-19T03:39:22.422546+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.792909+0000","last_change":"2024-04-19T03:39:19.420389+0000","last_active":"2024-04-19T03:39:20.792909+0000","last_peered":"2024-04-19T03:39:20.792909+0000","last_clean":"2024-04-19T03:39:20.792909+0000","last_became_active":"2024-04-19T03:39:19.418907+0000","last_became_peered":"2024-04-19T03:39:19.418907+0000","last_unstale":"2024-04-19T03:39:20.792909+0000","last_undegraded":"2024-04-19T03:39:20.792909+0000","last_fullsized":"2024-04-19T03:39:20.792909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:10.315321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421297+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:22.421297+0000","last_peered":"2024-04-19T03:39:22.421297+0000","last_clean":"2024-04-19T03:39:22.421297+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:22.421297+0000","last_undegraded":"2024-04-19T03:39:22.421297+0000","last_fullsized":"2024-04-19T03:39:22.421297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418649+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:22.418649+0000","last_peered":"2024-04-19T03:39:22.418649+0000","last_clean":"2024-04-19T03:39:22.418649+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:22.418649+0000","last_undegraded":"2024-04-19T03:39:22.418649+0000","last_fullsized":"2024-04-19T03:39:22.418649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776343+0000","last_change":"2024-04-19T03:39:19.424877+0000","last_active":"2024-04-19T03:39:20.776343+0000","last_peered":"2024-04-19T03:39:20.776343+0000","last_clean":"2024-04-19T03:39:20.776343+0000","last_became_active":"2024-04-19T03:39:19.424216+0000","last_became_peered":"2024-04-19T03:39:19.424216+0000","last_unstale":"2024-04-19T03:39:20.776343+0000","last_undegraded":"2024-04-19T03:39:20.776343+0000","last_fullsized":"2024-04-19T03:39:20.776343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:16:03.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417905+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:22.417905+0000","last_peered":"2024-04-19T03:39:22.417905+0000","last_clean":"2024-04-19T03:39:22.417905+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:22.417905+0000","last_undegraded":"2024-04-19T03:39:22.417905+0000","last_fullsized":"2024-04-19T03:39:22.417905+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.808019+0000","last_change":"2024-04-19T03:39:19.420362+0000","last_active":"2024-04-19T03:39:20.808019+0000","last_peered":"2024-04-19T03:39:20.808019+0000","last_clean":"2024-04-19T03:39:20.808019+0000","last_became_active":"2024-04-19T03:39:19.419278+0000","last_became_peered":"2024-04-19T03:39:19.419278+0000","last_unstale":"2024-04-19T03:39:20.808019+0000","last_undegraded":"2024-04-19T03:39:20.808019+0000","last_fullsized":"2024-04-19T03:39:20.808019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:02.103259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421363+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:22.421363+0000","last_peered":"2024-04-19T03:39:22.421363+0000","last_clean":"2024-04-19T03:39:22.421363+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:22.421363+0000","last_undegraded":"2024-04-19T03:39:22.421363+0000","last_fullsized":"2024-04-19T03:39:22.421363+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.812540+0000","last_change":"2024-04-19T03:39:19.426867+0000","last_active":"2024-04-19T03:39:20.812540+0000","last_peered":"2024-04-19T03:39:20.812540+0000","last_clean":"2024-04-19T03:39:20.812540+0000","last_became_active":"2024-04-19T03:39:19.425825+0000","last_became_peered":"2024-04-19T03:39:19.425825+0000","last_unstale":"2024-04-19T03:39:20.812540+0000","last_undegraded":"2024-04-19T03:39:20.812540+0000","last_fullsized":"2024-04-19T03:39:20.812540+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:33.744870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418681+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:22.418681+0000","last_peered":"2024-04-19T03:39:22.418681+0000","last_clean":"2024-04-19T03:39:22.418681+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:22.418681+0000","last_undegraded":"2024-04-19T03:39:22.418681+0000","last_fullsized":"2024-04-19T03:39:22.418681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422170+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:22.422170+0000","last_peered":"2024-04-19T03:39:22.422170+0000","last_clean":"2024-04-19T03:39:22.422170+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:22.422170+0000","last_undegraded":"2024-04-19T03:39:22.422170+0000","last_fullsized":"2024-04-19T03:39:22.422170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418675+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:22.418675+0000","last_peered":"2024-04-19T03:39:22.418675+0000","last_clean":"2024-04-19T03:39:22.418675+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:22.418675+0000","last_undegraded":"2024-04-19T03:39:22.418675+0000","last_fullsized":"2024-04-19T03:39:22.418675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2055,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425829+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:22.425829+0000","last_peered":"2024-04-19T03:39:22.425829+0000","last_clean":"2024-04-19T03:39:22.425829+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:22.425829+0000","last_undegraded":"2024-04-19T03:39:22.425829+0000","last_fullsized":"2024-04-19T03:39:22.425829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.699995+0000","last_change":"2024-04-19T03:39:19.418696+0000","last_active":"2024-04-19T03:39:20.699995+0000","last_peered":"2024-04-19T03:39:20.699995+0000","last_clean":"2024-04-19T03:39:20.699995+0000","last_became_active":"2024-04-19T03:39:19.416023+0000","last_became_peered":"2024-04-19T03:39:19.416023+0000","last_unstale":"2024-04-19T03:39:20.699995+0000","last_undegraded":"2024-04-19T03:39:20.699995+0000","last_fullsized":"2024-04-19T03:39:20.699995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:03:24.163580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.809450+0000","last_change":"2024-04-19T03:39:19.423441+0000","last_active":"2024-04-19T03:39:20.809450+0000","last_peered":"2024-04-19T03:39:20.809450+0000","last_clean":"2024-04-19T03:39:20.809450+0000","last_became_active":"2024-04-19T03:39:19.421557+0000","last_became_peered":"2024-04-19T03:39:19.421557+0000","last_unstale":"2024-04-19T03:39:20.809450+0000","last_undegraded":"2024-04-19T03:39:20.809450+0000","last_fullsized":"2024-04-19T03:39:20.809450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:52.644757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421219+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:22.421219+0000","last_peered":"2024-04-19T03:39:22.421219+0000","last_clean":"2024-04-19T03:39:22.421219+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:22.421219+0000","last_undegraded":"2024-04-19T03:39:22.421219+0000","last_fullsized":"2024-04-19T03:39:22.421219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421724+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:22.421724+0000","last_peered":"2024-04-19T03:39:22.421724+0000","last_clean":"2024-04-19T03:39:22.421724+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:22.421724+0000","last_undegraded":"2024-04-19T03:39:22.421724+0000","last_fullsized":"2024-04-19T03:39:22.421724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421874+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:22.421874+0000","last_peered":"2024-04-19T03:39:22.421874+0000","last_clean":"2024-04-19T03:39:22.421874+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:22.421874+0000","last_undegraded":"2024-04-19T03:39:22.421874+0000","last_fullsized":"2024-04-19T03:39:22.421874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.832327+0000","last_change":"2024-04-19T03:39:19.423441+0000","last_active":"2024-04-19T03:39:20.832327+0000","last_peered":"2024-04-19T03:39:20.832327+0000","last_clean":"2024-04-19T03:39:20.832327+0000","last_became_active":"2024-04-19T03:39:19.422038+0000","last_became_peered":"2024-04-19T03:39:19.422038+0000","last_unstale":"2024-04-19T03:39:20.832327+0000","last_undegraded":"2024-04-19T03:39:20.832327+0000","last_fullsized":"2024-04-19T03:39:20.832327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:54.159938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2068,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.413561+0000","last_change":"2024-04-19T03:39:21.413561+0000","last_active":"2024-04-19T03:39:19.399820+0000","last_peered":"2024-04-19T03:39:17.390596+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.373442+0000","last_became_peered":"2024-04-19T03:36:29.373442+0000","last_unstale":"2024-04-19T03:39:21.413561+0000","last_undegraded":"2024-04-19T03:39:21.413561+0000","last_fullsized":"2024-04-19T03:39:21.413561+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:00.224961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422213+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:22.422213+0000","last_peered":"2024-04-19T03:39:22.422213+0000","last_clean":"2024-04-19T03:39:22.422213+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:22.422213+0000","last_undegraded":"2024-04-19T03:39:22.422213+0000","last_fullsized":"2024-04-19T03:39:22.422213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.792829+0000","last_change":"2024-04-19T03:39:19.422170+0000","last_active":"2024-04-19T03:39:20.792829+0000","last_peered":"2024-04-19T03:39:20.792829+0000","last_clean":"2024-04-19T03:39:20.792829+0000","last_became_active":"2024-04-19T03:39:19.421532+0000","last_became_peered":"2024-04-19T03:39:19.421532+0000","last_unstale":"2024-04-19T03:39:20.792829+0000","last_undegraded":"2024-04-19T03:39:20.792829+0000","last_fullsized":"2024-04-19T03:39:20.792829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:44.716256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417889+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:22.417889+0000","last_peered":"2024-04-19T03:39:22.417889+0000","last_clean":"2024-04-19T03:39:22.417889+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:22.417889+0000","last_undegraded":"2024-04-19T03:39:22.417889+0000","last_fullsized":"2024-04-19T03:39:22.417889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421507+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:22.421507+0000","last_peered":"2024-04-19T03:39:22.421507+0000","last_clean":"2024-04-19T03:39:22.421507+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:22.421507+0000","last_undegraded":"2024-04-19T03:39:22.421507+0000","last_fullsized":"2024-04-19T03:39:22.421507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418537+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:22.418537+0000","last_peered":"2024-04-19T03:39:22.418537+0000","last_clean":"2024-04-19T03:39:22.418537+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:22.418537+0000","last_undegraded":"2024-04-19T03:39:22.418537+0000","last_fullsized":"2024-04-19T03:39:22.418537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2117,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414810+0000","last_change":"2024-04-19T03:39:21.414810+0000","last_active":"2024-04-19T03:39:19.400814+0000","last_peered":"2024-04-19T03:39:17.390411+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.373880+0000","last_became_peered":"2024-04-19T03:36:29.373880+0000","last_unstale":"2024-04-19T03:39:21.414810+0000","last_undegraded":"2024-04-19T03:39:21.414810+0000","last_fullsized":"2024-04-19T03:39:21.414810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:01.028017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776527+0000","last_change":"2024-04-19T03:39:19.423562+0000","last_active":"2024-04-19T03:39:20.776527+0000","last_peered":"2024-04-19T03:39:20.776527+0000","last_clean":"2024-04-19T03:39:20.776527+0000","last_became_active":"2024-04-19T03:39:19.421810+0000","last_became_peered":"2024-04-19T03:39:19.421810+0000","last_unstale":"2024-04-19T03:39:20.776527+0000","last_undegraded":"2024-04-19T03:39:20.776527+0000","last_fullsized":"2024-04-19T03:39:20.776527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:34:19.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418045+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:22.418045+0000","last_peered":"2024-04-19T03:39:22.418045+0000","last_clean":"2024-04-19T03:39:22.418045+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:22.418045+0000","last_undegraded":"2024-04-19T03:39:22.418045+0000","last_fullsized":"2024-04-19T03:39:22.418045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2077,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425727+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:22.425727+0000","last_peered":"2024-04-19T03:39:22.425727+0000","last_clean":"2024-04-19T03:39:22.425727+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:22.425727+0000","last_undegraded":"2024-04-19T03:39:22.425727+0000","last_fullsized":"2024-04-19T03:39:22.425727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2093,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418045+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:22.418045+0000","last_peered":"2024-04-19T03:39:22.418045+0000","last_clean":"2024-04-19T03:39:22.418045+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:22.418045+0000","last_undegraded":"2024-04-19T03:39:22.418045+0000","last_fullsized":"2024-04-19T03:39:22.418045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.426357+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:22.426357+0000","last_peered":"2024-04-19T03:39:22.426357+0000","last_clean":"2024-04-19T03:39:22.426357+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:22.426357+0000","last_undegraded":"2024-04-19T03:39:22.426357+0000","last_fullsized":"2024-04-19T03:39:22.426357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481794,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47132,"kb_used_data":1548,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324708,"statfs":{"total":96636764160,"available":96588500992,"internally_reserved":0,"allocated":1585152,"data_stored":1203350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369752,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002088,"statfs":{"total":96636764160,"available":96258138112,"internally_reserved":0,"allocated":1581056,"data_stored":1206376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738412,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378736,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993104,"statfs":{"total":96636764160,"available":96248938496,"internally_reserved":0,"allocated":692224,"data_stored":331588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.432},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:26.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T03:39:26.768 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:26.768 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":222,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":84,"num_osds":3,"num_up_osds":3,"osd_up_since":1713497958,"num_in_osds":3,"osd_in_since":1713497745,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":90},{"state_name":"peering","count":15}],"num_pgs":105,"num_pools":4,"num_objects":25,"data_bytes":877232,"bytes_used":814714880,"bytes_avail":289095577600,"bytes_total":289910292480,"inactive_pgs_ratio":0.1428571492433548,"recovering_objects_per_sec":3,"recovering_bytes_per_sec":70329,"recovering_keys_per_sec":0,"num_objects_recovered":14,"num_bytes_recovered":281408,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4186}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-19T03:37:06.283521+0000","services":{}},"progress_events":{}} 2024-04-19T03:39:26.784 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-19T03:39:26.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:27.156 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:27.170 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-04-19T03:39:26.331307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795620,"kb_used_data":3768,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319900,"statfs":{"total":289910292480,"available":289095577600,"internally_reserved":0,"allocated":3858432,"data_stored":2741314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001277"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2056,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422626+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:22.422626+0000","last_peered":"2024-04-19T03:39:22.422626+0000","last_clean":"2024-04-19T03:39:22.422626+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:22.422626+0000","last_undegraded":"2024-04-19T03:39:22.422626+0000","last_fullsized":"2024-04-19T03:39:22.422626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422058+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:22.422058+0000","last_peered":"2024-04-19T03:39:22.422058+0000","last_clean":"2024-04-19T03:39:22.422058+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:22.422058+0000","last_undegraded":"2024-04-19T03:39:22.422058+0000","last_fullsized":"2024-04-19T03:39:22.422058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4061,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417980+0000","last_change":"2024-04-19T03:39:21.417980+0000","last_active":"2024-04-19T03:39:19.401011+0000","last_peered":"2024-04-19T03:39:17.390890+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.390099+0000","last_became_peered":"2024-04-19T03:36:29.390099+0000","last_unstale":"2024-04-19T03:39:21.417980+0000","last_undegraded":"2024-04-19T03:39:21.417980+0000","last_fullsized":"2024-04-19T03:39:21.417980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:07:42.792413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.792917+0000","last_change":"2024-04-19T03:39:19.419024+0000","last_active":"2024-04-19T03:39:20.792917+0000","last_peered":"2024-04-19T03:39:20.792917+0000","last_clean":"2024-04-19T03:39:20.792917+0000","last_became_active":"2024-04-19T03:39:19.417807+0000","last_became_peered":"2024-04-19T03:39:19.417807+0000","last_unstale":"2024-04-19T03:39:20.792917+0000","last_undegraded":"2024-04-19T03:39:20.792917+0000","last_fullsized":"2024-04-19T03:39:20.792917+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:48.505600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2128,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421783+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:22.421783+0000","last_peered":"2024-04-19T03:39:22.421783+0000","last_clean":"2024-04-19T03:39:22.421783+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:22.421783+0000","last_undegraded":"2024-04-19T03:39:22.421783+0000","last_fullsized":"2024-04-19T03:39:22.421783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.793497+0000","last_change":"2024-04-19T03:39:19.421767+0000","last_active":"2024-04-19T03:39:20.793497+0000","last_peered":"2024-04-19T03:39:20.793497+0000","last_clean":"2024-04-19T03:39:20.793497+0000","last_became_active":"2024-04-19T03:39:19.419382+0000","last_became_peered":"2024-04-19T03:39:19.419382+0000","last_unstale":"2024-04-19T03:39:20.793497+0000","last_undegraded":"2024-04-19T03:39:20.793497+0000","last_fullsized":"2024-04-19T03:39:20.793497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:24.971099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.762843+0000","last_change":"2024-04-19T03:39:19.421794+0000","last_active":"2024-04-19T03:39:20.762843+0000","last_peered":"2024-04-19T03:39:20.762843+0000","last_clean":"2024-04-19T03:39:20.762843+0000","last_became_active":"2024-04-19T03:39:19.420332+0000","last_became_peered":"2024-04-19T03:39:19.420332+0000","last_unstale":"2024-04-19T03:39:20.762843+0000","last_undegraded":"2024-04-19T03:39:20.762843+0000","last_fullsized":"2024-04-19T03:39:20.762843+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:58.338163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8109,"reported_epoch":79,"state":"peering","last_fresh":"2024-04-19T03:39:20.848454+0000","last_change":"2024-04-19T03:39:21.413503+0000","last_active":"2024-04-19T03:39:21.413503+0000","last_peered":"2024-04-19T03:39:20.848454+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:39:20.777376+0000","last_became_peered":"2024-04-19T03:39:20.777376+0000","last_unstale":"2024-04-19T03:39:20.848454+0000","last_undegraded":"2024-04-19T03:39:20.848454+0000","last_fullsized":"2024-04-19T03:39:20.397920+0000","mapping_epoch":80,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:18:32.130026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417737+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:22.417737+0000","last_peered":"2024-04-19T03:39:22.417737+0000","last_clean":"2024-04-19T03:39:22.417737+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:22.417737+0000","last_undegraded":"2024-04-19T03:39:22.417737+0000","last_fullsized":"2024-04-19T03:39:22.417737+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6163,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422441+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:22.422441+0000","last_peered":"2024-04-19T03:39:22.422441+0000","last_clean":"2024-04-19T03:39:22.422441+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:22.422441+0000","last_undegraded":"2024-04-19T03:39:22.422441+0000","last_fullsized":"2024-04-19T03:39:22.422441+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4007,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414383+0000","last_change":"2024-04-19T03:39:21.414383+0000","last_active":"2024-04-19T03:39:19.399755+0000","last_peered":"2024-04-19T03:39:17.390889+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.373192+0000","last_became_peered":"2024-04-19T03:36:29.373192+0000","last_unstale":"2024-04-19T03:39:21.414383+0000","last_undegraded":"2024-04-19T03:39:21.414383+0000","last_fullsized":"2024-04-19T03:39:21.414383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:49.295567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2168,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425823+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:22.425823+0000","last_peered":"2024-04-19T03:39:22.425823+0000","last_clean":"2024-04-19T03:39:22.425823+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:22.425823+0000","last_undegraded":"2024-04-19T03:39:22.425823+0000","last_fullsized":"2024-04-19T03:39:22.425823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2069,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421186+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:22.421186+0000","last_peered":"2024-04-19T03:39:22.421186+0000","last_clean":"2024-04-19T03:39:22.421186+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:22.421186+0000","last_undegraded":"2024-04-19T03:39:22.421186+0000","last_fullsized":"2024-04-19T03:39:22.421186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2140,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.419591+0000","last_change":"2024-04-19T03:39:21.419591+0000","last_active":"2024-04-19T03:39:19.401370+0000","last_peered":"2024-04-19T03:39:17.390391+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.383815+0000","last_became_peered":"2024-04-19T03:36:29.383815+0000","last_unstale":"2024-04-19T03:39:21.419591+0000","last_undegraded":"2024-04-19T03:39:21.419591+0000","last_fullsized":"2024-04-19T03:39:21.419591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:03:35.454941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2093,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417583+0000","last_change":"2024-04-19T03:39:21.417583+0000","last_active":"2024-04-19T03:39:19.400625+0000","last_peered":"2024-04-19T03:39:17.390203+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.389452+0000","last_became_peered":"2024-04-19T03:36:29.389452+0000","last_unstale":"2024-04-19T03:39:21.417583+0000","last_undegraded":"2024-04-19T03:39:21.417583+0000","last_fullsized":"2024-04-19T03:39:21.417583+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:25:08.519003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2070,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.413454+0000","last_change":"2024-04-19T03:39:21.413454+0000","last_active":"2024-04-19T03:39:19.398248+0000","last_peered":"2024-04-19T03:39:17.389980+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.372165+0000","last_became_peered":"2024-04-19T03:36:29.372165+0000","last_unstale":"2024-04-19T03:39:21.413454+0000","last_undegraded":"2024-04-19T03:39:21.413454+0000","last_fullsized":"2024-04-19T03:39:21.413454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:02.026046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2057,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418300+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:22.418300+0000","last_peered":"2024-04-19T03:39:22.418300+0000","last_clean":"2024-04-19T03:39:22.418300+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:22.418300+0000","last_undegraded":"2024-04-19T03:39:22.418300+0000","last_fullsized":"2024-04-19T03:39:22.418300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422216+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:22.422216+0000","last_peered":"2024-04-19T03:39:22.422216+0000","last_clean":"2024-04-19T03:39:22.422216+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:22.422216+0000","last_undegraded":"2024-04-19T03:39:22.422216+0000","last_fullsized":"2024-04-19T03:39:22.422216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417698+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:22.417698+0000","last_peered":"2024-04-19T03:39:22.417698+0000","last_clean":"2024-04-19T03:39:22.417698+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:22.417698+0000","last_undegraded":"2024-04-19T03:39:22.417698+0000","last_fullsized":"2024-04-19T03:39:22.417698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4154,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414259+0000","last_change":"2024-04-19T03:39:21.414259+0000","last_active":"2024-04-19T03:39:19.399351+0000","last_peered":"2024-04-19T03:39:17.390607+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.372161+0000","last_became_peered":"2024-04-19T03:36:29.372161+0000","last_unstale":"2024-04-19T03:39:21.414259+0000","last_undegraded":"2024-04-19T03:39:21.414259+0000","last_fullsized":"2024-04-19T03:39:21.414259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:09.474850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.695055+0000","last_change":"2024-04-19T03:39:19.425914+0000","last_active":"2024-04-19T03:39:20.695055+0000","last_peered":"2024-04-19T03:39:20.695055+0000","last_clean":"2024-04-19T03:39:20.695055+0000","last_became_active":"2024-04-19T03:39:19.425552+0000","last_became_peered":"2024-04-19T03:39:19.425552+0000","last_unstale":"2024-04-19T03:39:20.695055+0000","last_undegraded":"2024-04-19T03:39:20.695055+0000","last_fullsized":"2024-04-19T03:39:20.695055+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:41.252438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425847+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:22.425847+0000","last_peered":"2024-04-19T03:39:22.425847+0000","last_clean":"2024-04-19T03:39:22.425847+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:22.425847+0000","last_undegraded":"2024-04-19T03:39:22.425847+0000","last_fullsized":"2024-04-19T03:39:22.425847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.426153+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:22.426153+0000","last_peered":"2024-04-19T03:39:22.426153+0000","last_clean":"2024-04-19T03:39:22.426153+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:22.426153+0000","last_undegraded":"2024-04-19T03:39:22.426153+0000","last_fullsized":"2024-04-19T03:39:22.426153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4098,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421455+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:22.421455+0000","last_peered":"2024-04-19T03:39:22.421455+0000","last_clean":"2024-04-19T03:39:22.421455+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:22.421455+0000","last_undegraded":"2024-04-19T03:39:22.421455+0000","last_fullsized":"2024-04-19T03:39:22.421455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2084,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425871+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:22.425871+0000","last_peered":"2024-04-19T03:39:22.425871+0000","last_clean":"2024-04-19T03:39:22.425871+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:22.425871+0000","last_undegraded":"2024-04-19T03:39:22.425871+0000","last_fullsized":"2024-04-19T03:39:22.425871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418038+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:22.418038+0000","last_peered":"2024-04-19T03:39:22.418038+0000","last_clean":"2024-04-19T03:39:22.418038+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:22.418038+0000","last_undegraded":"2024-04-19T03:39:22.418038+0000","last_fullsized":"2024-04-19T03:39:22.418038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2096,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417852+0000","last_change":"2024-04-19T03:39:21.417852+0000","last_active":"2024-04-19T03:39:19.405093+0000","last_peered":"2024-04-19T03:39:17.391549+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.390763+0000","last_became_peered":"2024-04-19T03:36:29.390763+0000","last_unstale":"2024-04-19T03:39:21.417852+0000","last_undegraded":"2024-04-19T03:39:21.417852+0000","last_fullsized":"2024-04-19T03:39:21.417852+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:00:17.140503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421096+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:22.421096+0000","last_peered":"2024-04-19T03:39:22.421096+0000","last_clean":"2024-04-19T03:39:22.421096+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:22.421096+0000","last_undegraded":"2024-04-19T03:39:22.421096+0000","last_fullsized":"2024-04-19T03:39:22.421096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422060+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:22.422060+0000","last_peered":"2024-04-19T03:39:22.422060+0000","last_clean":"2024-04-19T03:39:22.422060+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:22.422060+0000","last_undegraded":"2024-04-19T03:39:22.422060+0000","last_fullsized":"2024-04-19T03:39:22.422060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418269+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:22.418269+0000","last_peered":"2024-04-19T03:39:22.418269+0000","last_clean":"2024-04-19T03:39:22.418269+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:22.418269+0000","last_undegraded":"2024-04-19T03:39:22.418269+0000","last_fullsized":"2024-04-19T03:39:22.418269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417821+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:22.417821+0000","last_peered":"2024-04-19T03:39:22.417821+0000","last_clean":"2024-04-19T03:39:22.417821+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:22.417821+0000","last_undegraded":"2024-04-19T03:39:22.417821+0000","last_fullsized":"2024-04-19T03:39:22.417821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418584+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:22.418584+0000","last_peered":"2024-04-19T03:39:22.418584+0000","last_clean":"2024-04-19T03:39:22.418584+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:22.418584+0000","last_undegraded":"2024-04-19T03:39:22.418584+0000","last_fullsized":"2024-04-19T03:39:22.418584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422451+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:22.422451+0000","last_peered":"2024-04-19T03:39:22.422451+0000","last_clean":"2024-04-19T03:39:22.422451+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:22.422451+0000","last_undegraded":"2024-04-19T03:39:22.422451+0000","last_fullsized":"2024-04-19T03:39:22.422451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418530+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:22.418530+0000","last_peered":"2024-04-19T03:39:22.418530+0000","last_clean":"2024-04-19T03:39:22.418530+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:22.418530+0000","last_undegraded":"2024-04-19T03:39:22.418530+0000","last_fullsized":"2024-04-19T03:39:22.418530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418345+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:22.418345+0000","last_peered":"2024-04-19T03:39:22.418345+0000","last_clean":"2024-04-19T03:39:22.418345+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:22.418345+0000","last_undegraded":"2024-04-19T03:39:22.418345+0000","last_fullsized":"2024-04-19T03:39:22.418345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.712770+0000","last_change":"2024-04-19T03:39:19.422942+0000","last_active":"2024-04-19T03:39:20.712770+0000","last_peered":"2024-04-19T03:39:20.712770+0000","last_clean":"2024-04-19T03:39:20.712770+0000","last_became_active":"2024-04-19T03:39:19.420043+0000","last_became_peered":"2024-04-19T03:39:19.420043+0000","last_unstale":"2024-04-19T03:39:20.712770+0000","last_undegraded":"2024-04-19T03:39:20.712770+0000","last_fullsized":"2024-04-19T03:39:20.712770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:43.957699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6057,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.429203+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:22.429203+0000","last_peered":"2024-04-19T03:39:22.429203+0000","last_clean":"2024-04-19T03:39:22.429203+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:22.429203+0000","last_undegraded":"2024-04-19T03:39:22.429203+0000","last_fullsized":"2024-04-19T03:39:22.429203+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421942+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:22.421942+0000","last_peered":"2024-04-19T03:39:22.421942+0000","last_clean":"2024-04-19T03:39:22.421942+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:22.421942+0000","last_undegraded":"2024-04-19T03:39:22.421942+0000","last_fullsized":"2024-04-19T03:39:22.421942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418193+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:22.418193+0000","last_peered":"2024-04-19T03:39:22.418193+0000","last_clean":"2024-04-19T03:39:22.418193+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:22.418193+0000","last_undegraded":"2024-04-19T03:39:22.418193+0000","last_fullsized":"2024-04-19T03:39:22.418193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.793033+0000","last_change":"2024-04-19T03:39:19.432065+0000","last_active":"2024-04-19T03:39:20.793033+0000","last_peered":"2024-04-19T03:39:20.793033+0000","last_clean":"2024-04-19T03:39:20.793033+0000","last_became_active":"2024-04-19T03:39:19.420230+0000","last_became_peered":"2024-04-19T03:39:19.420230+0000","last_unstale":"2024-04-19T03:39:20.793033+0000","last_undegraded":"2024-04-19T03:39:20.793033+0000","last_fullsized":"2024-04-19T03:39:20.793033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:39.830013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4151,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414548+0000","last_change":"2024-04-19T03:39:21.414548+0000","last_active":"2024-04-19T03:39:19.401355+0000","last_peered":"2024-04-19T03:39:17.390440+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.389480+0000","last_became_peered":"2024-04-19T03:36:29.389480+0000","last_unstale":"2024-04-19T03:39:21.414548+0000","last_undegraded":"2024-04-19T03:39:21.414548+0000","last_fullsized":"2024-04-19T03:39:21.414548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:11:25.576886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.695194+0000","last_change":"2024-04-19T03:39:19.424767+0000","last_active":"2024-04-19T03:39:20.695194+0000","last_peered":"2024-04-19T03:39:20.695194+0000","last_clean":"2024-04-19T03:39:20.695194+0000","last_became_active":"2024-04-19T03:39:19.424119+0000","last_became_peered":"2024-04-19T03:39:19.424119+0000","last_unstale":"2024-04-19T03:39:20.695194+0000","last_undegraded":"2024-04-19T03:39:20.695194+0000","last_fullsized":"2024-04-19T03:39:20.695194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:17.100453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2052,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421734+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:22.421734+0000","last_peered":"2024-04-19T03:39:22.421734+0000","last_clean":"2024-04-19T03:39:22.421734+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:22.421734+0000","last_undegraded":"2024-04-19T03:39:22.421734+0000","last_fullsized":"2024-04-19T03:39:22.421734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418215+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:22.418215+0000","last_peered":"2024-04-19T03:39:22.418215+0000","last_clean":"2024-04-19T03:39:22.418215+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:22.418215+0000","last_undegraded":"2024-04-19T03:39:22.418215+0000","last_fullsized":"2024-04-19T03:39:22.418215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422360+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:22.422360+0000","last_peered":"2024-04-19T03:39:22.422360+0000","last_clean":"2024-04-19T03:39:22.422360+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:22.422360+0000","last_undegraded":"2024-04-19T03:39:22.422360+0000","last_fullsized":"2024-04-19T03:39:22.422360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421225+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:22.421225+0000","last_peered":"2024-04-19T03:39:22.421225+0000","last_clean":"2024-04-19T03:39:22.421225+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:22.421225+0000","last_undegraded":"2024-04-19T03:39:22.421225+0000","last_fullsized":"2024-04-19T03:39:22.421225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417979+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:22.417979+0000","last_peered":"2024-04-19T03:39:22.417979+0000","last_clean":"2024-04-19T03:39:22.417979+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:22.417979+0000","last_undegraded":"2024-04-19T03:39:22.417979+0000","last_fullsized":"2024-04-19T03:39:22.417979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776626+0000","last_change":"2024-04-19T03:39:19.426025+0000","last_active":"2024-04-19T03:39:20.776626+0000","last_peered":"2024-04-19T03:39:20.776626+0000","last_clean":"2024-04-19T03:39:20.776626+0000","last_became_active":"2024-04-19T03:39:19.425633+0000","last_became_peered":"2024-04-19T03:39:19.425633+0000","last_unstale":"2024-04-19T03:39:20.776626+0000","last_undegraded":"2024-04-19T03:39:20.776626+0000","last_fullsized":"2024-04-19T03:39:20.776626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:54.826770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2196,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.426153+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:22.426153+0000","last_peered":"2024-04-19T03:39:22.426153+0000","last_clean":"2024-04-19T03:39:22.426153+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:22.426153+0000","last_undegraded":"2024-04-19T03:39:22.426153+0000","last_fullsized":"2024-04-19T03:39:22.426153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.700248+0000","last_change":"2024-04-19T03:39:19.423254+0000","last_active":"2024-04-19T03:39:20.700248+0000","last_peered":"2024-04-19T03:39:20.700248+0000","last_clean":"2024-04-19T03:39:20.700248+0000","last_became_active":"2024-04-19T03:39:19.420608+0000","last_became_peered":"2024-04-19T03:39:19.420608+0000","last_unstale":"2024-04-19T03:39:20.700248+0000","last_undegraded":"2024-04-19T03:39:20.700248+0000","last_fullsized":"2024-04-19T03:39:20.700248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:51:19.679913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425324+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:22.425324+0000","last_peered":"2024-04-19T03:39:22.425324+0000","last_clean":"2024-04-19T03:39:22.425324+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:22.425324+0000","last_undegraded":"2024-04-19T03:39:22.425324+0000","last_fullsized":"2024-04-19T03:39:22.425324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422030+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:22.422030+0000","last_peered":"2024-04-19T03:39:22.422030+0000","last_clean":"2024-04-19T03:39:22.422030+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:22.422030+0000","last_undegraded":"2024-04-19T03:39:22.422030+0000","last_fullsized":"2024-04-19T03:39:22.422030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421492+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:22.421492+0000","last_peered":"2024-04-19T03:39:22.421492+0000","last_clean":"2024-04-19T03:39:22.421492+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:22.421492+0000","last_undegraded":"2024-04-19T03:39:22.421492+0000","last_fullsized":"2024-04-19T03:39:22.421492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.807853+0000","last_change":"2024-04-19T03:39:19.419541+0000","last_active":"2024-04-19T03:39:20.807853+0000","last_peered":"2024-04-19T03:39:20.807853+0000","last_clean":"2024-04-19T03:39:20.807853+0000","last_became_active":"2024-04-19T03:39:19.419126+0000","last_became_peered":"2024-04-19T03:39:19.419126+0000","last_unstale":"2024-04-19T03:39:20.807853+0000","last_undegraded":"2024-04-19T03:39:20.807853+0000","last_fullsized":"2024-04-19T03:39:20.807853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:32.179086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2049,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.416591+0000","last_change":"2024-04-19T03:39:21.416591+0000","last_active":"2024-04-19T03:39:19.397578+0000","last_peered":"2024-04-19T03:39:17.390075+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.372053+0000","last_became_peered":"2024-04-19T03:36:29.372053+0000","last_unstale":"2024-04-19T03:39:21.416591+0000","last_undegraded":"2024-04-19T03:39:21.416591+0000","last_fullsized":"2024-04-19T03:39:21.416591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:15.396828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.832336+0000","last_change":"2024-04-19T03:39:19.420641+0000","last_active":"2024-04-19T03:39:20.832336+0000","last_peered":"2024-04-19T03:39:20.832336+0000","last_clean":"2024-04-19T03:39:20.832336+0000","last_became_active":"2024-04-19T03:39:19.420142+0000","last_became_peered":"2024-04-19T03:39:19.420142+0000","last_unstale":"2024-04-19T03:39:20.832336+0000","last_undegraded":"2024-04-19T03:39:20.832336+0000","last_fullsized":"2024-04-19T03:39:20.832336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:07.098008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417556+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:22.417556+0000","last_peered":"2024-04-19T03:39:22.417556+0000","last_clean":"2024-04-19T03:39:22.417556+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:22.417556+0000","last_undegraded":"2024-04-19T03:39:22.417556+0000","last_fullsized":"2024-04-19T03:39:22.417556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417935+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:22.417935+0000","last_peered":"2024-04-19T03:39:22.417935+0000","last_clean":"2024-04-19T03:39:22.417935+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:22.417935+0000","last_undegraded":"2024-04-19T03:39:22.417935+0000","last_fullsized":"2024-04-19T03:39:22.417935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2076,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414647+0000","last_change":"2024-04-19T03:39:21.414647+0000","last_active":"2024-04-19T03:39:19.401036+0000","last_peered":"2024-04-19T03:39:17.390868+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.374335+0000","last_became_peered":"2024-04-19T03:36:29.374335+0000","last_unstale":"2024-04-19T03:39:21.414647+0000","last_undegraded":"2024-04-19T03:39:21.414647+0000","last_fullsized":"2024-04-19T03:39:21.414647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:01:56.554589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.793546+0000","last_change":"2024-04-19T03:39:19.420700+0000","last_active":"2024-04-19T03:39:20.793546+0000","last_peered":"2024-04-19T03:39:20.793546+0000","last_clean":"2024-04-19T03:39:20.793546+0000","last_became_active":"2024-04-19T03:39:19.419391+0000","last_became_peered":"2024-04-19T03:39:19.419391+0000","last_unstale":"2024-04-19T03:39:20.793546+0000","last_undegraded":"2024-04-19T03:39:20.793546+0000","last_fullsized":"2024-04-19T03:39:20.793546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:04.519906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2103,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414644+0000","last_change":"2024-04-19T03:39:21.414644+0000","last_active":"2024-04-19T03:39:19.404845+0000","last_peered":"2024-04-19T03:39:17.391343+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.389704+0000","last_became_peered":"2024-04-19T03:36:29.389704+0000","last_unstale":"2024-04-19T03:39:21.414644+0000","last_undegraded":"2024-04-19T03:39:21.414644+0000","last_fullsized":"2024-04-19T03:39:21.414644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:09.496570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421084+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:22.421084+0000","last_peered":"2024-04-19T03:39:22.421084+0000","last_clean":"2024-04-19T03:39:22.421084+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:22.421084+0000","last_undegraded":"2024-04-19T03:39:22.421084+0000","last_fullsized":"2024-04-19T03:39:22.421084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2113,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.417458+0000","last_change":"2024-04-19T03:39:21.417458+0000","last_active":"2024-04-19T03:39:19.402862+0000","last_peered":"2024-04-19T03:39:17.391142+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.390577+0000","last_became_peered":"2024-04-19T03:36:29.390577+0000","last_unstale":"2024-04-19T03:39:21.417458+0000","last_undegraded":"2024-04-19T03:39:21.417458+0000","last_fullsized":"2024-04-19T03:39:21.417458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:41.874078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421213+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:22.421213+0000","last_peered":"2024-04-19T03:39:22.421213+0000","last_clean":"2024-04-19T03:39:22.421213+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:22.421213+0000","last_undegraded":"2024-04-19T03:39:22.421213+0000","last_fullsized":"2024-04-19T03:39:22.421213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418126+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:22.418126+0000","last_peered":"2024-04-19T03:39:22.418126+0000","last_clean":"2024-04-19T03:39:22.418126+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:22.418126+0000","last_undegraded":"2024-04-19T03:39:22.418126+0000","last_fullsized":"2024-04-19T03:39:22.418126+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417925+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:22.417925+0000","last_peered":"2024-04-19T03:39:22.417925+0000","last_clean":"2024-04-19T03:39:22.417925+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:22.417925+0000","last_undegraded":"2024-04-19T03:39:22.417925+0000","last_fullsized":"2024-04-19T03:39:22.417925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422048+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:22.422048+0000","last_peered":"2024-04-19T03:39:22.422048+0000","last_clean":"2024-04-19T03:39:22.422048+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:22.422048+0000","last_undegraded":"2024-04-19T03:39:22.422048+0000","last_fullsized":"2024-04-19T03:39:22.422048+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418187+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:22.418187+0000","last_peered":"2024-04-19T03:39:22.418187+0000","last_clean":"2024-04-19T03:39:22.418187+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:22.418187+0000","last_undegraded":"2024-04-19T03:39:22.418187+0000","last_fullsized":"2024-04-19T03:39:22.418187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421727+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:22.421727+0000","last_peered":"2024-04-19T03:39:22.421727+0000","last_clean":"2024-04-19T03:39:22.421727+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:22.421727+0000","last_undegraded":"2024-04-19T03:39:22.421727+0000","last_fullsized":"2024-04-19T03:39:22.421727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":104,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417785+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:22.417785+0000","last_peered":"2024-04-19T03:39:22.417785+0000","last_clean":"2024-04-19T03:39:22.417785+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:22.417785+0000","last_undegraded":"2024-04-19T03:39:22.417785+0000","last_fullsized":"2024-04-19T03:39:22.417785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421360+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:22.421360+0000","last_peered":"2024-04-19T03:39:22.421360+0000","last_clean":"2024-04-19T03:39:22.421360+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:22.421360+0000","last_undegraded":"2024-04-19T03:39:22.421360+0000","last_fullsized":"2024-04-19T03:39:22.421360+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417413+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:22.417413+0000","last_peered":"2024-04-19T03:39:22.417413+0000","last_clean":"2024-04-19T03:39:22.417413+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:22.417413+0000","last_undegraded":"2024-04-19T03:39:22.417413+0000","last_fullsized":"2024-04-19T03:39:22.417413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776717+0000","last_change":"2024-04-19T03:39:19.426047+0000","last_active":"2024-04-19T03:39:20.776717+0000","last_peered":"2024-04-19T03:39:20.776717+0000","last_clean":"2024-04-19T03:39:20.776717+0000","last_became_active":"2024-04-19T03:39:19.425609+0000","last_became_peered":"2024-04-19T03:39:19.425609+0000","last_unstale":"2024-04-19T03:39:20.776717+0000","last_undegraded":"2024-04-19T03:39:20.776717+0000","last_fullsized":"2024-04-19T03:39:20.776717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:20.346656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417921+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:22.417921+0000","last_peered":"2024-04-19T03:39:22.417921+0000","last_clean":"2024-04-19T03:39:22.417921+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:22.417921+0000","last_undegraded":"2024-04-19T03:39:22.417921+0000","last_fullsized":"2024-04-19T03:39:22.417921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8078,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422546+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:22.422546+0000","last_peered":"2024-04-19T03:39:22.422546+0000","last_clean":"2024-04-19T03:39:22.422546+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:22.422546+0000","last_undegraded":"2024-04-19T03:39:22.422546+0000","last_fullsized":"2024-04-19T03:39:22.422546+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.792909+0000","last_change":"2024-04-19T03:39:19.420389+0000","last_active":"2024-04-19T03:39:20.792909+0000","last_peered":"2024-04-19T03:39:20.792909+0000","last_clean":"2024-04-19T03:39:20.792909+0000","last_became_active":"2024-04-19T03:39:19.418907+0000","last_became_peered":"2024-04-19T03:39:19.418907+0000","last_unstale":"2024-04-19T03:39:20.792909+0000","last_undegraded":"2024-04-19T03:39:20.792909+0000","last_fullsized":"2024-04-19T03:39:20.792909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:10.315321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421297+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:22.421297+0000","last_peered":"2024-04-19T03:39:22.421297+0000","last_clean":"2024-04-19T03:39:22.421297+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:22.421297+0000","last_undegraded":"2024-04-19T03:39:22.421297+0000","last_fullsized":"2024-04-19T03:39:22.421297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418649+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:22.418649+0000","last_peered":"2024-04-19T03:39:22.418649+0000","last_clean":"2024-04-19T03:39:22.418649+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:22.418649+0000","last_undegraded":"2024-04-19T03:39:22.418649+0000","last_fullsized":"2024-04-19T03:39:22.418649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776343+0000","last_change":"2024-04-19T03:39:19.424877+0000","last_active":"2024-04-19T03:39:20.776343+0000","last_peered":"2024-04-19T03:39:20.776343+0000","last_clean":"2024-04-19T03:39:20.776343+0000","last_became_active":"2024-04-19T03:39:19.424216+0000","last_became_peered":"2024-04-19T03:39:19.424216+0000","last_unstale":"2024-04-19T03:39:20.776343+0000","last_undegraded":"2024-04-19T03:39:20.776343+0000","last_fullsized":"2024-04-19T03:39:20.776343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:16:03.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417905+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:22.417905+0000","last_peered":"2024-04-19T03:39:22.417905+0000","last_clean":"2024-04-19T03:39:22.417905+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:22.417905+0000","last_undegraded":"2024-04-19T03:39:22.417905+0000","last_fullsized":"2024-04-19T03:39:22.417905+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.808019+0000","last_change":"2024-04-19T03:39:19.420362+0000","last_active":"2024-04-19T03:39:20.808019+0000","last_peered":"2024-04-19T03:39:20.808019+0000","last_clean":"2024-04-19T03:39:20.808019+0000","last_became_active":"2024-04-19T03:39:19.419278+0000","last_became_peered":"2024-04-19T03:39:19.419278+0000","last_unstale":"2024-04-19T03:39:20.808019+0000","last_undegraded":"2024-04-19T03:39:20.808019+0000","last_fullsized":"2024-04-19T03:39:20.808019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:02.103259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421363+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:22.421363+0000","last_peered":"2024-04-19T03:39:22.421363+0000","last_clean":"2024-04-19T03:39:22.421363+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:22.421363+0000","last_undegraded":"2024-04-19T03:39:22.421363+0000","last_fullsized":"2024-04-19T03:39:22.421363+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.812540+0000","last_change":"2024-04-19T03:39:19.426867+0000","last_active":"2024-04-19T03:39:20.812540+0000","last_peered":"2024-04-19T03:39:20.812540+0000","last_clean":"2024-04-19T03:39:20.812540+0000","last_became_active":"2024-04-19T03:39:19.425825+0000","last_became_peered":"2024-04-19T03:39:19.425825+0000","last_unstale":"2024-04-19T03:39:20.812540+0000","last_undegraded":"2024-04-19T03:39:20.812540+0000","last_fullsized":"2024-04-19T03:39:20.812540+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:33.744870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418681+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:22.418681+0000","last_peered":"2024-04-19T03:39:22.418681+0000","last_clean":"2024-04-19T03:39:22.418681+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:22.418681+0000","last_undegraded":"2024-04-19T03:39:22.418681+0000","last_fullsized":"2024-04-19T03:39:22.418681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422170+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:22.422170+0000","last_peered":"2024-04-19T03:39:22.422170+0000","last_clean":"2024-04-19T03:39:22.422170+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:22.422170+0000","last_undegraded":"2024-04-19T03:39:22.422170+0000","last_fullsized":"2024-04-19T03:39:22.422170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418675+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:22.418675+0000","last_peered":"2024-04-19T03:39:22.418675+0000","last_clean":"2024-04-19T03:39:22.418675+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:22.418675+0000","last_undegraded":"2024-04-19T03:39:22.418675+0000","last_fullsized":"2024-04-19T03:39:22.418675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2055,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425829+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:22.425829+0000","last_peered":"2024-04-19T03:39:22.425829+0000","last_clean":"2024-04-19T03:39:22.425829+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:22.425829+0000","last_undegraded":"2024-04-19T03:39:22.425829+0000","last_fullsized":"2024-04-19T03:39:22.425829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.699995+0000","last_change":"2024-04-19T03:39:19.418696+0000","last_active":"2024-04-19T03:39:20.699995+0000","last_peered":"2024-04-19T03:39:20.699995+0000","last_clean":"2024-04-19T03:39:20.699995+0000","last_became_active":"2024-04-19T03:39:19.416023+0000","last_became_peered":"2024-04-19T03:39:19.416023+0000","last_unstale":"2024-04-19T03:39:20.699995+0000","last_undegraded":"2024-04-19T03:39:20.699995+0000","last_fullsized":"2024-04-19T03:39:20.699995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:03:24.163580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.809450+0000","last_change":"2024-04-19T03:39:19.423441+0000","last_active":"2024-04-19T03:39:20.809450+0000","last_peered":"2024-04-19T03:39:20.809450+0000","last_clean":"2024-04-19T03:39:20.809450+0000","last_became_active":"2024-04-19T03:39:19.421557+0000","last_became_peered":"2024-04-19T03:39:19.421557+0000","last_unstale":"2024-04-19T03:39:20.809450+0000","last_undegraded":"2024-04-19T03:39:20.809450+0000","last_fullsized":"2024-04-19T03:39:20.809450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:52.644757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421219+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:22.421219+0000","last_peered":"2024-04-19T03:39:22.421219+0000","last_clean":"2024-04-19T03:39:22.421219+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:22.421219+0000","last_undegraded":"2024-04-19T03:39:22.421219+0000","last_fullsized":"2024-04-19T03:39:22.421219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421724+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:22.421724+0000","last_peered":"2024-04-19T03:39:22.421724+0000","last_clean":"2024-04-19T03:39:22.421724+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:22.421724+0000","last_undegraded":"2024-04-19T03:39:22.421724+0000","last_fullsized":"2024-04-19T03:39:22.421724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421874+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:22.421874+0000","last_peered":"2024-04-19T03:39:22.421874+0000","last_clean":"2024-04-19T03:39:22.421874+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:22.421874+0000","last_undegraded":"2024-04-19T03:39:22.421874+0000","last_fullsized":"2024-04-19T03:39:22.421874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.832327+0000","last_change":"2024-04-19T03:39:19.423441+0000","last_active":"2024-04-19T03:39:20.832327+0000","last_peered":"2024-04-19T03:39:20.832327+0000","last_clean":"2024-04-19T03:39:20.832327+0000","last_became_active":"2024-04-19T03:39:19.422038+0000","last_became_peered":"2024-04-19T03:39:19.422038+0000","last_unstale":"2024-04-19T03:39:20.832327+0000","last_undegraded":"2024-04-19T03:39:20.832327+0000","last_fullsized":"2024-04-19T03:39:20.832327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:54.159938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2068,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.413561+0000","last_change":"2024-04-19T03:39:21.413561+0000","last_active":"2024-04-19T03:39:19.399820+0000","last_peered":"2024-04-19T03:39:17.390596+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.373442+0000","last_became_peered":"2024-04-19T03:36:29.373442+0000","last_unstale":"2024-04-19T03:39:21.413561+0000","last_undegraded":"2024-04-19T03:39:21.413561+0000","last_fullsized":"2024-04-19T03:39:21.413561+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:00.224961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.422213+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:22.422213+0000","last_peered":"2024-04-19T03:39:22.422213+0000","last_clean":"2024-04-19T03:39:22.422213+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:22.422213+0000","last_undegraded":"2024-04-19T03:39:22.422213+0000","last_fullsized":"2024-04-19T03:39:22.422213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.792829+0000","last_change":"2024-04-19T03:39:19.422170+0000","last_active":"2024-04-19T03:39:20.792829+0000","last_peered":"2024-04-19T03:39:20.792829+0000","last_clean":"2024-04-19T03:39:20.792829+0000","last_became_active":"2024-04-19T03:39:19.421532+0000","last_became_peered":"2024-04-19T03:39:19.421532+0000","last_unstale":"2024-04-19T03:39:20.792829+0000","last_undegraded":"2024-04-19T03:39:20.792829+0000","last_fullsized":"2024-04-19T03:39:20.792829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:44.716256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.417889+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:22.417889+0000","last_peered":"2024-04-19T03:39:22.417889+0000","last_clean":"2024-04-19T03:39:22.417889+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:22.417889+0000","last_undegraded":"2024-04-19T03:39:22.417889+0000","last_fullsized":"2024-04-19T03:39:22.417889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.421507+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:22.421507+0000","last_peered":"2024-04-19T03:39:22.421507+0000","last_clean":"2024-04-19T03:39:22.421507+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:22.421507+0000","last_undegraded":"2024-04-19T03:39:22.421507+0000","last_fullsized":"2024-04-19T03:39:22.421507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418537+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:22.418537+0000","last_peered":"2024-04-19T03:39:22.418537+0000","last_clean":"2024-04-19T03:39:22.418537+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:22.418537+0000","last_undegraded":"2024-04-19T03:39:22.418537+0000","last_fullsized":"2024-04-19T03:39:22.418537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2117,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-19T03:39:21.414810+0000","last_change":"2024-04-19T03:39:21.414810+0000","last_active":"2024-04-19T03:39:19.400814+0000","last_peered":"2024-04-19T03:39:17.390411+0000","last_clean":"2024-04-19T03:35:59.415213+0000","last_became_active":"2024-04-19T03:36:29.373880+0000","last_became_peered":"2024-04-19T03:36:29.373880+0000","last_unstale":"2024-04-19T03:39:21.414810+0000","last_undegraded":"2024-04-19T03:39:21.414810+0000","last_fullsized":"2024-04-19T03:39:21.414810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:01.028017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-19T03:39:20.776527+0000","last_change":"2024-04-19T03:39:19.423562+0000","last_active":"2024-04-19T03:39:20.776527+0000","last_peered":"2024-04-19T03:39:20.776527+0000","last_clean":"2024-04-19T03:39:20.776527+0000","last_became_active":"2024-04-19T03:39:19.421810+0000","last_became_peered":"2024-04-19T03:39:19.421810+0000","last_unstale":"2024-04-19T03:39:20.776527+0000","last_undegraded":"2024-04-19T03:39:20.776527+0000","last_fullsized":"2024-04-19T03:39:20.776527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:34:19.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418045+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:22.418045+0000","last_peered":"2024-04-19T03:39:22.418045+0000","last_clean":"2024-04-19T03:39:22.418045+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:22.418045+0000","last_undegraded":"2024-04-19T03:39:22.418045+0000","last_fullsized":"2024-04-19T03:39:22.418045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2077,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.425727+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:22.425727+0000","last_peered":"2024-04-19T03:39:22.425727+0000","last_clean":"2024-04-19T03:39:22.425727+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:22.425727+0000","last_undegraded":"2024-04-19T03:39:22.425727+0000","last_fullsized":"2024-04-19T03:39:22.425727+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2093,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.418045+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:22.418045+0000","last_peered":"2024-04-19T03:39:22.418045+0000","last_clean":"2024-04-19T03:39:22.418045+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:22.418045+0000","last_undegraded":"2024-04-19T03:39:22.418045+0000","last_fullsized":"2024-04-19T03:39:22.418045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:39:22.426357+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:22.426357+0000","last_peered":"2024-04-19T03:39:22.426357+0000","last_clean":"2024-04-19T03:39:22.426357+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:22.426357+0000","last_undegraded":"2024-04-19T03:39:22.426357+0000","last_fullsized":"2024-04-19T03:39:22.426357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481794,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47132,"kb_used_data":1548,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324708,"statfs":{"total":96636764160,"available":96588500992,"internally_reserved":0,"allocated":1585152,"data_stored":1203350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369752,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002088,"statfs":{"total":96636764160,"available":96258138112,"internally_reserved":0,"allocated":1581056,"data_stored":1206376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738412,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378736,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993104,"statfs":{"total":96636764160,"available":96248938496,"internally_reserved":0,"allocated":692224,"data_stored":331588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.432},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:30.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:30.571 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-04-19T03:39:30.332333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795704,"kb_used_data":3848,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319816,"statfs":{"total":289910292480,"available":289095491584,"internally_reserved":0,"allocated":3940352,"data_stored":2783650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.917498"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2058,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422891+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:24.422891+0000","last_peered":"2024-04-19T03:39:24.422891+0000","last_clean":"2024-04-19T03:39:24.422891+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:24.422891+0000","last_undegraded":"2024-04-19T03:39:24.422891+0000","last_fullsized":"2024-04-19T03:39:24.422891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422310+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:24.422310+0000","last_peered":"2024-04-19T03:39:24.422310+0000","last_clean":"2024-04-19T03:39:24.422310+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:24.422310+0000","last_undegraded":"2024-04-19T03:39:24.422310+0000","last_fullsized":"2024-04-19T03:39:24.422310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4071,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422786+0000","last_change":"2024-04-19T03:39:22.427075+0000","last_active":"2024-04-19T03:39:24.422786+0000","last_peered":"2024-04-19T03:39:24.422786+0000","last_clean":"2024-04-19T03:39:24.422786+0000","last_became_active":"2024-04-19T03:39:22.425995+0000","last_became_peered":"2024-04-19T03:39:22.425995+0000","last_unstale":"2024-04-19T03:39:24.422786+0000","last_undegraded":"2024-04-19T03:39:24.422786+0000","last_fullsized":"2024-04-19T03:39:24.422786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:14:59.705330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422436+0000","last_change":"2024-04-19T03:39:19.419024+0000","last_active":"2024-04-19T03:39:24.422436+0000","last_peered":"2024-04-19T03:39:24.422436+0000","last_clean":"2024-04-19T03:39:24.422436+0000","last_became_active":"2024-04-19T03:39:19.417807+0000","last_became_peered":"2024-04-19T03:39:19.417807+0000","last_unstale":"2024-04-19T03:39:24.422436+0000","last_undegraded":"2024-04-19T03:39:24.422436+0000","last_fullsized":"2024-04-19T03:39:24.422436+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:48.505600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422264+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:24.422264+0000","last_peered":"2024-04-19T03:39:24.422264+0000","last_clean":"2024-04-19T03:39:24.422264+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:24.422264+0000","last_undegraded":"2024-04-19T03:39:24.422264+0000","last_fullsized":"2024-04-19T03:39:24.422264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422662+0000","last_change":"2024-04-19T03:39:19.421767+0000","last_active":"2024-04-19T03:39:24.422662+0000","last_peered":"2024-04-19T03:39:24.422662+0000","last_clean":"2024-04-19T03:39:24.422662+0000","last_became_active":"2024-04-19T03:39:19.419382+0000","last_became_peered":"2024-04-19T03:39:19.419382+0000","last_unstale":"2024-04-19T03:39:24.422662+0000","last_undegraded":"2024-04-19T03:39:24.422662+0000","last_fullsized":"2024-04-19T03:39:24.422662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:24.971099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422810+0000","last_change":"2024-04-19T03:39:19.421794+0000","last_active":"2024-04-19T03:39:24.422810+0000","last_peered":"2024-04-19T03:39:24.422810+0000","last_clean":"2024-04-19T03:39:24.422810+0000","last_became_active":"2024-04-19T03:39:19.420332+0000","last_became_peered":"2024-04-19T03:39:19.420332+0000","last_unstale":"2024-04-19T03:39:24.422810+0000","last_undegraded":"2024-04-19T03:39:24.422810+0000","last_fullsized":"2024-04-19T03:39:24.422810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:11:58.338163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8119,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421780+0000","last_change":"2024-04-19T03:39:22.421909+0000","last_active":"2024-04-19T03:39:24.421780+0000","last_peered":"2024-04-19T03:39:24.421780+0000","last_clean":"2024-04-19T03:39:24.421780+0000","last_became_active":"2024-04-19T03:39:22.420832+0000","last_became_peered":"2024-04-19T03:39:22.420832+0000","last_unstale":"2024-04-19T03:39:24.421780+0000","last_undegraded":"2024-04-19T03:39:24.421780+0000","last_fullsized":"2024-04-19T03:39:24.421780+0000","mapping_epoch":80,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:33:17.512933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6153,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392241+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:25.392241+0000","last_peered":"2024-04-19T03:39:25.392241+0000","last_clean":"2024-04-19T03:39:25.392241+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:25.392241+0000","last_undegraded":"2024-04-19T03:39:25.392241+0000","last_fullsized":"2024-04-19T03:39:25.392241+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422763+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:24.422763+0000","last_peered":"2024-04-19T03:39:24.422763+0000","last_clean":"2024-04-19T03:39:24.422763+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:24.422763+0000","last_undegraded":"2024-04-19T03:39:24.422763+0000","last_fullsized":"2024-04-19T03:39:24.422763+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4017,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423122+0000","last_change":"2024-04-19T03:39:22.424791+0000","last_active":"2024-04-19T03:39:24.423122+0000","last_peered":"2024-04-19T03:39:24.423122+0000","last_clean":"2024-04-19T03:39:24.423122+0000","last_became_active":"2024-04-19T03:39:22.423745+0000","last_became_peered":"2024-04-19T03:39:22.423745+0000","last_unstale":"2024-04-19T03:39:24.423122+0000","last_undegraded":"2024-04-19T03:39:24.423122+0000","last_fullsized":"2024-04-19T03:39:24.423122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:41.949392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2170,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422158+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:24.422158+0000","last_peered":"2024-04-19T03:39:24.422158+0000","last_clean":"2024-04-19T03:39:24.422158+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:24.422158+0000","last_undegraded":"2024-04-19T03:39:24.422158+0000","last_fullsized":"2024-04-19T03:39:24.422158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2071,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422023+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:24.422023+0000","last_peered":"2024-04-19T03:39:24.422023+0000","last_clean":"2024-04-19T03:39:24.422023+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:24.422023+0000","last_undegraded":"2024-04-19T03:39:24.422023+0000","last_fullsized":"2024-04-19T03:39:24.422023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422202+0000","last_change":"2024-04-19T03:39:22.424136+0000","last_active":"2024-04-19T03:39:24.422202+0000","last_peered":"2024-04-19T03:39:24.422202+0000","last_clean":"2024-04-19T03:39:24.422202+0000","last_became_active":"2024-04-19T03:39:22.423406+0000","last_became_peered":"2024-04-19T03:39:22.423406+0000","last_unstale":"2024-04-19T03:39:24.422202+0000","last_undegraded":"2024-04-19T03:39:24.422202+0000","last_fullsized":"2024-04-19T03:39:24.422202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:08.687257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423052+0000","last_change":"2024-04-19T03:39:22.424124+0000","last_active":"2024-04-19T03:39:24.423052+0000","last_peered":"2024-04-19T03:39:24.423052+0000","last_clean":"2024-04-19T03:39:24.423052+0000","last_became_active":"2024-04-19T03:39:22.423430+0000","last_became_peered":"2024-04-19T03:39:22.423430+0000","last_unstale":"2024-04-19T03:39:24.423052+0000","last_undegraded":"2024-04-19T03:39:24.423052+0000","last_fullsized":"2024-04-19T03:39:24.423052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:01:49.301315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2080,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422232+0000","last_change":"2024-04-19T03:39:22.424621+0000","last_active":"2024-04-19T03:39:24.422232+0000","last_peered":"2024-04-19T03:39:24.422232+0000","last_clean":"2024-04-19T03:39:24.422232+0000","last_became_active":"2024-04-19T03:39:22.424010+0000","last_became_peered":"2024-04-19T03:39:22.424010+0000","last_unstale":"2024-04-19T03:39:24.422232+0000","last_undegraded":"2024-04-19T03:39:24.422232+0000","last_fullsized":"2024-04-19T03:39:24.422232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:22:02.587072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2059,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392341+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:25.392341+0000","last_peered":"2024-04-19T03:39:25.392341+0000","last_clean":"2024-04-19T03:39:25.392341+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:25.392341+0000","last_undegraded":"2024-04-19T03:39:25.392341+0000","last_fullsized":"2024-04-19T03:39:25.392341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422533+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:24.422533+0000","last_peered":"2024-04-19T03:39:24.422533+0000","last_clean":"2024-04-19T03:39:24.422533+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:24.422533+0000","last_undegraded":"2024-04-19T03:39:24.422533+0000","last_fullsized":"2024-04-19T03:39:24.422533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4131,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392223+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:25.392223+0000","last_peered":"2024-04-19T03:39:25.392223+0000","last_clean":"2024-04-19T03:39:25.392223+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:25.392223+0000","last_undegraded":"2024-04-19T03:39:25.392223+0000","last_fullsized":"2024-04-19T03:39:25.392223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4164,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423092+0000","last_change":"2024-04-19T03:39:22.425878+0000","last_active":"2024-04-19T03:39:24.423092+0000","last_peered":"2024-04-19T03:39:24.423092+0000","last_clean":"2024-04-19T03:39:24.423092+0000","last_became_active":"2024-04-19T03:39:22.424429+0000","last_became_peered":"2024-04-19T03:39:22.424429+0000","last_unstale":"2024-04-19T03:39:24.423092+0000","last_undegraded":"2024-04-19T03:39:24.423092+0000","last_fullsized":"2024-04-19T03:39:24.423092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:27:50.335805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422018+0000","last_change":"2024-04-19T03:39:19.425914+0000","last_active":"2024-04-19T03:39:24.422018+0000","last_peered":"2024-04-19T03:39:24.422018+0000","last_clean":"2024-04-19T03:39:24.422018+0000","last_became_active":"2024-04-19T03:39:19.425552+0000","last_became_peered":"2024-04-19T03:39:19.425552+0000","last_unstale":"2024-04-19T03:39:24.422018+0000","last_undegraded":"2024-04-19T03:39:24.422018+0000","last_fullsized":"2024-04-19T03:39:24.422018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:22:41.252438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422374+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:24.422374+0000","last_peered":"2024-04-19T03:39:24.422374+0000","last_clean":"2024-04-19T03:39:24.422374+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:24.422374+0000","last_undegraded":"2024-04-19T03:39:24.422374+0000","last_fullsized":"2024-04-19T03:39:24.422374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2147,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391717+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:25.391717+0000","last_peered":"2024-04-19T03:39:25.391717+0000","last_clean":"2024-04-19T03:39:25.391717+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:25.391717+0000","last_undegraded":"2024-04-19T03:39:25.391717+0000","last_fullsized":"2024-04-19T03:39:25.391717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4100,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422045+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:24.422045+0000","last_peered":"2024-04-19T03:39:24.422045+0000","last_clean":"2024-04-19T03:39:24.422045+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:24.422045+0000","last_undegraded":"2024-04-19T03:39:24.422045+0000","last_fullsized":"2024-04-19T03:39:24.422045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2086,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422871+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:24.422871+0000","last_peered":"2024-04-19T03:39:24.422871+0000","last_clean":"2024-04-19T03:39:24.422871+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:24.422871+0000","last_undegraded":"2024-04-19T03:39:24.422871+0000","last_fullsized":"2024-04-19T03:39:24.422871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":107,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392545+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:25.392545+0000","last_peered":"2024-04-19T03:39:25.392545+0000","last_clean":"2024-04-19T03:39:25.392545+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:25.392545+0000","last_undegraded":"2024-04-19T03:39:25.392545+0000","last_fullsized":"2024-04-19T03:39:25.392545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2106,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422594+0000","last_change":"2024-04-19T03:39:22.422783+0000","last_active":"2024-04-19T03:39:24.422594+0000","last_peered":"2024-04-19T03:39:24.422594+0000","last_clean":"2024-04-19T03:39:24.422594+0000","last_became_active":"2024-04-19T03:39:22.422213+0000","last_became_peered":"2024-04-19T03:39:22.422213+0000","last_unstale":"2024-04-19T03:39:24.422594+0000","last_undegraded":"2024-04-19T03:39:24.422594+0000","last_fullsized":"2024-04-19T03:39:24.422594+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:43.968707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422045+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:24.422045+0000","last_peered":"2024-04-19T03:39:24.422045+0000","last_clean":"2024-04-19T03:39:24.422045+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:24.422045+0000","last_undegraded":"2024-04-19T03:39:24.422045+0000","last_fullsized":"2024-04-19T03:39:24.422045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":107,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423026+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:24.423026+0000","last_peered":"2024-04-19T03:39:24.423026+0000","last_clean":"2024-04-19T03:39:24.423026+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:24.423026+0000","last_undegraded":"2024-04-19T03:39:24.423026+0000","last_fullsized":"2024-04-19T03:39:24.423026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391660+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:25.391660+0000","last_peered":"2024-04-19T03:39:25.391660+0000","last_clean":"2024-04-19T03:39:25.391660+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:25.391660+0000","last_undegraded":"2024-04-19T03:39:25.391660+0000","last_fullsized":"2024-04-19T03:39:25.391660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392434+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:25.392434+0000","last_peered":"2024-04-19T03:39:25.392434+0000","last_clean":"2024-04-19T03:39:25.392434+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:25.392434+0000","last_undegraded":"2024-04-19T03:39:25.392434+0000","last_fullsized":"2024-04-19T03:39:25.392434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391533+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:25.391533+0000","last_peered":"2024-04-19T03:39:25.391533+0000","last_clean":"2024-04-19T03:39:25.391533+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:25.391533+0000","last_undegraded":"2024-04-19T03:39:25.391533+0000","last_fullsized":"2024-04-19T03:39:25.391533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":98,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422736+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:24.422736+0000","last_peered":"2024-04-19T03:39:24.422736+0000","last_clean":"2024-04-19T03:39:24.422736+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:24.422736+0000","last_undegraded":"2024-04-19T03:39:24.422736+0000","last_fullsized":"2024-04-19T03:39:24.422736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392489+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:25.392489+0000","last_peered":"2024-04-19T03:39:25.392489+0000","last_clean":"2024-04-19T03:39:25.392489+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:25.392489+0000","last_undegraded":"2024-04-19T03:39:25.392489+0000","last_fullsized":"2024-04-19T03:39:25.392489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":85,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391426+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:25.391426+0000","last_peered":"2024-04-19T03:39:25.391426+0000","last_clean":"2024-04-19T03:39:25.391426+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:25.391426+0000","last_undegraded":"2024-04-19T03:39:25.391426+0000","last_fullsized":"2024-04-19T03:39:25.391426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423343+0000","last_change":"2024-04-19T03:39:19.422942+0000","last_active":"2024-04-19T03:39:24.423343+0000","last_peered":"2024-04-19T03:39:24.423343+0000","last_clean":"2024-04-19T03:39:24.423343+0000","last_became_active":"2024-04-19T03:39:19.420043+0000","last_became_peered":"2024-04-19T03:39:19.420043+0000","last_unstale":"2024-04-19T03:39:24.423343+0000","last_undegraded":"2024-04-19T03:39:24.423343+0000","last_fullsized":"2024-04-19T03:39:24.423343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:43.957699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6059,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391629+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:25.391629+0000","last_peered":"2024-04-19T03:39:25.391629+0000","last_clean":"2024-04-19T03:39:25.391629+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:25.391629+0000","last_undegraded":"2024-04-19T03:39:25.391629+0000","last_fullsized":"2024-04-19T03:39:25.391629+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":104,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422893+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:24.422893+0000","last_peered":"2024-04-19T03:39:24.422893+0000","last_clean":"2024-04-19T03:39:24.422893+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:24.422893+0000","last_undegraded":"2024-04-19T03:39:24.422893+0000","last_fullsized":"2024-04-19T03:39:24.422893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391765+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:25.391765+0000","last_peered":"2024-04-19T03:39:25.391765+0000","last_clean":"2024-04-19T03:39:25.391765+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:25.391765+0000","last_undegraded":"2024-04-19T03:39:25.391765+0000","last_fullsized":"2024-04-19T03:39:25.391765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422780+0000","last_change":"2024-04-19T03:39:19.432065+0000","last_active":"2024-04-19T03:39:24.422780+0000","last_peered":"2024-04-19T03:39:24.422780+0000","last_clean":"2024-04-19T03:39:24.422780+0000","last_became_active":"2024-04-19T03:39:19.420230+0000","last_became_peered":"2024-04-19T03:39:19.420230+0000","last_unstale":"2024-04-19T03:39:24.422780+0000","last_undegraded":"2024-04-19T03:39:24.422780+0000","last_fullsized":"2024-04-19T03:39:24.422780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:05:39.830013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422334+0000","last_change":"2024-04-19T03:39:22.425673+0000","last_active":"2024-04-19T03:39:24.422334+0000","last_peered":"2024-04-19T03:39:24.422334+0000","last_clean":"2024-04-19T03:39:24.422334+0000","last_became_active":"2024-04-19T03:39:22.423359+0000","last_became_peered":"2024-04-19T03:39:22.423359+0000","last_unstale":"2024-04-19T03:39:24.422334+0000","last_undegraded":"2024-04-19T03:39:24.422334+0000","last_fullsized":"2024-04-19T03:39:24.422334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:14:34.848930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422162+0000","last_change":"2024-04-19T03:39:19.424767+0000","last_active":"2024-04-19T03:39:24.422162+0000","last_peered":"2024-04-19T03:39:24.422162+0000","last_clean":"2024-04-19T03:39:24.422162+0000","last_became_active":"2024-04-19T03:39:19.424119+0000","last_became_peered":"2024-04-19T03:39:19.424119+0000","last_unstale":"2024-04-19T03:39:24.422162+0000","last_undegraded":"2024-04-19T03:39:24.422162+0000","last_fullsized":"2024-04-19T03:39:24.422162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:17.100453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2054,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422293+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:24.422293+0000","last_peered":"2024-04-19T03:39:24.422293+0000","last_clean":"2024-04-19T03:39:24.422293+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:24.422293+0000","last_undegraded":"2024-04-19T03:39:24.422293+0000","last_fullsized":"2024-04-19T03:39:24.422293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391691+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:25.391691+0000","last_peered":"2024-04-19T03:39:25.391691+0000","last_clean":"2024-04-19T03:39:25.391691+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:25.391691+0000","last_undegraded":"2024-04-19T03:39:25.391691+0000","last_fullsized":"2024-04-19T03:39:25.391691+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2112,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423112+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:24.423112+0000","last_peered":"2024-04-19T03:39:24.423112+0000","last_clean":"2024-04-19T03:39:24.423112+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:24.423112+0000","last_undegraded":"2024-04-19T03:39:24.423112+0000","last_fullsized":"2024-04-19T03:39:24.423112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422535+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:24.422535+0000","last_peered":"2024-04-19T03:39:24.422535+0000","last_clean":"2024-04-19T03:39:24.422535+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:24.422535+0000","last_undegraded":"2024-04-19T03:39:24.422535+0000","last_fullsized":"2024-04-19T03:39:24.422535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392534+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:25.392534+0000","last_peered":"2024-04-19T03:39:25.392534+0000","last_clean":"2024-04-19T03:39:25.392534+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:25.392534+0000","last_undegraded":"2024-04-19T03:39:25.392534+0000","last_fullsized":"2024-04-19T03:39:25.392534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422449+0000","last_change":"2024-04-19T03:39:19.426025+0000","last_active":"2024-04-19T03:39:24.422449+0000","last_peered":"2024-04-19T03:39:24.422449+0000","last_clean":"2024-04-19T03:39:24.422449+0000","last_became_active":"2024-04-19T03:39:19.425633+0000","last_became_peered":"2024-04-19T03:39:19.425633+0000","last_unstale":"2024-04-19T03:39:24.422449+0000","last_undegraded":"2024-04-19T03:39:24.422449+0000","last_fullsized":"2024-04-19T03:39:24.422449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:54.826770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2198,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392587+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:25.392587+0000","last_peered":"2024-04-19T03:39:25.392587+0000","last_clean":"2024-04-19T03:39:25.392587+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:25.392587+0000","last_undegraded":"2024-04-19T03:39:25.392587+0000","last_fullsized":"2024-04-19T03:39:25.392587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423246+0000","last_change":"2024-04-19T03:39:19.423254+0000","last_active":"2024-04-19T03:39:24.423246+0000","last_peered":"2024-04-19T03:39:24.423246+0000","last_clean":"2024-04-19T03:39:24.423246+0000","last_became_active":"2024-04-19T03:39:19.420608+0000","last_became_peered":"2024-04-19T03:39:19.420608+0000","last_unstale":"2024-04-19T03:39:24.423246+0000","last_undegraded":"2024-04-19T03:39:24.423246+0000","last_fullsized":"2024-04-19T03:39:24.423246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:51:19.679913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2157,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421620+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:24.421620+0000","last_peered":"2024-04-19T03:39:24.421620+0000","last_clean":"2024-04-19T03:39:24.421620+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:24.421620+0000","last_undegraded":"2024-04-19T03:39:24.421620+0000","last_fullsized":"2024-04-19T03:39:24.421620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":95,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422319+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:24.422319+0000","last_peered":"2024-04-19T03:39:24.422319+0000","last_clean":"2024-04-19T03:39:24.422319+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:24.422319+0000","last_undegraded":"2024-04-19T03:39:24.422319+0000","last_fullsized":"2024-04-19T03:39:24.422319+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422134+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:24.422134+0000","last_peered":"2024-04-19T03:39:24.422134+0000","last_clean":"2024-04-19T03:39:24.422134+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:24.422134+0000","last_undegraded":"2024-04-19T03:39:24.422134+0000","last_fullsized":"2024-04-19T03:39:24.422134+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422375+0000","last_change":"2024-04-19T03:39:19.419541+0000","last_active":"2024-04-19T03:39:24.422375+0000","last_peered":"2024-04-19T03:39:24.422375+0000","last_clean":"2024-04-19T03:39:24.422375+0000","last_became_active":"2024-04-19T03:39:19.419126+0000","last_became_peered":"2024-04-19T03:39:19.419126+0000","last_unstale":"2024-04-19T03:39:24.422375+0000","last_undegraded":"2024-04-19T03:39:24.422375+0000","last_fullsized":"2024-04-19T03:39:24.422375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:32.179086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2059,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421877+0000","last_change":"2024-04-19T03:39:22.421585+0000","last_active":"2024-04-19T03:39:24.421877+0000","last_peered":"2024-04-19T03:39:24.421877+0000","last_clean":"2024-04-19T03:39:24.421877+0000","last_became_active":"2024-04-19T03:39:22.420856+0000","last_became_peered":"2024-04-19T03:39:22.420856+0000","last_unstale":"2024-04-19T03:39:24.421877+0000","last_undegraded":"2024-04-19T03:39:24.421877+0000","last_fullsized":"2024-04-19T03:39:24.421877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:48:17.028303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423238+0000","last_change":"2024-04-19T03:39:19.420641+0000","last_active":"2024-04-19T03:39:24.423238+0000","last_peered":"2024-04-19T03:39:24.423238+0000","last_clean":"2024-04-19T03:39:24.423238+0000","last_became_active":"2024-04-19T03:39:19.420142+0000","last_became_peered":"2024-04-19T03:39:19.420142+0000","last_unstale":"2024-04-19T03:39:24.423238+0000","last_undegraded":"2024-04-19T03:39:24.423238+0000","last_fullsized":"2024-04-19T03:39:24.423238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:07.098008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":100,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392033+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:25.392033+0000","last_peered":"2024-04-19T03:39:25.392033+0000","last_clean":"2024-04-19T03:39:25.392033+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:25.392033+0000","last_undegraded":"2024-04-19T03:39:25.392033+0000","last_fullsized":"2024-04-19T03:39:25.392033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392024+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:25.392024+0000","last_peered":"2024-04-19T03:39:25.392024+0000","last_clean":"2024-04-19T03:39:25.392024+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:25.392024+0000","last_undegraded":"2024-04-19T03:39:25.392024+0000","last_fullsized":"2024-04-19T03:39:25.392024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2086,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422893+0000","last_change":"2024-04-19T03:39:22.420008+0000","last_active":"2024-04-19T03:39:24.422893+0000","last_peered":"2024-04-19T03:39:24.422893+0000","last_clean":"2024-04-19T03:39:24.422893+0000","last_became_active":"2024-04-19T03:39:22.419131+0000","last_became_peered":"2024-04-19T03:39:22.419131+0000","last_unstale":"2024-04-19T03:39:24.422893+0000","last_undegraded":"2024-04-19T03:39:24.422893+0000","last_fullsized":"2024-04-19T03:39:24.422893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:17.338061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422687+0000","last_change":"2024-04-19T03:39:19.420700+0000","last_active":"2024-04-19T03:39:24.422687+0000","last_peered":"2024-04-19T03:39:24.422687+0000","last_clean":"2024-04-19T03:39:24.422687+0000","last_became_active":"2024-04-19T03:39:19.419391+0000","last_became_peered":"2024-04-19T03:39:19.419391+0000","last_unstale":"2024-04-19T03:39:24.422687+0000","last_undegraded":"2024-04-19T03:39:24.422687+0000","last_fullsized":"2024-04-19T03:39:24.422687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:44:04.519906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422309+0000","last_change":"2024-04-19T03:39:22.427143+0000","last_active":"2024-04-19T03:39:24.422309+0000","last_peered":"2024-04-19T03:39:24.422309+0000","last_clean":"2024-04-19T03:39:24.422309+0000","last_became_active":"2024-04-19T03:39:22.426368+0000","last_became_peered":"2024-04-19T03:39:22.426368+0000","last_unstale":"2024-04-19T03:39:24.422309+0000","last_undegraded":"2024-04-19T03:39:24.422309+0000","last_fullsized":"2024-04-19T03:39:24.422309+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:59.313715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421831+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:24.421831+0000","last_peered":"2024-04-19T03:39:24.421831+0000","last_clean":"2024-04-19T03:39:24.421831+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:24.421831+0000","last_undegraded":"2024-04-19T03:39:24.421831+0000","last_fullsized":"2024-04-19T03:39:24.421831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2123,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423245+0000","last_change":"2024-04-19T03:39:22.424273+0000","last_active":"2024-04-19T03:39:24.423245+0000","last_peered":"2024-04-19T03:39:24.423245+0000","last_clean":"2024-04-19T03:39:24.423245+0000","last_became_active":"2024-04-19T03:39:22.423506+0000","last_became_peered":"2024-04-19T03:39:22.423506+0000","last_unstale":"2024-04-19T03:39:24.423245+0000","last_undegraded":"2024-04-19T03:39:24.423245+0000","last_fullsized":"2024-04-19T03:39:24.423245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:21:43.286340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421734+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:24.421734+0000","last_peered":"2024-04-19T03:39:24.421734+0000","last_clean":"2024-04-19T03:39:24.421734+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:24.421734+0000","last_undegraded":"2024-04-19T03:39:24.421734+0000","last_fullsized":"2024-04-19T03:39:24.421734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6110,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392414+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:25.392414+0000","last_peered":"2024-04-19T03:39:25.392414+0000","last_clean":"2024-04-19T03:39:25.392414+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:25.392414+0000","last_undegraded":"2024-04-19T03:39:25.392414+0000","last_fullsized":"2024-04-19T03:39:25.392414+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392382+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:25.392382+0000","last_peered":"2024-04-19T03:39:25.392382+0000","last_clean":"2024-04-19T03:39:25.392382+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:25.392382+0000","last_undegraded":"2024-04-19T03:39:25.392382+0000","last_fullsized":"2024-04-19T03:39:25.392382+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422895+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:24.422895+0000","last_peered":"2024-04-19T03:39:24.422895+0000","last_clean":"2024-04-19T03:39:24.422895+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:24.422895+0000","last_undegraded":"2024-04-19T03:39:24.422895+0000","last_fullsized":"2024-04-19T03:39:24.422895+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":100,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391322+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:25.391322+0000","last_peered":"2024-04-19T03:39:25.391322+0000","last_clean":"2024-04-19T03:39:25.391322+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:25.391322+0000","last_undegraded":"2024-04-19T03:39:25.391322+0000","last_fullsized":"2024-04-19T03:39:25.391322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422585+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:24.422585+0000","last_peered":"2024-04-19T03:39:24.422585+0000","last_clean":"2024-04-19T03:39:24.422585+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:24.422585+0000","last_undegraded":"2024-04-19T03:39:24.422585+0000","last_fullsized":"2024-04-19T03:39:24.422585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":106,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392409+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:25.392409+0000","last_peered":"2024-04-19T03:39:25.392409+0000","last_clean":"2024-04-19T03:39:25.392409+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:25.392409+0000","last_undegraded":"2024-04-19T03:39:25.392409+0000","last_fullsized":"2024-04-19T03:39:25.392409+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421991+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:24.421991+0000","last_peered":"2024-04-19T03:39:24.421991+0000","last_clean":"2024-04-19T03:39:24.421991+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:24.421991+0000","last_undegraded":"2024-04-19T03:39:24.421991+0000","last_fullsized":"2024-04-19T03:39:24.421991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391935+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:25.391935+0000","last_peered":"2024-04-19T03:39:25.391935+0000","last_clean":"2024-04-19T03:39:25.391935+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:25.391935+0000","last_undegraded":"2024-04-19T03:39:25.391935+0000","last_fullsized":"2024-04-19T03:39:25.391935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":221,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422442+0000","last_change":"2024-04-19T03:39:19.426047+0000","last_active":"2024-04-19T03:39:24.422442+0000","last_peered":"2024-04-19T03:39:24.422442+0000","last_clean":"2024-04-19T03:39:24.422442+0000","last_became_active":"2024-04-19T03:39:19.425609+0000","last_became_peered":"2024-04-19T03:39:19.425609+0000","last_unstale":"2024-04-19T03:39:24.422442+0000","last_undegraded":"2024-04-19T03:39:24.422442+0000","last_fullsized":"2024-04-19T03:39:24.422442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:28:20.346656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":104,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391467+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:25.391467+0000","last_peered":"2024-04-19T03:39:25.391467+0000","last_clean":"2024-04-19T03:39:25.391467+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:25.391467+0000","last_undegraded":"2024-04-19T03:39:25.391467+0000","last_fullsized":"2024-04-19T03:39:25.391467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8080,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422858+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:24.422858+0000","last_peered":"2024-04-19T03:39:24.422858+0000","last_clean":"2024-04-19T03:39:24.422858+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:24.422858+0000","last_undegraded":"2024-04-19T03:39:24.422858+0000","last_fullsized":"2024-04-19T03:39:24.422858+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422150+0000","last_change":"2024-04-19T03:39:19.420389+0000","last_active":"2024-04-19T03:39:24.422150+0000","last_peered":"2024-04-19T03:39:24.422150+0000","last_clean":"2024-04-19T03:39:24.422150+0000","last_became_active":"2024-04-19T03:39:19.418907+0000","last_became_peered":"2024-04-19T03:39:19.418907+0000","last_unstale":"2024-04-19T03:39:24.422150+0000","last_undegraded":"2024-04-19T03:39:24.422150+0000","last_fullsized":"2024-04-19T03:39:24.422150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:10.315321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421732+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:24.421732+0000","last_peered":"2024-04-19T03:39:24.421732+0000","last_clean":"2024-04-19T03:39:24.421732+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:24.421732+0000","last_undegraded":"2024-04-19T03:39:24.421732+0000","last_fullsized":"2024-04-19T03:39:24.421732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392577+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:25.392577+0000","last_peered":"2024-04-19T03:39:25.392577+0000","last_clean":"2024-04-19T03:39:25.392577+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:25.392577+0000","last_undegraded":"2024-04-19T03:39:25.392577+0000","last_fullsized":"2024-04-19T03:39:25.392577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421933+0000","last_change":"2024-04-19T03:39:19.424877+0000","last_active":"2024-04-19T03:39:24.421933+0000","last_peered":"2024-04-19T03:39:24.421933+0000","last_clean":"2024-04-19T03:39:24.421933+0000","last_became_active":"2024-04-19T03:39:19.424216+0000","last_became_peered":"2024-04-19T03:39:19.424216+0000","last_unstale":"2024-04-19T03:39:24.421933+0000","last_undegraded":"2024-04-19T03:39:24.421933+0000","last_fullsized":"2024-04-19T03:39:24.421933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:16:03.959278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391689+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:25.391689+0000","last_peered":"2024-04-19T03:39:25.391689+0000","last_clean":"2024-04-19T03:39:25.391689+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:25.391689+0000","last_undegraded":"2024-04-19T03:39:25.391689+0000","last_fullsized":"2024-04-19T03:39:25.391689+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422842+0000","last_change":"2024-04-19T03:39:19.420362+0000","last_active":"2024-04-19T03:39:24.422842+0000","last_peered":"2024-04-19T03:39:24.422842+0000","last_clean":"2024-04-19T03:39:24.422842+0000","last_became_active":"2024-04-19T03:39:19.419278+0000","last_became_peered":"2024-04-19T03:39:19.419278+0000","last_unstale":"2024-04-19T03:39:24.422842+0000","last_undegraded":"2024-04-19T03:39:24.422842+0000","last_fullsized":"2024-04-19T03:39:24.422842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:02.103259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421832+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:24.421832+0000","last_peered":"2024-04-19T03:39:24.421832+0000","last_clean":"2024-04-19T03:39:24.421832+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:24.421832+0000","last_undegraded":"2024-04-19T03:39:24.421832+0000","last_fullsized":"2024-04-19T03:39:24.421832+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423084+0000","last_change":"2024-04-19T03:39:19.426867+0000","last_active":"2024-04-19T03:39:24.423084+0000","last_peered":"2024-04-19T03:39:24.423084+0000","last_clean":"2024-04-19T03:39:24.423084+0000","last_became_active":"2024-04-19T03:39:19.425825+0000","last_became_peered":"2024-04-19T03:39:19.425825+0000","last_unstale":"2024-04-19T03:39:24.423084+0000","last_undegraded":"2024-04-19T03:39:24.423084+0000","last_fullsized":"2024-04-19T03:39:24.423084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:16:33.744870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392220+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:25.392220+0000","last_peered":"2024-04-19T03:39:25.392220+0000","last_clean":"2024-04-19T03:39:25.392220+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:25.392220+0000","last_undegraded":"2024-04-19T03:39:25.392220+0000","last_fullsized":"2024-04-19T03:39:25.392220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422610+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:24.422610+0000","last_peered":"2024-04-19T03:39:24.422610+0000","last_clean":"2024-04-19T03:39:24.422610+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:24.422610+0000","last_undegraded":"2024-04-19T03:39:24.422610+0000","last_fullsized":"2024-04-19T03:39:24.422610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392286+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:25.392286+0000","last_peered":"2024-04-19T03:39:25.392286+0000","last_clean":"2024-04-19T03:39:25.392286+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:25.392286+0000","last_undegraded":"2024-04-19T03:39:25.392286+0000","last_fullsized":"2024-04-19T03:39:25.392286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2057,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422456+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:24.422456+0000","last_peered":"2024-04-19T03:39:24.422456+0000","last_clean":"2024-04-19T03:39:24.422456+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:24.422456+0000","last_undegraded":"2024-04-19T03:39:24.422456+0000","last_fullsized":"2024-04-19T03:39:24.422456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422605+0000","last_change":"2024-04-19T03:39:19.418696+0000","last_active":"2024-04-19T03:39:24.422605+0000","last_peered":"2024-04-19T03:39:24.422605+0000","last_clean":"2024-04-19T03:39:24.422605+0000","last_became_active":"2024-04-19T03:39:19.416023+0000","last_became_peered":"2024-04-19T03:39:19.416023+0000","last_unstale":"2024-04-19T03:39:24.422605+0000","last_undegraded":"2024-04-19T03:39:24.422605+0000","last_fullsized":"2024-04-19T03:39:24.422605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:03:24.163580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422932+0000","last_change":"2024-04-19T03:39:19.423441+0000","last_active":"2024-04-19T03:39:24.422932+0000","last_peered":"2024-04-19T03:39:24.422932+0000","last_clean":"2024-04-19T03:39:24.422932+0000","last_became_active":"2024-04-19T03:39:19.421557+0000","last_became_peered":"2024-04-19T03:39:19.421557+0000","last_unstale":"2024-04-19T03:39:24.422932+0000","last_undegraded":"2024-04-19T03:39:24.422932+0000","last_fullsized":"2024-04-19T03:39:24.422932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:52.644757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":100,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422426+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:24.422426+0000","last_peered":"2024-04-19T03:39:24.422426+0000","last_clean":"2024-04-19T03:39:24.422426+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:24.422426+0000","last_undegraded":"2024-04-19T03:39:24.422426+0000","last_fullsized":"2024-04-19T03:39:24.422426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":94,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422144+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:24.422144+0000","last_peered":"2024-04-19T03:39:24.422144+0000","last_clean":"2024-04-19T03:39:24.422144+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:24.422144+0000","last_undegraded":"2024-04-19T03:39:24.422144+0000","last_fullsized":"2024-04-19T03:39:24.422144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2135,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422765+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:24.422765+0000","last_peered":"2024-04-19T03:39:24.422765+0000","last_clean":"2024-04-19T03:39:24.422765+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:24.422765+0000","last_undegraded":"2024-04-19T03:39:24.422765+0000","last_fullsized":"2024-04-19T03:39:24.422765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423352+0000","last_change":"2024-04-19T03:39:19.423441+0000","last_active":"2024-04-19T03:39:24.423352+0000","last_peered":"2024-04-19T03:39:24.423352+0000","last_clean":"2024-04-19T03:39:24.423352+0000","last_became_active":"2024-04-19T03:39:19.422038+0000","last_became_peered":"2024-04-19T03:39:19.422038+0000","last_unstale":"2024-04-19T03:39:24.423352+0000","last_undegraded":"2024-04-19T03:39:24.423352+0000","last_fullsized":"2024-04-19T03:39:24.423352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:05:54.159938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2078,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422313+0000","last_change":"2024-04-19T03:39:22.426328+0000","last_active":"2024-04-19T03:39:24.422313+0000","last_peered":"2024-04-19T03:39:24.422313+0000","last_clean":"2024-04-19T03:39:24.422313+0000","last_became_active":"2024-04-19T03:39:22.425512+0000","last_became_peered":"2024-04-19T03:39:22.425512+0000","last_unstale":"2024-04-19T03:39:24.422313+0000","last_undegraded":"2024-04-19T03:39:24.422313+0000","last_fullsized":"2024-04-19T03:39:24.422313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:17.080474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.423026+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:24.423026+0000","last_peered":"2024-04-19T03:39:24.423026+0000","last_clean":"2024-04-19T03:39:24.423026+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:24.423026+0000","last_undegraded":"2024-04-19T03:39:24.423026+0000","last_fullsized":"2024-04-19T03:39:24.423026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421951+0000","last_change":"2024-04-19T03:39:19.422170+0000","last_active":"2024-04-19T03:39:24.421951+0000","last_peered":"2024-04-19T03:39:24.421951+0000","last_clean":"2024-04-19T03:39:24.421951+0000","last_became_active":"2024-04-19T03:39:19.421532+0000","last_became_peered":"2024-04-19T03:39:19.421532+0000","last_unstale":"2024-04-19T03:39:24.421951+0000","last_undegraded":"2024-04-19T03:39:24.421951+0000","last_fullsized":"2024-04-19T03:39:24.421951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:44.716256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392475+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:25.392475+0000","last_peered":"2024-04-19T03:39:25.392475+0000","last_clean":"2024-04-19T03:39:25.392475+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:25.392475+0000","last_undegraded":"2024-04-19T03:39:25.392475+0000","last_fullsized":"2024-04-19T03:39:25.392475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4141,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422301+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:24.422301+0000","last_peered":"2024-04-19T03:39:24.422301+0000","last_clean":"2024-04-19T03:39:24.422301+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:24.422301+0000","last_undegraded":"2024-04-19T03:39:24.422301+0000","last_fullsized":"2024-04-19T03:39:24.422301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392500+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:25.392500+0000","last_peered":"2024-04-19T03:39:25.392500+0000","last_clean":"2024-04-19T03:39:25.392500+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:25.392500+0000","last_undegraded":"2024-04-19T03:39:25.392500+0000","last_fullsized":"2024-04-19T03:39:25.392500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2127,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.421620+0000","last_change":"2024-04-19T03:39:22.419996+0000","last_active":"2024-04-19T03:39:24.421620+0000","last_peered":"2024-04-19T03:39:24.421620+0000","last_clean":"2024-04-19T03:39:24.421620+0000","last_became_active":"2024-04-19T03:39:22.419058+0000","last_became_peered":"2024-04-19T03:39:22.419058+0000","last_unstale":"2024-04-19T03:39:24.421620+0000","last_undegraded":"2024-04-19T03:39:24.421620+0000","last_fullsized":"2024-04-19T03:39:24.421620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:02.174360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422268+0000","last_change":"2024-04-19T03:39:19.423562+0000","last_active":"2024-04-19T03:39:24.422268+0000","last_peered":"2024-04-19T03:39:24.422268+0000","last_clean":"2024-04-19T03:39:24.422268+0000","last_became_active":"2024-04-19T03:39:19.421810+0000","last_became_peered":"2024-04-19T03:39:19.421810+0000","last_unstale":"2024-04-19T03:39:24.422268+0000","last_undegraded":"2024-04-19T03:39:24.422268+0000","last_fullsized":"2024-04-19T03:39:24.422268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:34:19.153092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":91,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.391526+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:25.391526+0000","last_peered":"2024-04-19T03:39:25.391526+0000","last_clean":"2024-04-19T03:39:25.391526+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:25.391526+0000","last_undegraded":"2024-04-19T03:39:25.391526+0000","last_fullsized":"2024-04-19T03:39:25.391526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2079,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422556+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:24.422556+0000","last_peered":"2024-04-19T03:39:24.422556+0000","last_clean":"2024-04-19T03:39:24.422556+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:24.422556+0000","last_undegraded":"2024-04-19T03:39:24.422556+0000","last_fullsized":"2024-04-19T03:39:24.422556+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2095,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:25.392206+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:25.392206+0000","last_peered":"2024-04-19T03:39:25.392206+0000","last_clean":"2024-04-19T03:39:25.392206+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:25.392206+0000","last_undegraded":"2024-04-19T03:39:25.392206+0000","last_fullsized":"2024-04-19T03:39:25.392206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-19T03:39:24.422809+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:24.422809+0000","last_peered":"2024-04-19T03:39:24.422809+0000","last_clean":"2024-04-19T03:39:24.422809+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:24.422809+0000","last_undegraded":"2024-04-19T03:39:24.422809+0000","last_fullsized":"2024-04-19T03:39:24.422809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481795,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47164,"kb_used_data":1580,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324676,"statfs":{"total":96636764160,"available":96588468224,"internally_reserved":0,"allocated":1617920,"data_stored":1220294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369776,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002064,"statfs":{"total":96636764160,"available":96258113536,"internally_reserved":0,"allocated":1605632,"data_stored":1219072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738413,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378764,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993076,"statfs":{"total":96636764160,"available":96248909824,"internally_reserved":0,"allocated":716800,"data_stored":344284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.435},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:30.575 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T03:39:30.576 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:39:30.576 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T03:39:30.576 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.072735 2024-04-19T03:39:30.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.07273483743207787 2024-04-19T03:39:31.394 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.2 primary-affinity to 0.0727348 (847662) 2024-04-19T03:39:36.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-19T03:39:36.571 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a: {} 2024-04-19T03:39:36.581 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b: {} 2024-04-19T03:39:36.591 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c: {} 2024-04-19T03:39:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:39:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:39:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:39:36.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T03:39:37.397 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T03:39:37.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-19T03:39:38.401 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-19T03:39:38.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T03:39:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T03:39:39.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-19T03:39:40.412 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-19T03:39:40.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T03:39:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T03:39:41.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-19T03:39:42.424 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-19T03:39:42.439 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-19T03:39:42.439 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-19T03:39:42.439 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-19T03:39:42.439 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-19T03:39:42.439 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T03:39:42.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:39:42.807 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:42.807 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:39:42.413630+0000","last_up_change":"2024-04-19T03:39:18.391293+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":19,"up_from":77,"up_thru":80,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":5986},{"type":"v1","addr":"172.21.15.129:6801","nonce":5986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":5986},{"type":"v1","addr":"172.21.15.129:6803","nonce":5986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":5986},{"type":"v1","addr":"172.21.15.129:6807","nonce":5986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":5986},{"type":"v1","addr":"172.21.15.129:6805","nonce":5986}]},"public_addr":"172.21.15.129:6801/5986","cluster_addr":"172.21.15.129:6803/5986","heartbeat_back_addr":"172.21.15.129:6807/5986","heartbeat_front_addr":"172.21.15.129:6805/5986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":19}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:39:42.823 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T03:39:42.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:39:43.193 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:43.193 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:39:42.413630+0000","last_up_change":"2024-04-19T03:39:18.391293+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":19,"up_from":77,"up_thru":80,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":5986},{"type":"v1","addr":"172.21.15.129:6801","nonce":5986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":5986},{"type":"v1","addr":"172.21.15.129:6803","nonce":5986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":5986},{"type":"v1","addr":"172.21.15.129:6807","nonce":5986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":5986},{"type":"v1","addr":"172.21.15.129:6805","nonce":5986}]},"public_addr":"172.21.15.129:6801/5986","cluster_addr":"172.21.15.129:6803/5986","heartbeat_back_addr":"172.21.15.129:6807/5986","heartbeat_front_addr":"172.21.15.129:6805/5986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":19}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:39:43.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T03:39:43.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T03:39:43.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T03:39:43.402 INFO:teuthology.orchestra.run.smithi005.stdout:34359738416 2024-04-19T03:39:43.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T03:39:43.403 INFO:teuthology.orchestra.run.smithi005.stdout:34359738416 2024-04-19T03:39:43.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T03:39:43.405 INFO:teuthology.orchestra.run.smithi005.stdout:330712481799 2024-04-19T03:39:43.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T03:39:43.821 INFO:teuthology.orchestra.run.smithi005.stdout:330712481797 2024-04-19T03:39:43.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 330712481799 got 330712481797 for osd.2 2024-04-19T03:39:43.855 INFO:teuthology.orchestra.run.smithi005.stdout:34359738415 2024-04-19T03:39:43.858 INFO:teuthology.orchestra.run.smithi005.stdout:34359738415 2024-04-19T03:39:43.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738415 for osd.0 2024-04-19T03:39:43.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738415 for osd.1 2024-04-19T03:39:44.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T03:39:44.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T03:39:44.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T03:39:45.232 INFO:teuthology.orchestra.run.smithi005.stdout:330712481799 2024-04-19T03:39:45.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 330712481799 got 330712481799 for osd.2 2024-04-19T03:39:45.248 DEBUG:teuthology.parallel:result is None 2024-04-19T03:39:45.260 INFO:teuthology.orchestra.run.smithi005.stdout:34359738417 2024-04-19T03:39:45.269 INFO:teuthology.orchestra.run.smithi005.stdout:34359738417 2024-04-19T03:39:45.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738417 for osd.0 2024-04-19T03:39:45.278 DEBUG:teuthology.parallel:result is None 2024-04-19T03:39:45.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738417 for osd.1 2024-04-19T03:39:45.286 DEBUG:teuthology.parallel:result is None 2024-04-19T03:39:45.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T03:39:45.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:45.703 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:45.705 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:45.717 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-04-19T03:39:44.335547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795892,"kb_used_data":4040,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319628,"statfs":{"total":289910292480,"available":289095299072,"internally_reserved":0,"allocated":4136960,"data_stored":2885242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000806"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2066,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413844+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:41.413844+0000","last_peered":"2024-04-19T03:39:41.413844+0000","last_clean":"2024-04-19T03:39:41.413844+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:41.413844+0000","last_undegraded":"2024-04-19T03:39:41.413844+0000","last_fullsized":"2024-04-19T03:39:41.413844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413352+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:41.413352+0000","last_peered":"2024-04-19T03:39:41.413352+0000","last_clean":"2024-04-19T03:39:41.413352+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:41.413352+0000","last_undegraded":"2024-04-19T03:39:41.413352+0000","last_fullsized":"2024-04-19T03:39:41.413352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4081,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391168+0000","last_change":"2024-04-19T03:39:32.399459+0000","last_active":"2024-04-19T03:39:37.391168+0000","last_peered":"2024-04-19T03:39:37.391168+0000","last_clean":"2024-04-19T03:39:37.391168+0000","last_became_active":"2024-04-19T03:39:32.397753+0000","last_became_peered":"2024-04-19T03:39:32.397753+0000","last_unstale":"2024-04-19T03:39:37.391168+0000","last_undegraded":"2024-04-19T03:39:37.391168+0000","last_fullsized":"2024-04-19T03:39:37.391168+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:54.322202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390587+0000","last_change":"2024-04-19T03:39:32.400611+0000","last_active":"2024-04-19T03:39:37.390587+0000","last_peered":"2024-04-19T03:39:37.390587+0000","last_clean":"2024-04-19T03:39:37.390587+0000","last_became_active":"2024-04-19T03:39:32.399743+0000","last_became_peered":"2024-04-19T03:39:32.399743+0000","last_unstale":"2024-04-19T03:39:37.390587+0000","last_undegraded":"2024-04-19T03:39:37.390587+0000","last_fullsized":"2024-04-19T03:39:37.390587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:40:42.830458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413052+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:41.413052+0000","last_peered":"2024-04-19T03:39:41.413052+0000","last_clean":"2024-04-19T03:39:41.413052+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:41.413052+0000","last_undegraded":"2024-04-19T03:39:41.413052+0000","last_fullsized":"2024-04-19T03:39:41.413052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":81,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390192+0000","last_change":"2024-04-19T03:39:32.398542+0000","last_active":"2024-04-19T03:39:37.390192+0000","last_peered":"2024-04-19T03:39:37.390192+0000","last_clean":"2024-04-19T03:39:37.390192+0000","last_became_active":"2024-04-19T03:39:32.398227+0000","last_became_peered":"2024-04-19T03:39:32.398227+0000","last_unstale":"2024-04-19T03:39:37.390192+0000","last_undegraded":"2024-04-19T03:39:37.390192+0000","last_fullsized":"2024-04-19T03:39:37.390192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:10:16.307090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390010+0000","last_change":"2024-04-19T03:39:32.396074+0000","last_active":"2024-04-19T03:39:37.390010+0000","last_peered":"2024-04-19T03:39:37.390010+0000","last_clean":"2024-04-19T03:39:37.390010+0000","last_became_active":"2024-04-19T03:39:32.395729+0000","last_became_peered":"2024-04-19T03:39:32.395729+0000","last_unstale":"2024-04-19T03:39:37.390010+0000","last_undegraded":"2024-04-19T03:39:37.390010+0000","last_fullsized":"2024-04-19T03:39:37.390010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:29.445916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389883+0000","last_change":"2024-04-19T03:39:32.400603+0000","last_active":"2024-04-19T03:39:37.389883+0000","last_peered":"2024-04-19T03:39:37.389883+0000","last_clean":"2024-04-19T03:39:37.389883+0000","last_became_active":"2024-04-19T03:39:32.397995+0000","last_became_peered":"2024-04-19T03:39:32.397995+0000","last_unstale":"2024-04-19T03:39:37.389883+0000","last_undegraded":"2024-04-19T03:39:37.389883+0000","last_fullsized":"2024-04-19T03:39:37.389883+0000","mapping_epoch":85,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:57.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6161,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418326+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:42.418326+0000","last_peered":"2024-04-19T03:39:42.418326+0000","last_clean":"2024-04-19T03:39:42.418326+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:42.418326+0000","last_undegraded":"2024-04-19T03:39:42.418326+0000","last_fullsized":"2024-04-19T03:39:42.418326+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413649+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:41.413649+0000","last_peered":"2024-04-19T03:39:41.413649+0000","last_clean":"2024-04-19T03:39:41.413649+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:41.413649+0000","last_undegraded":"2024-04-19T03:39:41.413649+0000","last_fullsized":"2024-04-19T03:39:41.413649+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4027,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390781+0000","last_change":"2024-04-19T03:39:32.400179+0000","last_active":"2024-04-19T03:39:37.390781+0000","last_peered":"2024-04-19T03:39:37.390781+0000","last_clean":"2024-04-19T03:39:37.390781+0000","last_became_active":"2024-04-19T03:39:32.397994+0000","last_became_peered":"2024-04-19T03:39:32.397994+0000","last_unstale":"2024-04-19T03:39:37.390781+0000","last_undegraded":"2024-04-19T03:39:37.390781+0000","last_fullsized":"2024-04-19T03:39:37.390781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:33.299512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413111+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:41.413111+0000","last_peered":"2024-04-19T03:39:41.413111+0000","last_clean":"2024-04-19T03:39:41.413111+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:41.413111+0000","last_undegraded":"2024-04-19T03:39:41.413111+0000","last_fullsized":"2024-04-19T03:39:41.413111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2079,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412862+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:41.412862+0000","last_peered":"2024-04-19T03:39:41.412862+0000","last_clean":"2024-04-19T03:39:41.412862+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:41.412862+0000","last_undegraded":"2024-04-19T03:39:41.412862+0000","last_fullsized":"2024-04-19T03:39:41.412862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390697+0000","last_change":"2024-04-19T03:39:32.395332+0000","last_active":"2024-04-19T03:39:37.390697+0000","last_peered":"2024-04-19T03:39:37.390697+0000","last_clean":"2024-04-19T03:39:37.390697+0000","last_became_active":"2024-04-19T03:39:32.392604+0000","last_became_peered":"2024-04-19T03:39:32.392604+0000","last_unstale":"2024-04-19T03:39:37.390697+0000","last_undegraded":"2024-04-19T03:39:37.390697+0000","last_fullsized":"2024-04-19T03:39:37.390697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:12.846842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2111,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390584+0000","last_change":"2024-04-19T03:39:32.395011+0000","last_active":"2024-04-19T03:39:37.390584+0000","last_peered":"2024-04-19T03:39:37.390584+0000","last_clean":"2024-04-19T03:39:37.390584+0000","last_became_active":"2024-04-19T03:39:32.392633+0000","last_became_peered":"2024-04-19T03:39:32.392633+0000","last_unstale":"2024-04-19T03:39:37.390584+0000","last_undegraded":"2024-04-19T03:39:37.390584+0000","last_fullsized":"2024-04-19T03:39:37.390584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:56.349038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2088,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389956+0000","last_change":"2024-04-19T03:39:32.396919+0000","last_active":"2024-04-19T03:39:37.389956+0000","last_peered":"2024-04-19T03:39:37.389956+0000","last_clean":"2024-04-19T03:39:37.389956+0000","last_became_active":"2024-04-19T03:39:32.395719+0000","last_became_peered":"2024-04-19T03:39:32.395719+0000","last_unstale":"2024-04-19T03:39:37.389956+0000","last_undegraded":"2024-04-19T03:39:37.389956+0000","last_fullsized":"2024-04-19T03:39:37.389956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:08.092382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419797+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:42.419797+0000","last_peered":"2024-04-19T03:39:42.419797+0000","last_clean":"2024-04-19T03:39:42.419797+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:42.419797+0000","last_undegraded":"2024-04-19T03:39:42.419797+0000","last_fullsized":"2024-04-19T03:39:42.419797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413507+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:41.413507+0000","last_peered":"2024-04-19T03:39:41.413507+0000","last_clean":"2024-04-19T03:39:41.413507+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:41.413507+0000","last_undegraded":"2024-04-19T03:39:41.413507+0000","last_fullsized":"2024-04-19T03:39:41.413507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4139,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419233+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:42.419233+0000","last_peered":"2024-04-19T03:39:42.419233+0000","last_clean":"2024-04-19T03:39:42.419233+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:42.419233+0000","last_undegraded":"2024-04-19T03:39:42.419233+0000","last_fullsized":"2024-04-19T03:39:42.419233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390528+0000","last_change":"2024-04-19T03:39:32.401641+0000","last_active":"2024-04-19T03:39:37.390528+0000","last_peered":"2024-04-19T03:39:37.390528+0000","last_clean":"2024-04-19T03:39:37.390528+0000","last_became_active":"2024-04-19T03:39:32.399814+0000","last_became_peered":"2024-04-19T03:39:32.399814+0000","last_unstale":"2024-04-19T03:39:37.390528+0000","last_undegraded":"2024-04-19T03:39:37.390528+0000","last_fullsized":"2024-04-19T03:39:37.390528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:40.327326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390386+0000","last_change":"2024-04-19T03:39:32.400170+0000","last_active":"2024-04-19T03:39:37.390386+0000","last_peered":"2024-04-19T03:39:37.390386+0000","last_clean":"2024-04-19T03:39:37.390386+0000","last_became_active":"2024-04-19T03:39:32.399694+0000","last_became_peered":"2024-04-19T03:39:32.399694+0000","last_unstale":"2024-04-19T03:39:37.390386+0000","last_undegraded":"2024-04-19T03:39:37.390386+0000","last_fullsized":"2024-04-19T03:39:37.390386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:18.828239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412798+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:41.412798+0000","last_peered":"2024-04-19T03:39:41.412798+0000","last_clean":"2024-04-19T03:39:41.412798+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:41.412798+0000","last_undegraded":"2024-04-19T03:39:41.412798+0000","last_fullsized":"2024-04-19T03:39:41.412798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2155,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418161+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:42.418161+0000","last_peered":"2024-04-19T03:39:42.418161+0000","last_clean":"2024-04-19T03:39:42.418161+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:42.418161+0000","last_undegraded":"2024-04-19T03:39:42.418161+0000","last_fullsized":"2024-04-19T03:39:42.418161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412776+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:41.412776+0000","last_peered":"2024-04-19T03:39:41.412776+0000","last_clean":"2024-04-19T03:39:41.412776+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:41.412776+0000","last_undegraded":"2024-04-19T03:39:41.412776+0000","last_fullsized":"2024-04-19T03:39:41.412776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2094,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413817+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:41.413817+0000","last_peered":"2024-04-19T03:39:41.413817+0000","last_clean":"2024-04-19T03:39:41.413817+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:41.413817+0000","last_undegraded":"2024-04-19T03:39:41.413817+0000","last_fullsized":"2024-04-19T03:39:41.413817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419868+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:42.419868+0000","last_peered":"2024-04-19T03:39:42.419868+0000","last_clean":"2024-04-19T03:39:42.419868+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:42.419868+0000","last_undegraded":"2024-04-19T03:39:42.419868+0000","last_fullsized":"2024-04-19T03:39:42.419868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391435+0000","last_change":"2024-04-19T03:39:32.397511+0000","last_active":"2024-04-19T03:39:37.391435+0000","last_peered":"2024-04-19T03:39:37.391435+0000","last_clean":"2024-04-19T03:39:37.391435+0000","last_became_active":"2024-04-19T03:39:32.396369+0000","last_became_peered":"2024-04-19T03:39:32.396369+0000","last_unstale":"2024-04-19T03:39:37.391435+0000","last_undegraded":"2024-04-19T03:39:37.391435+0000","last_fullsized":"2024-04-19T03:39:37.391435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:02:22.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412750+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:41.412750+0000","last_peered":"2024-04-19T03:39:41.412750+0000","last_clean":"2024-04-19T03:39:41.412750+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:41.412750+0000","last_undegraded":"2024-04-19T03:39:41.412750+0000","last_fullsized":"2024-04-19T03:39:41.412750+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413799+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:41.413799+0000","last_peered":"2024-04-19T03:39:41.413799+0000","last_clean":"2024-04-19T03:39:41.413799+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:41.413799+0000","last_undegraded":"2024-04-19T03:39:41.413799+0000","last_fullsized":"2024-04-19T03:39:41.413799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418408+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:42.418408+0000","last_peered":"2024-04-19T03:39:42.418408+0000","last_clean":"2024-04-19T03:39:42.418408+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:42.418408+0000","last_undegraded":"2024-04-19T03:39:42.418408+0000","last_fullsized":"2024-04-19T03:39:42.418408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418928+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:42.418928+0000","last_peered":"2024-04-19T03:39:42.418928+0000","last_clean":"2024-04-19T03:39:42.418928+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:42.418928+0000","last_undegraded":"2024-04-19T03:39:42.418928+0000","last_fullsized":"2024-04-19T03:39:42.418928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420339+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:42.420339+0000","last_peered":"2024-04-19T03:39:42.420339+0000","last_clean":"2024-04-19T03:39:42.420339+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:42.420339+0000","last_undegraded":"2024-04-19T03:39:42.420339+0000","last_fullsized":"2024-04-19T03:39:42.420339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413707+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:41.413707+0000","last_peered":"2024-04-19T03:39:41.413707+0000","last_clean":"2024-04-19T03:39:41.413707+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:41.413707+0000","last_undegraded":"2024-04-19T03:39:41.413707+0000","last_fullsized":"2024-04-19T03:39:41.413707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420283+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:42.420283+0000","last_peered":"2024-04-19T03:39:42.420283+0000","last_clean":"2024-04-19T03:39:42.420283+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:42.420283+0000","last_undegraded":"2024-04-19T03:39:42.420283+0000","last_fullsized":"2024-04-19T03:39:42.420283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420113+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:42.420113+0000","last_peered":"2024-04-19T03:39:42.420113+0000","last_clean":"2024-04-19T03:39:42.420113+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:42.420113+0000","last_undegraded":"2024-04-19T03:39:42.420113+0000","last_fullsized":"2024-04-19T03:39:42.420113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.400643+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.398090+0000","last_became_peered":"2024-04-19T03:39:32.398090+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:12:38.136122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418025+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:42.418025+0000","last_peered":"2024-04-19T03:39:42.418025+0000","last_clean":"2024-04-19T03:39:42.418025+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:42.418025+0000","last_undegraded":"2024-04-19T03:39:42.418025+0000","last_fullsized":"2024-04-19T03:39:42.418025+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413667+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:41.413667+0000","last_peered":"2024-04-19T03:39:41.413667+0000","last_clean":"2024-04-19T03:39:41.413667+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:41.413667+0000","last_undegraded":"2024-04-19T03:39:41.413667+0000","last_fullsized":"2024-04-19T03:39:41.413667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4150,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420052+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:42.420052+0000","last_peered":"2024-04-19T03:39:42.420052+0000","last_clean":"2024-04-19T03:39:42.420052+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:42.420052+0000","last_undegraded":"2024-04-19T03:39:42.420052+0000","last_fullsized":"2024-04-19T03:39:42.420052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":180,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391107+0000","last_change":"2024-04-19T03:39:32.394904+0000","last_active":"2024-04-19T03:39:37.391107+0000","last_peered":"2024-04-19T03:39:37.391107+0000","last_clean":"2024-04-19T03:39:37.391107+0000","last_became_active":"2024-04-19T03:39:32.394518+0000","last_became_peered":"2024-04-19T03:39:32.394518+0000","last_unstale":"2024-04-19T03:39:37.391107+0000","last_undegraded":"2024-04-19T03:39:37.391107+0000","last_fullsized":"2024-04-19T03:39:37.391107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:49.767040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4171,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390892+0000","last_change":"2024-04-19T03:39:32.395658+0000","last_active":"2024-04-19T03:39:37.390892+0000","last_peered":"2024-04-19T03:39:37.390892+0000","last_clean":"2024-04-19T03:39:37.390892+0000","last_became_active":"2024-04-19T03:39:32.393165+0000","last_became_peered":"2024-04-19T03:39:32.393165+0000","last_unstale":"2024-04-19T03:39:37.390892+0000","last_undegraded":"2024-04-19T03:39:37.390892+0000","last_fullsized":"2024-04-19T03:39:37.390892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:09.225415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390506+0000","last_change":"2024-04-19T03:39:32.400220+0000","last_active":"2024-04-19T03:39:37.390506+0000","last_peered":"2024-04-19T03:39:37.390506+0000","last_clean":"2024-04-19T03:39:37.390506+0000","last_became_active":"2024-04-19T03:39:32.399717+0000","last_became_peered":"2024-04-19T03:39:32.399717+0000","last_unstale":"2024-04-19T03:39:37.390506+0000","last_undegraded":"2024-04-19T03:39:37.390506+0000","last_fullsized":"2024-04-19T03:39:37.390506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:01.543694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2062,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413157+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:41.413157+0000","last_peered":"2024-04-19T03:39:41.413157+0000","last_clean":"2024-04-19T03:39:41.413157+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:41.413157+0000","last_undegraded":"2024-04-19T03:39:41.413157+0000","last_fullsized":"2024-04-19T03:39:41.413157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419933+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:42.419933+0000","last_peered":"2024-04-19T03:39:42.419933+0000","last_clean":"2024-04-19T03:39:42.419933+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:42.419933+0000","last_undegraded":"2024-04-19T03:39:42.419933+0000","last_fullsized":"2024-04-19T03:39:42.419933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413927+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:41.413927+0000","last_peered":"2024-04-19T03:39:41.413927+0000","last_clean":"2024-04-19T03:39:41.413927+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:41.413927+0000","last_undegraded":"2024-04-19T03:39:41.413927+0000","last_fullsized":"2024-04-19T03:39:41.413927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412670+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:41.412670+0000","last_peered":"2024-04-19T03:39:41.412670+0000","last_clean":"2024-04-19T03:39:41.412670+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:41.412670+0000","last_undegraded":"2024-04-19T03:39:41.412670+0000","last_fullsized":"2024-04-19T03:39:41.412670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":110,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419704+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:42.419704+0000","last_peered":"2024-04-19T03:39:42.419704+0000","last_clean":"2024-04-19T03:39:42.419704+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:42.419704+0000","last_undegraded":"2024-04-19T03:39:42.419704+0000","last_fullsized":"2024-04-19T03:39:42.419704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390748+0000","last_change":"2024-04-19T03:39:32.395496+0000","last_active":"2024-04-19T03:39:37.390748+0000","last_peered":"2024-04-19T03:39:37.390748+0000","last_clean":"2024-04-19T03:39:37.390748+0000","last_became_active":"2024-04-19T03:39:32.394631+0000","last_became_peered":"2024-04-19T03:39:32.394631+0000","last_unstale":"2024-04-19T03:39:37.390748+0000","last_undegraded":"2024-04-19T03:39:37.390748+0000","last_fullsized":"2024-04-19T03:39:37.390748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:10.062803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2206,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420401+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:42.420401+0000","last_peered":"2024-04-19T03:39:42.420401+0000","last_clean":"2024-04-19T03:39:42.420401+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:42.420401+0000","last_undegraded":"2024-04-19T03:39:42.420401+0000","last_fullsized":"2024-04-19T03:39:42.420401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391714+0000","last_change":"2024-04-19T03:39:32.396659+0000","last_active":"2024-04-19T03:39:37.391714+0000","last_peered":"2024-04-19T03:39:37.391714+0000","last_clean":"2024-04-19T03:39:37.391714+0000","last_became_active":"2024-04-19T03:39:32.396285+0000","last_became_peered":"2024-04-19T03:39:32.396285+0000","last_unstale":"2024-04-19T03:39:37.391714+0000","last_undegraded":"2024-04-19T03:39:37.391714+0000","last_fullsized":"2024-04-19T03:39:37.391714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:04.132840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412339+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:41.412339+0000","last_peered":"2024-04-19T03:39:41.412339+0000","last_clean":"2024-04-19T03:39:41.412339+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:41.412339+0000","last_undegraded":"2024-04-19T03:39:41.412339+0000","last_fullsized":"2024-04-19T03:39:41.412339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413240+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:41.413240+0000","last_peered":"2024-04-19T03:39:41.413240+0000","last_clean":"2024-04-19T03:39:41.413240+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:41.413240+0000","last_undegraded":"2024-04-19T03:39:41.413240+0000","last_fullsized":"2024-04-19T03:39:41.413240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412785+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:41.412785+0000","last_peered":"2024-04-19T03:39:41.412785+0000","last_clean":"2024-04-19T03:39:41.412785+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:41.412785+0000","last_undegraded":"2024-04-19T03:39:41.412785+0000","last_fullsized":"2024-04-19T03:39:41.412785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391598+0000","last_change":"2024-04-19T03:39:32.398006+0000","last_active":"2024-04-19T03:39:37.391598+0000","last_peered":"2024-04-19T03:39:37.391598+0000","last_clean":"2024-04-19T03:39:37.391598+0000","last_became_active":"2024-04-19T03:39:32.397734+0000","last_became_peered":"2024-04-19T03:39:32.397734+0000","last_unstale":"2024-04-19T03:39:37.391598+0000","last_undegraded":"2024-04-19T03:39:37.391598+0000","last_fullsized":"2024-04-19T03:39:37.391598+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:57:38.017118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2067,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390061+0000","last_change":"2024-04-19T03:39:32.401634+0000","last_active":"2024-04-19T03:39:37.390061+0000","last_peered":"2024-04-19T03:39:37.390061+0000","last_clean":"2024-04-19T03:39:37.390061+0000","last_became_active":"2024-04-19T03:39:32.398779+0000","last_became_peered":"2024-04-19T03:39:32.398779+0000","last_unstale":"2024-04-19T03:39:37.390061+0000","last_undegraded":"2024-04-19T03:39:37.390061+0000","last_fullsized":"2024-04-19T03:39:37.390061+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:42.670329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390983+0000","last_change":"2024-04-19T03:39:32.395971+0000","last_active":"2024-04-19T03:39:37.390983+0000","last_peered":"2024-04-19T03:39:37.390983+0000","last_clean":"2024-04-19T03:39:37.390983+0000","last_became_active":"2024-04-19T03:39:32.395700+0000","last_became_peered":"2024-04-19T03:39:32.395700+0000","last_unstale":"2024-04-19T03:39:37.390983+0000","last_undegraded":"2024-04-19T03:39:37.390983+0000","last_fullsized":"2024-04-19T03:39:37.390983+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:56:26.477882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421316+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:42.421316+0000","last_peered":"2024-04-19T03:39:42.421316+0000","last_clean":"2024-04-19T03:39:42.421316+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:42.421316+0000","last_undegraded":"2024-04-19T03:39:42.421316+0000","last_fullsized":"2024-04-19T03:39:42.421316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421232+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:42.421232+0000","last_peered":"2024-04-19T03:39:42.421232+0000","last_clean":"2024-04-19T03:39:42.421232+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:42.421232+0000","last_undegraded":"2024-04-19T03:39:42.421232+0000","last_fullsized":"2024-04-19T03:39:42.421232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2094,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390678+0000","last_change":"2024-04-19T03:39:32.399496+0000","last_active":"2024-04-19T03:39:37.390678+0000","last_peered":"2024-04-19T03:39:37.390678+0000","last_clean":"2024-04-19T03:39:37.390678+0000","last_became_active":"2024-04-19T03:39:32.398117+0000","last_became_peered":"2024-04-19T03:39:32.398117+0000","last_unstale":"2024-04-19T03:39:37.390678+0000","last_undegraded":"2024-04-19T03:39:37.390678+0000","last_fullsized":"2024-04-19T03:39:37.390678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:05.987207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390258+0000","last_change":"2024-04-19T03:39:32.394935+0000","last_active":"2024-04-19T03:39:37.390258+0000","last_peered":"2024-04-19T03:39:37.390258+0000","last_clean":"2024-04-19T03:39:37.390258+0000","last_became_active":"2024-04-19T03:39:32.394624+0000","last_became_peered":"2024-04-19T03:39:32.394624+0000","last_unstale":"2024-04-19T03:39:37.390258+0000","last_undegraded":"2024-04-19T03:39:37.390258+0000","last_fullsized":"2024-04-19T03:39:37.390258+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:11.842559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391395+0000","last_change":"2024-04-19T03:39:32.396066+0000","last_active":"2024-04-19T03:39:37.391395+0000","last_peered":"2024-04-19T03:39:37.391395+0000","last_clean":"2024-04-19T03:39:37.391395+0000","last_became_active":"2024-04-19T03:39:32.394630+0000","last_became_peered":"2024-04-19T03:39:32.394630+0000","last_unstale":"2024-04-19T03:39:37.391395+0000","last_undegraded":"2024-04-19T03:39:37.391395+0000","last_fullsized":"2024-04-19T03:39:37.391395+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412529+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:41.412529+0000","last_peered":"2024-04-19T03:39:41.412529+0000","last_clean":"2024-04-19T03:39:41.412529+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:41.412529+0000","last_undegraded":"2024-04-19T03:39:41.412529+0000","last_fullsized":"2024-04-19T03:39:41.412529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391415+0000","last_change":"2024-04-19T03:39:32.395663+0000","last_active":"2024-04-19T03:39:37.391415+0000","last_peered":"2024-04-19T03:39:37.391415+0000","last_clean":"2024-04-19T03:39:37.391415+0000","last_became_active":"2024-04-19T03:39:32.394303+0000","last_became_peered":"2024-04-19T03:39:32.394303+0000","last_unstale":"2024-04-19T03:39:37.391415+0000","last_undegraded":"2024-04-19T03:39:37.391415+0000","last_fullsized":"2024-04-19T03:39:37.391415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:42.996316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412603+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:41.412603+0000","last_peered":"2024-04-19T03:39:41.412603+0000","last_clean":"2024-04-19T03:39:41.412603+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:41.412603+0000","last_undegraded":"2024-04-19T03:39:41.412603+0000","last_fullsized":"2024-04-19T03:39:41.412603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6118,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420024+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:42.420024+0000","last_peered":"2024-04-19T03:39:42.420024+0000","last_clean":"2024-04-19T03:39:42.420024+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:42.420024+0000","last_undegraded":"2024-04-19T03:39:42.420024+0000","last_fullsized":"2024-04-19T03:39:42.420024+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419894+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:42.419894+0000","last_peered":"2024-04-19T03:39:42.419894+0000","last_clean":"2024-04-19T03:39:42.419894+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:42.419894+0000","last_undegraded":"2024-04-19T03:39:42.419894+0000","last_fullsized":"2024-04-19T03:39:42.419894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413757+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:41.413757+0000","last_peered":"2024-04-19T03:39:41.413757+0000","last_clean":"2024-04-19T03:39:41.413757+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:41.413757+0000","last_undegraded":"2024-04-19T03:39:41.413757+0000","last_fullsized":"2024-04-19T03:39:41.413757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420461+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:42.420461+0000","last_peered":"2024-04-19T03:39:42.420461+0000","last_clean":"2024-04-19T03:39:42.420461+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:42.420461+0000","last_undegraded":"2024-04-19T03:39:42.420461+0000","last_fullsized":"2024-04-19T03:39:42.420461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413236+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:41.413236+0000","last_peered":"2024-04-19T03:39:41.413236+0000","last_clean":"2024-04-19T03:39:41.413236+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:41.413236+0000","last_undegraded":"2024-04-19T03:39:41.413236+0000","last_fullsized":"2024-04-19T03:39:41.413236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":114,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418792+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:42.418792+0000","last_peered":"2024-04-19T03:39:42.418792+0000","last_clean":"2024-04-19T03:39:42.418792+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:42.418792+0000","last_undegraded":"2024-04-19T03:39:42.418792+0000","last_fullsized":"2024-04-19T03:39:42.418792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412749+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:41.412749+0000","last_peered":"2024-04-19T03:39:41.412749+0000","last_clean":"2024-04-19T03:39:41.412749+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:41.412749+0000","last_undegraded":"2024-04-19T03:39:41.412749+0000","last_fullsized":"2024-04-19T03:39:41.412749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420618+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:42.420618+0000","last_peered":"2024-04-19T03:39:42.420618+0000","last_clean":"2024-04-19T03:39:42.420618+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:42.420618+0000","last_undegraded":"2024-04-19T03:39:42.420618+0000","last_fullsized":"2024-04-19T03:39:42.420618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":277,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.395654+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.395086+0000","last_became_peered":"2024-04-19T03:39:32.395086+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:15.390971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":112,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417330+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:42.417330+0000","last_peered":"2024-04-19T03:39:42.417330+0000","last_clean":"2024-04-19T03:39:42.417330+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:42.417330+0000","last_undegraded":"2024-04-19T03:39:42.417330+0000","last_fullsized":"2024-04-19T03:39:42.417330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8088,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413659+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:41.413659+0000","last_peered":"2024-04-19T03:39:41.413659+0000","last_clean":"2024-04-19T03:39:41.413659+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:41.413659+0000","last_undegraded":"2024-04-19T03:39:41.413659+0000","last_fullsized":"2024-04-19T03:39:41.413659+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390307+0000","last_change":"2024-04-19T03:39:32.399167+0000","last_active":"2024-04-19T03:39:37.390307+0000","last_peered":"2024-04-19T03:39:37.390307+0000","last_clean":"2024-04-19T03:39:37.390307+0000","last_became_active":"2024-04-19T03:39:32.398584+0000","last_became_peered":"2024-04-19T03:39:32.398584+0000","last_unstale":"2024-04-19T03:39:37.390307+0000","last_undegraded":"2024-04-19T03:39:37.390307+0000","last_fullsized":"2024-04-19T03:39:37.390307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:43.337624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412475+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:41.412475+0000","last_peered":"2024-04-19T03:39:41.412475+0000","last_clean":"2024-04-19T03:39:41.412475+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:41.412475+0000","last_undegraded":"2024-04-19T03:39:41.412475+0000","last_fullsized":"2024-04-19T03:39:41.412475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420399+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:42.420399+0000","last_peered":"2024-04-19T03:39:42.420399+0000","last_clean":"2024-04-19T03:39:42.420399+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:42.420399+0000","last_undegraded":"2024-04-19T03:39:42.420399+0000","last_fullsized":"2024-04-19T03:39:42.420399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390450+0000","last_change":"2024-04-19T03:39:32.393622+0000","last_active":"2024-04-19T03:39:37.390450+0000","last_peered":"2024-04-19T03:39:37.390450+0000","last_clean":"2024-04-19T03:39:37.390450+0000","last_became_active":"2024-04-19T03:39:32.393342+0000","last_became_peered":"2024-04-19T03:39:32.393342+0000","last_unstale":"2024-04-19T03:39:37.390450+0000","last_undegraded":"2024-04-19T03:39:37.390450+0000","last_fullsized":"2024-04-19T03:39:37.390450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:42.742836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419973+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:42.419973+0000","last_peered":"2024-04-19T03:39:42.419973+0000","last_clean":"2024-04-19T03:39:42.419973+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:42.419973+0000","last_undegraded":"2024-04-19T03:39:42.419973+0000","last_fullsized":"2024-04-19T03:39:42.419973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391314+0000","last_change":"2024-04-19T03:39:32.395946+0000","last_active":"2024-04-19T03:39:37.391314+0000","last_peered":"2024-04-19T03:39:37.391314+0000","last_clean":"2024-04-19T03:39:37.391314+0000","last_became_active":"2024-04-19T03:39:32.395348+0000","last_became_peered":"2024-04-19T03:39:32.395348+0000","last_unstale":"2024-04-19T03:39:37.391314+0000","last_undegraded":"2024-04-19T03:39:37.391314+0000","last_fullsized":"2024-04-19T03:39:37.391314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:41.036403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412623+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:41.412623+0000","last_peered":"2024-04-19T03:39:41.412623+0000","last_clean":"2024-04-19T03:39:41.412623+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:41.412623+0000","last_undegraded":"2024-04-19T03:39:41.412623+0000","last_fullsized":"2024-04-19T03:39:41.412623+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390632+0000","last_change":"2024-04-19T03:39:32.396079+0000","last_active":"2024-04-19T03:39:37.390632+0000","last_peered":"2024-04-19T03:39:37.390632+0000","last_clean":"2024-04-19T03:39:37.390632+0000","last_became_active":"2024-04-19T03:39:32.395721+0000","last_became_peered":"2024-04-19T03:39:32.395721+0000","last_unstale":"2024-04-19T03:39:37.390632+0000","last_undegraded":"2024-04-19T03:39:37.390632+0000","last_fullsized":"2024-04-19T03:39:37.390632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:08.221132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":96,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421710+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:42.421710+0000","last_peered":"2024-04-19T03:39:42.421710+0000","last_clean":"2024-04-19T03:39:42.421710+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:42.421710+0000","last_undegraded":"2024-04-19T03:39:42.421710+0000","last_fullsized":"2024-04-19T03:39:42.421710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413384+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:41.413384+0000","last_peered":"2024-04-19T03:39:41.413384+0000","last_clean":"2024-04-19T03:39:41.413384+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:41.413384+0000","last_undegraded":"2024-04-19T03:39:41.413384+0000","last_fullsized":"2024-04-19T03:39:41.413384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421814+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:42.421814+0000","last_peered":"2024-04-19T03:39:42.421814+0000","last_clean":"2024-04-19T03:39:42.421814+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:42.421814+0000","last_undegraded":"2024-04-19T03:39:42.421814+0000","last_fullsized":"2024-04-19T03:39:42.421814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2065,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413134+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:41.413134+0000","last_peered":"2024-04-19T03:39:41.413134+0000","last_clean":"2024-04-19T03:39:41.413134+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:41.413134+0000","last_undegraded":"2024-04-19T03:39:41.413134+0000","last_fullsized":"2024-04-19T03:39:41.413134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391794+0000","last_change":"2024-04-19T03:39:32.394854+0000","last_active":"2024-04-19T03:39:37.391794+0000","last_peered":"2024-04-19T03:39:37.391794+0000","last_clean":"2024-04-19T03:39:37.391794+0000","last_became_active":"2024-04-19T03:39:32.394482+0000","last_became_peered":"2024-04-19T03:39:32.394482+0000","last_unstale":"2024-04-19T03:39:37.391794+0000","last_undegraded":"2024-04-19T03:39:37.391794+0000","last_fullsized":"2024-04-19T03:39:37.391794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:16.631854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390884+0000","last_change":"2024-04-19T03:39:32.400848+0000","last_active":"2024-04-19T03:39:37.390884+0000","last_peered":"2024-04-19T03:39:37.390884+0000","last_clean":"2024-04-19T03:39:37.390884+0000","last_became_active":"2024-04-19T03:39:32.400572+0000","last_became_peered":"2024-04-19T03:39:32.400572+0000","last_unstale":"2024-04-19T03:39:37.390884+0000","last_undegraded":"2024-04-19T03:39:37.390884+0000","last_fullsized":"2024-04-19T03:39:37.390884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:28.052247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412986+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:41.412986+0000","last_peered":"2024-04-19T03:39:41.412986+0000","last_clean":"2024-04-19T03:39:41.412986+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:41.412986+0000","last_undegraded":"2024-04-19T03:39:41.412986+0000","last_fullsized":"2024-04-19T03:39:41.412986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413041+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:41.413041+0000","last_peered":"2024-04-19T03:39:41.413041+0000","last_clean":"2024-04-19T03:39:41.413041+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:41.413041+0000","last_undegraded":"2024-04-19T03:39:41.413041+0000","last_fullsized":"2024-04-19T03:39:41.413041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413409+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:41.413409+0000","last_peered":"2024-04-19T03:39:41.413409+0000","last_clean":"2024-04-19T03:39:41.413409+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:41.413409+0000","last_undegraded":"2024-04-19T03:39:41.413409+0000","last_fullsized":"2024-04-19T03:39:41.413409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390723+0000","last_change":"2024-04-19T03:39:32.400398+0000","last_active":"2024-04-19T03:39:37.390723+0000","last_peered":"2024-04-19T03:39:37.390723+0000","last_clean":"2024-04-19T03:39:37.390723+0000","last_became_active":"2024-04-19T03:39:32.399453+0000","last_became_peered":"2024-04-19T03:39:32.399453+0000","last_unstale":"2024-04-19T03:39:37.390723+0000","last_undegraded":"2024-04-19T03:39:37.390723+0000","last_fullsized":"2024-04-19T03:39:37.390723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:47.765222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2086,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390416+0000","last_change":"2024-04-19T03:39:32.399370+0000","last_active":"2024-04-19T03:39:37.390416+0000","last_peered":"2024-04-19T03:39:37.390416+0000","last_clean":"2024-04-19T03:39:37.390416+0000","last_became_active":"2024-04-19T03:39:32.398094+0000","last_became_peered":"2024-04-19T03:39:32.398094+0000","last_unstale":"2024-04-19T03:39:37.390416+0000","last_undegraded":"2024-04-19T03:39:37.390416+0000","last_fullsized":"2024-04-19T03:39:37.390416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:58.061381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413825+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:41.413825+0000","last_peered":"2024-04-19T03:39:41.413825+0000","last_clean":"2024-04-19T03:39:41.413825+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:41.413825+0000","last_undegraded":"2024-04-19T03:39:41.413825+0000","last_fullsized":"2024-04-19T03:39:41.413825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":82,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390122+0000","last_change":"2024-04-19T03:39:32.399381+0000","last_active":"2024-04-19T03:39:37.390122+0000","last_peered":"2024-04-19T03:39:37.390122+0000","last_clean":"2024-04-19T03:39:37.390122+0000","last_became_active":"2024-04-19T03:39:32.398858+0000","last_became_peered":"2024-04-19T03:39:32.398858+0000","last_unstale":"2024-04-19T03:39:37.390122+0000","last_undegraded":"2024-04-19T03:39:37.390122+0000","last_fullsized":"2024-04-19T03:39:37.390122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:27.528014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419060+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:42.419060+0000","last_peered":"2024-04-19T03:39:42.419060+0000","last_clean":"2024-04-19T03:39:42.419060+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:42.419060+0000","last_undegraded":"2024-04-19T03:39:42.419060+0000","last_fullsized":"2024-04-19T03:39:42.419060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412882+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:41.412882+0000","last_peered":"2024-04-19T03:39:41.412882+0000","last_clean":"2024-04-19T03:39:41.412882+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:41.412882+0000","last_undegraded":"2024-04-19T03:39:41.412882+0000","last_fullsized":"2024-04-19T03:39:41.412882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420189+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:42.420189+0000","last_peered":"2024-04-19T03:39:42.420189+0000","last_clean":"2024-04-19T03:39:42.420189+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:42.420189+0000","last_undegraded":"2024-04-19T03:39:42.420189+0000","last_fullsized":"2024-04-19T03:39:42.420189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2135,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390302+0000","last_change":"2024-04-19T03:39:32.402322+0000","last_active":"2024-04-19T03:39:37.390302+0000","last_peered":"2024-04-19T03:39:37.390302+0000","last_clean":"2024-04-19T03:39:37.390302+0000","last_became_active":"2024-04-19T03:39:32.401133+0000","last_became_peered":"2024-04-19T03:39:32.401133+0000","last_unstale":"2024-04-19T03:39:37.390302+0000","last_undegraded":"2024-04-19T03:39:37.390302+0000","last_fullsized":"2024-04-19T03:39:37.390302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:33:33.557434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389840+0000","last_change":"2024-04-19T03:39:32.401135+0000","last_active":"2024-04-19T03:39:37.389840+0000","last_peered":"2024-04-19T03:39:37.389840+0000","last_clean":"2024-04-19T03:39:37.389840+0000","last_became_active":"2024-04-19T03:39:32.400869+0000","last_became_peered":"2024-04-19T03:39:32.400869+0000","last_unstale":"2024-04-19T03:39:37.389840+0000","last_undegraded":"2024-04-19T03:39:37.389840+0000","last_fullsized":"2024-04-19T03:39:37.389840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:06.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":99,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417609+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:42.417609+0000","last_peered":"2024-04-19T03:39:42.417609+0000","last_clean":"2024-04-19T03:39:42.417609+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:42.417609+0000","last_undegraded":"2024-04-19T03:39:42.417609+0000","last_fullsized":"2024-04-19T03:39:42.417609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2087,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413001+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:41.413001+0000","last_peered":"2024-04-19T03:39:41.413001+0000","last_clean":"2024-04-19T03:39:41.413001+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:41.413001+0000","last_undegraded":"2024-04-19T03:39:41.413001+0000","last_fullsized":"2024-04-19T03:39:41.413001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421424+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:42.421424+0000","last_peered":"2024-04-19T03:39:42.421424+0000","last_clean":"2024-04-19T03:39:42.421424+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:42.421424+0000","last_undegraded":"2024-04-19T03:39:42.421424+0000","last_fullsized":"2024-04-19T03:39:42.421424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413465+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:41.413465+0000","last_peered":"2024-04-19T03:39:41.413465+0000","last_clean":"2024-04-19T03:39:41.413465+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:41.413465+0000","last_undegraded":"2024-04-19T03:39:41.413465+0000","last_fullsized":"2024-04-19T03:39:41.413465+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481799,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1644,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1683456,"data_stored":1254158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369836,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002004,"statfs":{"total":96636764160,"available":96258052096,"internally_reserved":0,"allocated":1671168,"data_stored":1252936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":782336,"data_stored":378148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:45.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:46.133 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:46.147 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-04-19T03:39:44.335547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795892,"kb_used_data":4040,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319628,"statfs":{"total":289910292480,"available":289095299072,"internally_reserved":0,"allocated":4136960,"data_stored":2885242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000806"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2066,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413844+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:41.413844+0000","last_peered":"2024-04-19T03:39:41.413844+0000","last_clean":"2024-04-19T03:39:41.413844+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:41.413844+0000","last_undegraded":"2024-04-19T03:39:41.413844+0000","last_fullsized":"2024-04-19T03:39:41.413844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413352+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:41.413352+0000","last_peered":"2024-04-19T03:39:41.413352+0000","last_clean":"2024-04-19T03:39:41.413352+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:41.413352+0000","last_undegraded":"2024-04-19T03:39:41.413352+0000","last_fullsized":"2024-04-19T03:39:41.413352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4081,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391168+0000","last_change":"2024-04-19T03:39:32.399459+0000","last_active":"2024-04-19T03:39:37.391168+0000","last_peered":"2024-04-19T03:39:37.391168+0000","last_clean":"2024-04-19T03:39:37.391168+0000","last_became_active":"2024-04-19T03:39:32.397753+0000","last_became_peered":"2024-04-19T03:39:32.397753+0000","last_unstale":"2024-04-19T03:39:37.391168+0000","last_undegraded":"2024-04-19T03:39:37.391168+0000","last_fullsized":"2024-04-19T03:39:37.391168+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:54.322202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390587+0000","last_change":"2024-04-19T03:39:32.400611+0000","last_active":"2024-04-19T03:39:37.390587+0000","last_peered":"2024-04-19T03:39:37.390587+0000","last_clean":"2024-04-19T03:39:37.390587+0000","last_became_active":"2024-04-19T03:39:32.399743+0000","last_became_peered":"2024-04-19T03:39:32.399743+0000","last_unstale":"2024-04-19T03:39:37.390587+0000","last_undegraded":"2024-04-19T03:39:37.390587+0000","last_fullsized":"2024-04-19T03:39:37.390587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:40:42.830458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413052+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:41.413052+0000","last_peered":"2024-04-19T03:39:41.413052+0000","last_clean":"2024-04-19T03:39:41.413052+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:41.413052+0000","last_undegraded":"2024-04-19T03:39:41.413052+0000","last_fullsized":"2024-04-19T03:39:41.413052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":81,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390192+0000","last_change":"2024-04-19T03:39:32.398542+0000","last_active":"2024-04-19T03:39:37.390192+0000","last_peered":"2024-04-19T03:39:37.390192+0000","last_clean":"2024-04-19T03:39:37.390192+0000","last_became_active":"2024-04-19T03:39:32.398227+0000","last_became_peered":"2024-04-19T03:39:32.398227+0000","last_unstale":"2024-04-19T03:39:37.390192+0000","last_undegraded":"2024-04-19T03:39:37.390192+0000","last_fullsized":"2024-04-19T03:39:37.390192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:10:16.307090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390010+0000","last_change":"2024-04-19T03:39:32.396074+0000","last_active":"2024-04-19T03:39:37.390010+0000","last_peered":"2024-04-19T03:39:37.390010+0000","last_clean":"2024-04-19T03:39:37.390010+0000","last_became_active":"2024-04-19T03:39:32.395729+0000","last_became_peered":"2024-04-19T03:39:32.395729+0000","last_unstale":"2024-04-19T03:39:37.390010+0000","last_undegraded":"2024-04-19T03:39:37.390010+0000","last_fullsized":"2024-04-19T03:39:37.390010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:29.445916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389883+0000","last_change":"2024-04-19T03:39:32.400603+0000","last_active":"2024-04-19T03:39:37.389883+0000","last_peered":"2024-04-19T03:39:37.389883+0000","last_clean":"2024-04-19T03:39:37.389883+0000","last_became_active":"2024-04-19T03:39:32.397995+0000","last_became_peered":"2024-04-19T03:39:32.397995+0000","last_unstale":"2024-04-19T03:39:37.389883+0000","last_undegraded":"2024-04-19T03:39:37.389883+0000","last_fullsized":"2024-04-19T03:39:37.389883+0000","mapping_epoch":85,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:57.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6161,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418326+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:42.418326+0000","last_peered":"2024-04-19T03:39:42.418326+0000","last_clean":"2024-04-19T03:39:42.418326+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:42.418326+0000","last_undegraded":"2024-04-19T03:39:42.418326+0000","last_fullsized":"2024-04-19T03:39:42.418326+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413649+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:41.413649+0000","last_peered":"2024-04-19T03:39:41.413649+0000","last_clean":"2024-04-19T03:39:41.413649+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:41.413649+0000","last_undegraded":"2024-04-19T03:39:41.413649+0000","last_fullsized":"2024-04-19T03:39:41.413649+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4027,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390781+0000","last_change":"2024-04-19T03:39:32.400179+0000","last_active":"2024-04-19T03:39:37.390781+0000","last_peered":"2024-04-19T03:39:37.390781+0000","last_clean":"2024-04-19T03:39:37.390781+0000","last_became_active":"2024-04-19T03:39:32.397994+0000","last_became_peered":"2024-04-19T03:39:32.397994+0000","last_unstale":"2024-04-19T03:39:37.390781+0000","last_undegraded":"2024-04-19T03:39:37.390781+0000","last_fullsized":"2024-04-19T03:39:37.390781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:33.299512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413111+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:41.413111+0000","last_peered":"2024-04-19T03:39:41.413111+0000","last_clean":"2024-04-19T03:39:41.413111+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:41.413111+0000","last_undegraded":"2024-04-19T03:39:41.413111+0000","last_fullsized":"2024-04-19T03:39:41.413111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2079,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412862+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:41.412862+0000","last_peered":"2024-04-19T03:39:41.412862+0000","last_clean":"2024-04-19T03:39:41.412862+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:41.412862+0000","last_undegraded":"2024-04-19T03:39:41.412862+0000","last_fullsized":"2024-04-19T03:39:41.412862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390697+0000","last_change":"2024-04-19T03:39:32.395332+0000","last_active":"2024-04-19T03:39:37.390697+0000","last_peered":"2024-04-19T03:39:37.390697+0000","last_clean":"2024-04-19T03:39:37.390697+0000","last_became_active":"2024-04-19T03:39:32.392604+0000","last_became_peered":"2024-04-19T03:39:32.392604+0000","last_unstale":"2024-04-19T03:39:37.390697+0000","last_undegraded":"2024-04-19T03:39:37.390697+0000","last_fullsized":"2024-04-19T03:39:37.390697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:12.846842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2111,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390584+0000","last_change":"2024-04-19T03:39:32.395011+0000","last_active":"2024-04-19T03:39:37.390584+0000","last_peered":"2024-04-19T03:39:37.390584+0000","last_clean":"2024-04-19T03:39:37.390584+0000","last_became_active":"2024-04-19T03:39:32.392633+0000","last_became_peered":"2024-04-19T03:39:32.392633+0000","last_unstale":"2024-04-19T03:39:37.390584+0000","last_undegraded":"2024-04-19T03:39:37.390584+0000","last_fullsized":"2024-04-19T03:39:37.390584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:56.349038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2088,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389956+0000","last_change":"2024-04-19T03:39:32.396919+0000","last_active":"2024-04-19T03:39:37.389956+0000","last_peered":"2024-04-19T03:39:37.389956+0000","last_clean":"2024-04-19T03:39:37.389956+0000","last_became_active":"2024-04-19T03:39:32.395719+0000","last_became_peered":"2024-04-19T03:39:32.395719+0000","last_unstale":"2024-04-19T03:39:37.389956+0000","last_undegraded":"2024-04-19T03:39:37.389956+0000","last_fullsized":"2024-04-19T03:39:37.389956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:08.092382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419797+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:42.419797+0000","last_peered":"2024-04-19T03:39:42.419797+0000","last_clean":"2024-04-19T03:39:42.419797+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:42.419797+0000","last_undegraded":"2024-04-19T03:39:42.419797+0000","last_fullsized":"2024-04-19T03:39:42.419797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413507+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:41.413507+0000","last_peered":"2024-04-19T03:39:41.413507+0000","last_clean":"2024-04-19T03:39:41.413507+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:41.413507+0000","last_undegraded":"2024-04-19T03:39:41.413507+0000","last_fullsized":"2024-04-19T03:39:41.413507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4139,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419233+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:42.419233+0000","last_peered":"2024-04-19T03:39:42.419233+0000","last_clean":"2024-04-19T03:39:42.419233+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:42.419233+0000","last_undegraded":"2024-04-19T03:39:42.419233+0000","last_fullsized":"2024-04-19T03:39:42.419233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390528+0000","last_change":"2024-04-19T03:39:32.401641+0000","last_active":"2024-04-19T03:39:37.390528+0000","last_peered":"2024-04-19T03:39:37.390528+0000","last_clean":"2024-04-19T03:39:37.390528+0000","last_became_active":"2024-04-19T03:39:32.399814+0000","last_became_peered":"2024-04-19T03:39:32.399814+0000","last_unstale":"2024-04-19T03:39:37.390528+0000","last_undegraded":"2024-04-19T03:39:37.390528+0000","last_fullsized":"2024-04-19T03:39:37.390528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:40.327326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390386+0000","last_change":"2024-04-19T03:39:32.400170+0000","last_active":"2024-04-19T03:39:37.390386+0000","last_peered":"2024-04-19T03:39:37.390386+0000","last_clean":"2024-04-19T03:39:37.390386+0000","last_became_active":"2024-04-19T03:39:32.399694+0000","last_became_peered":"2024-04-19T03:39:32.399694+0000","last_unstale":"2024-04-19T03:39:37.390386+0000","last_undegraded":"2024-04-19T03:39:37.390386+0000","last_fullsized":"2024-04-19T03:39:37.390386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:18.828239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412798+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:41.412798+0000","last_peered":"2024-04-19T03:39:41.412798+0000","last_clean":"2024-04-19T03:39:41.412798+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:41.412798+0000","last_undegraded":"2024-04-19T03:39:41.412798+0000","last_fullsized":"2024-04-19T03:39:41.412798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2155,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418161+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:42.418161+0000","last_peered":"2024-04-19T03:39:42.418161+0000","last_clean":"2024-04-19T03:39:42.418161+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:42.418161+0000","last_undegraded":"2024-04-19T03:39:42.418161+0000","last_fullsized":"2024-04-19T03:39:42.418161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412776+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:41.412776+0000","last_peered":"2024-04-19T03:39:41.412776+0000","last_clean":"2024-04-19T03:39:41.412776+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:41.412776+0000","last_undegraded":"2024-04-19T03:39:41.412776+0000","last_fullsized":"2024-04-19T03:39:41.412776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2094,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413817+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:41.413817+0000","last_peered":"2024-04-19T03:39:41.413817+0000","last_clean":"2024-04-19T03:39:41.413817+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:41.413817+0000","last_undegraded":"2024-04-19T03:39:41.413817+0000","last_fullsized":"2024-04-19T03:39:41.413817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419868+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:42.419868+0000","last_peered":"2024-04-19T03:39:42.419868+0000","last_clean":"2024-04-19T03:39:42.419868+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:42.419868+0000","last_undegraded":"2024-04-19T03:39:42.419868+0000","last_fullsized":"2024-04-19T03:39:42.419868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391435+0000","last_change":"2024-04-19T03:39:32.397511+0000","last_active":"2024-04-19T03:39:37.391435+0000","last_peered":"2024-04-19T03:39:37.391435+0000","last_clean":"2024-04-19T03:39:37.391435+0000","last_became_active":"2024-04-19T03:39:32.396369+0000","last_became_peered":"2024-04-19T03:39:32.396369+0000","last_unstale":"2024-04-19T03:39:37.391435+0000","last_undegraded":"2024-04-19T03:39:37.391435+0000","last_fullsized":"2024-04-19T03:39:37.391435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:02:22.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412750+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:41.412750+0000","last_peered":"2024-04-19T03:39:41.412750+0000","last_clean":"2024-04-19T03:39:41.412750+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:41.412750+0000","last_undegraded":"2024-04-19T03:39:41.412750+0000","last_fullsized":"2024-04-19T03:39:41.412750+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413799+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:41.413799+0000","last_peered":"2024-04-19T03:39:41.413799+0000","last_clean":"2024-04-19T03:39:41.413799+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:41.413799+0000","last_undegraded":"2024-04-19T03:39:41.413799+0000","last_fullsized":"2024-04-19T03:39:41.413799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418408+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:42.418408+0000","last_peered":"2024-04-19T03:39:42.418408+0000","last_clean":"2024-04-19T03:39:42.418408+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:42.418408+0000","last_undegraded":"2024-04-19T03:39:42.418408+0000","last_fullsized":"2024-04-19T03:39:42.418408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418928+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:42.418928+0000","last_peered":"2024-04-19T03:39:42.418928+0000","last_clean":"2024-04-19T03:39:42.418928+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:42.418928+0000","last_undegraded":"2024-04-19T03:39:42.418928+0000","last_fullsized":"2024-04-19T03:39:42.418928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420339+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:42.420339+0000","last_peered":"2024-04-19T03:39:42.420339+0000","last_clean":"2024-04-19T03:39:42.420339+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:42.420339+0000","last_undegraded":"2024-04-19T03:39:42.420339+0000","last_fullsized":"2024-04-19T03:39:42.420339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413707+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:41.413707+0000","last_peered":"2024-04-19T03:39:41.413707+0000","last_clean":"2024-04-19T03:39:41.413707+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:41.413707+0000","last_undegraded":"2024-04-19T03:39:41.413707+0000","last_fullsized":"2024-04-19T03:39:41.413707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420283+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:42.420283+0000","last_peered":"2024-04-19T03:39:42.420283+0000","last_clean":"2024-04-19T03:39:42.420283+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:42.420283+0000","last_undegraded":"2024-04-19T03:39:42.420283+0000","last_fullsized":"2024-04-19T03:39:42.420283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420113+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:42.420113+0000","last_peered":"2024-04-19T03:39:42.420113+0000","last_clean":"2024-04-19T03:39:42.420113+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:42.420113+0000","last_undegraded":"2024-04-19T03:39:42.420113+0000","last_fullsized":"2024-04-19T03:39:42.420113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.400643+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.398090+0000","last_became_peered":"2024-04-19T03:39:32.398090+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:12:38.136122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418025+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:42.418025+0000","last_peered":"2024-04-19T03:39:42.418025+0000","last_clean":"2024-04-19T03:39:42.418025+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:42.418025+0000","last_undegraded":"2024-04-19T03:39:42.418025+0000","last_fullsized":"2024-04-19T03:39:42.418025+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413667+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:41.413667+0000","last_peered":"2024-04-19T03:39:41.413667+0000","last_clean":"2024-04-19T03:39:41.413667+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:41.413667+0000","last_undegraded":"2024-04-19T03:39:41.413667+0000","last_fullsized":"2024-04-19T03:39:41.413667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4150,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420052+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:42.420052+0000","last_peered":"2024-04-19T03:39:42.420052+0000","last_clean":"2024-04-19T03:39:42.420052+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:42.420052+0000","last_undegraded":"2024-04-19T03:39:42.420052+0000","last_fullsized":"2024-04-19T03:39:42.420052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":180,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391107+0000","last_change":"2024-04-19T03:39:32.394904+0000","last_active":"2024-04-19T03:39:37.391107+0000","last_peered":"2024-04-19T03:39:37.391107+0000","last_clean":"2024-04-19T03:39:37.391107+0000","last_became_active":"2024-04-19T03:39:32.394518+0000","last_became_peered":"2024-04-19T03:39:32.394518+0000","last_unstale":"2024-04-19T03:39:37.391107+0000","last_undegraded":"2024-04-19T03:39:37.391107+0000","last_fullsized":"2024-04-19T03:39:37.391107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:49.767040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4171,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390892+0000","last_change":"2024-04-19T03:39:32.395658+0000","last_active":"2024-04-19T03:39:37.390892+0000","last_peered":"2024-04-19T03:39:37.390892+0000","last_clean":"2024-04-19T03:39:37.390892+0000","last_became_active":"2024-04-19T03:39:32.393165+0000","last_became_peered":"2024-04-19T03:39:32.393165+0000","last_unstale":"2024-04-19T03:39:37.390892+0000","last_undegraded":"2024-04-19T03:39:37.390892+0000","last_fullsized":"2024-04-19T03:39:37.390892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:09.225415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390506+0000","last_change":"2024-04-19T03:39:32.400220+0000","last_active":"2024-04-19T03:39:37.390506+0000","last_peered":"2024-04-19T03:39:37.390506+0000","last_clean":"2024-04-19T03:39:37.390506+0000","last_became_active":"2024-04-19T03:39:32.399717+0000","last_became_peered":"2024-04-19T03:39:32.399717+0000","last_unstale":"2024-04-19T03:39:37.390506+0000","last_undegraded":"2024-04-19T03:39:37.390506+0000","last_fullsized":"2024-04-19T03:39:37.390506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:01.543694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2062,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413157+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:41.413157+0000","last_peered":"2024-04-19T03:39:41.413157+0000","last_clean":"2024-04-19T03:39:41.413157+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:41.413157+0000","last_undegraded":"2024-04-19T03:39:41.413157+0000","last_fullsized":"2024-04-19T03:39:41.413157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419933+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:42.419933+0000","last_peered":"2024-04-19T03:39:42.419933+0000","last_clean":"2024-04-19T03:39:42.419933+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:42.419933+0000","last_undegraded":"2024-04-19T03:39:42.419933+0000","last_fullsized":"2024-04-19T03:39:42.419933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413927+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:41.413927+0000","last_peered":"2024-04-19T03:39:41.413927+0000","last_clean":"2024-04-19T03:39:41.413927+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:41.413927+0000","last_undegraded":"2024-04-19T03:39:41.413927+0000","last_fullsized":"2024-04-19T03:39:41.413927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412670+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:41.412670+0000","last_peered":"2024-04-19T03:39:41.412670+0000","last_clean":"2024-04-19T03:39:41.412670+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:41.412670+0000","last_undegraded":"2024-04-19T03:39:41.412670+0000","last_fullsized":"2024-04-19T03:39:41.412670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":110,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419704+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:42.419704+0000","last_peered":"2024-04-19T03:39:42.419704+0000","last_clean":"2024-04-19T03:39:42.419704+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:42.419704+0000","last_undegraded":"2024-04-19T03:39:42.419704+0000","last_fullsized":"2024-04-19T03:39:42.419704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390748+0000","last_change":"2024-04-19T03:39:32.395496+0000","last_active":"2024-04-19T03:39:37.390748+0000","last_peered":"2024-04-19T03:39:37.390748+0000","last_clean":"2024-04-19T03:39:37.390748+0000","last_became_active":"2024-04-19T03:39:32.394631+0000","last_became_peered":"2024-04-19T03:39:32.394631+0000","last_unstale":"2024-04-19T03:39:37.390748+0000","last_undegraded":"2024-04-19T03:39:37.390748+0000","last_fullsized":"2024-04-19T03:39:37.390748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:10.062803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2206,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420401+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:42.420401+0000","last_peered":"2024-04-19T03:39:42.420401+0000","last_clean":"2024-04-19T03:39:42.420401+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:42.420401+0000","last_undegraded":"2024-04-19T03:39:42.420401+0000","last_fullsized":"2024-04-19T03:39:42.420401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391714+0000","last_change":"2024-04-19T03:39:32.396659+0000","last_active":"2024-04-19T03:39:37.391714+0000","last_peered":"2024-04-19T03:39:37.391714+0000","last_clean":"2024-04-19T03:39:37.391714+0000","last_became_active":"2024-04-19T03:39:32.396285+0000","last_became_peered":"2024-04-19T03:39:32.396285+0000","last_unstale":"2024-04-19T03:39:37.391714+0000","last_undegraded":"2024-04-19T03:39:37.391714+0000","last_fullsized":"2024-04-19T03:39:37.391714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:04.132840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412339+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:41.412339+0000","last_peered":"2024-04-19T03:39:41.412339+0000","last_clean":"2024-04-19T03:39:41.412339+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:41.412339+0000","last_undegraded":"2024-04-19T03:39:41.412339+0000","last_fullsized":"2024-04-19T03:39:41.412339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413240+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:41.413240+0000","last_peered":"2024-04-19T03:39:41.413240+0000","last_clean":"2024-04-19T03:39:41.413240+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:41.413240+0000","last_undegraded":"2024-04-19T03:39:41.413240+0000","last_fullsized":"2024-04-19T03:39:41.413240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412785+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:41.412785+0000","last_peered":"2024-04-19T03:39:41.412785+0000","last_clean":"2024-04-19T03:39:41.412785+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:41.412785+0000","last_undegraded":"2024-04-19T03:39:41.412785+0000","last_fullsized":"2024-04-19T03:39:41.412785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391598+0000","last_change":"2024-04-19T03:39:32.398006+0000","last_active":"2024-04-19T03:39:37.391598+0000","last_peered":"2024-04-19T03:39:37.391598+0000","last_clean":"2024-04-19T03:39:37.391598+0000","last_became_active":"2024-04-19T03:39:32.397734+0000","last_became_peered":"2024-04-19T03:39:32.397734+0000","last_unstale":"2024-04-19T03:39:37.391598+0000","last_undegraded":"2024-04-19T03:39:37.391598+0000","last_fullsized":"2024-04-19T03:39:37.391598+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:57:38.017118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2067,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390061+0000","last_change":"2024-04-19T03:39:32.401634+0000","last_active":"2024-04-19T03:39:37.390061+0000","last_peered":"2024-04-19T03:39:37.390061+0000","last_clean":"2024-04-19T03:39:37.390061+0000","last_became_active":"2024-04-19T03:39:32.398779+0000","last_became_peered":"2024-04-19T03:39:32.398779+0000","last_unstale":"2024-04-19T03:39:37.390061+0000","last_undegraded":"2024-04-19T03:39:37.390061+0000","last_fullsized":"2024-04-19T03:39:37.390061+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:42.670329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390983+0000","last_change":"2024-04-19T03:39:32.395971+0000","last_active":"2024-04-19T03:39:37.390983+0000","last_peered":"2024-04-19T03:39:37.390983+0000","last_clean":"2024-04-19T03:39:37.390983+0000","last_became_active":"2024-04-19T03:39:32.395700+0000","last_became_peered":"2024-04-19T03:39:32.395700+0000","last_unstale":"2024-04-19T03:39:37.390983+0000","last_undegraded":"2024-04-19T03:39:37.390983+0000","last_fullsized":"2024-04-19T03:39:37.390983+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:56:26.477882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421316+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:42.421316+0000","last_peered":"2024-04-19T03:39:42.421316+0000","last_clean":"2024-04-19T03:39:42.421316+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:42.421316+0000","last_undegraded":"2024-04-19T03:39:42.421316+0000","last_fullsized":"2024-04-19T03:39:42.421316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421232+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:42.421232+0000","last_peered":"2024-04-19T03:39:42.421232+0000","last_clean":"2024-04-19T03:39:42.421232+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:42.421232+0000","last_undegraded":"2024-04-19T03:39:42.421232+0000","last_fullsized":"2024-04-19T03:39:42.421232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2094,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390678+0000","last_change":"2024-04-19T03:39:32.399496+0000","last_active":"2024-04-19T03:39:37.390678+0000","last_peered":"2024-04-19T03:39:37.390678+0000","last_clean":"2024-04-19T03:39:37.390678+0000","last_became_active":"2024-04-19T03:39:32.398117+0000","last_became_peered":"2024-04-19T03:39:32.398117+0000","last_unstale":"2024-04-19T03:39:37.390678+0000","last_undegraded":"2024-04-19T03:39:37.390678+0000","last_fullsized":"2024-04-19T03:39:37.390678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:05.987207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390258+0000","last_change":"2024-04-19T03:39:32.394935+0000","last_active":"2024-04-19T03:39:37.390258+0000","last_peered":"2024-04-19T03:39:37.390258+0000","last_clean":"2024-04-19T03:39:37.390258+0000","last_became_active":"2024-04-19T03:39:32.394624+0000","last_became_peered":"2024-04-19T03:39:32.394624+0000","last_unstale":"2024-04-19T03:39:37.390258+0000","last_undegraded":"2024-04-19T03:39:37.390258+0000","last_fullsized":"2024-04-19T03:39:37.390258+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:11.842559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391395+0000","last_change":"2024-04-19T03:39:32.396066+0000","last_active":"2024-04-19T03:39:37.391395+0000","last_peered":"2024-04-19T03:39:37.391395+0000","last_clean":"2024-04-19T03:39:37.391395+0000","last_became_active":"2024-04-19T03:39:32.394630+0000","last_became_peered":"2024-04-19T03:39:32.394630+0000","last_unstale":"2024-04-19T03:39:37.391395+0000","last_undegraded":"2024-04-19T03:39:37.391395+0000","last_fullsized":"2024-04-19T03:39:37.391395+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412529+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:41.412529+0000","last_peered":"2024-04-19T03:39:41.412529+0000","last_clean":"2024-04-19T03:39:41.412529+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:41.412529+0000","last_undegraded":"2024-04-19T03:39:41.412529+0000","last_fullsized":"2024-04-19T03:39:41.412529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391415+0000","last_change":"2024-04-19T03:39:32.395663+0000","last_active":"2024-04-19T03:39:37.391415+0000","last_peered":"2024-04-19T03:39:37.391415+0000","last_clean":"2024-04-19T03:39:37.391415+0000","last_became_active":"2024-04-19T03:39:32.394303+0000","last_became_peered":"2024-04-19T03:39:32.394303+0000","last_unstale":"2024-04-19T03:39:37.391415+0000","last_undegraded":"2024-04-19T03:39:37.391415+0000","last_fullsized":"2024-04-19T03:39:37.391415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:42.996316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412603+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:41.412603+0000","last_peered":"2024-04-19T03:39:41.412603+0000","last_clean":"2024-04-19T03:39:41.412603+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:41.412603+0000","last_undegraded":"2024-04-19T03:39:41.412603+0000","last_fullsized":"2024-04-19T03:39:41.412603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6118,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420024+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:42.420024+0000","last_peered":"2024-04-19T03:39:42.420024+0000","last_clean":"2024-04-19T03:39:42.420024+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:42.420024+0000","last_undegraded":"2024-04-19T03:39:42.420024+0000","last_fullsized":"2024-04-19T03:39:42.420024+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419894+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:42.419894+0000","last_peered":"2024-04-19T03:39:42.419894+0000","last_clean":"2024-04-19T03:39:42.419894+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:42.419894+0000","last_undegraded":"2024-04-19T03:39:42.419894+0000","last_fullsized":"2024-04-19T03:39:42.419894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413757+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:41.413757+0000","last_peered":"2024-04-19T03:39:41.413757+0000","last_clean":"2024-04-19T03:39:41.413757+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:41.413757+0000","last_undegraded":"2024-04-19T03:39:41.413757+0000","last_fullsized":"2024-04-19T03:39:41.413757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420461+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:42.420461+0000","last_peered":"2024-04-19T03:39:42.420461+0000","last_clean":"2024-04-19T03:39:42.420461+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:42.420461+0000","last_undegraded":"2024-04-19T03:39:42.420461+0000","last_fullsized":"2024-04-19T03:39:42.420461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413236+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:41.413236+0000","last_peered":"2024-04-19T03:39:41.413236+0000","last_clean":"2024-04-19T03:39:41.413236+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:41.413236+0000","last_undegraded":"2024-04-19T03:39:41.413236+0000","last_fullsized":"2024-04-19T03:39:41.413236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":114,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418792+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:42.418792+0000","last_peered":"2024-04-19T03:39:42.418792+0000","last_clean":"2024-04-19T03:39:42.418792+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:42.418792+0000","last_undegraded":"2024-04-19T03:39:42.418792+0000","last_fullsized":"2024-04-19T03:39:42.418792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412749+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:41.412749+0000","last_peered":"2024-04-19T03:39:41.412749+0000","last_clean":"2024-04-19T03:39:41.412749+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:41.412749+0000","last_undegraded":"2024-04-19T03:39:41.412749+0000","last_fullsized":"2024-04-19T03:39:41.412749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420618+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:42.420618+0000","last_peered":"2024-04-19T03:39:42.420618+0000","last_clean":"2024-04-19T03:39:42.420618+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:42.420618+0000","last_undegraded":"2024-04-19T03:39:42.420618+0000","last_fullsized":"2024-04-19T03:39:42.420618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":277,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.395654+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.395086+0000","last_became_peered":"2024-04-19T03:39:32.395086+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:15.390971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":112,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417330+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:42.417330+0000","last_peered":"2024-04-19T03:39:42.417330+0000","last_clean":"2024-04-19T03:39:42.417330+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:42.417330+0000","last_undegraded":"2024-04-19T03:39:42.417330+0000","last_fullsized":"2024-04-19T03:39:42.417330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8088,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413659+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:41.413659+0000","last_peered":"2024-04-19T03:39:41.413659+0000","last_clean":"2024-04-19T03:39:41.413659+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:41.413659+0000","last_undegraded":"2024-04-19T03:39:41.413659+0000","last_fullsized":"2024-04-19T03:39:41.413659+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390307+0000","last_change":"2024-04-19T03:39:32.399167+0000","last_active":"2024-04-19T03:39:37.390307+0000","last_peered":"2024-04-19T03:39:37.390307+0000","last_clean":"2024-04-19T03:39:37.390307+0000","last_became_active":"2024-04-19T03:39:32.398584+0000","last_became_peered":"2024-04-19T03:39:32.398584+0000","last_unstale":"2024-04-19T03:39:37.390307+0000","last_undegraded":"2024-04-19T03:39:37.390307+0000","last_fullsized":"2024-04-19T03:39:37.390307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:43.337624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412475+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:41.412475+0000","last_peered":"2024-04-19T03:39:41.412475+0000","last_clean":"2024-04-19T03:39:41.412475+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:41.412475+0000","last_undegraded":"2024-04-19T03:39:41.412475+0000","last_fullsized":"2024-04-19T03:39:41.412475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420399+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:42.420399+0000","last_peered":"2024-04-19T03:39:42.420399+0000","last_clean":"2024-04-19T03:39:42.420399+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:42.420399+0000","last_undegraded":"2024-04-19T03:39:42.420399+0000","last_fullsized":"2024-04-19T03:39:42.420399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390450+0000","last_change":"2024-04-19T03:39:32.393622+0000","last_active":"2024-04-19T03:39:37.390450+0000","last_peered":"2024-04-19T03:39:37.390450+0000","last_clean":"2024-04-19T03:39:37.390450+0000","last_became_active":"2024-04-19T03:39:32.393342+0000","last_became_peered":"2024-04-19T03:39:32.393342+0000","last_unstale":"2024-04-19T03:39:37.390450+0000","last_undegraded":"2024-04-19T03:39:37.390450+0000","last_fullsized":"2024-04-19T03:39:37.390450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:42.742836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419973+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:42.419973+0000","last_peered":"2024-04-19T03:39:42.419973+0000","last_clean":"2024-04-19T03:39:42.419973+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:42.419973+0000","last_undegraded":"2024-04-19T03:39:42.419973+0000","last_fullsized":"2024-04-19T03:39:42.419973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391314+0000","last_change":"2024-04-19T03:39:32.395946+0000","last_active":"2024-04-19T03:39:37.391314+0000","last_peered":"2024-04-19T03:39:37.391314+0000","last_clean":"2024-04-19T03:39:37.391314+0000","last_became_active":"2024-04-19T03:39:32.395348+0000","last_became_peered":"2024-04-19T03:39:32.395348+0000","last_unstale":"2024-04-19T03:39:37.391314+0000","last_undegraded":"2024-04-19T03:39:37.391314+0000","last_fullsized":"2024-04-19T03:39:37.391314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:41.036403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412623+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:41.412623+0000","last_peered":"2024-04-19T03:39:41.412623+0000","last_clean":"2024-04-19T03:39:41.412623+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:41.412623+0000","last_undegraded":"2024-04-19T03:39:41.412623+0000","last_fullsized":"2024-04-19T03:39:41.412623+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390632+0000","last_change":"2024-04-19T03:39:32.396079+0000","last_active":"2024-04-19T03:39:37.390632+0000","last_peered":"2024-04-19T03:39:37.390632+0000","last_clean":"2024-04-19T03:39:37.390632+0000","last_became_active":"2024-04-19T03:39:32.395721+0000","last_became_peered":"2024-04-19T03:39:32.395721+0000","last_unstale":"2024-04-19T03:39:37.390632+0000","last_undegraded":"2024-04-19T03:39:37.390632+0000","last_fullsized":"2024-04-19T03:39:37.390632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:08.221132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":96,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421710+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:42.421710+0000","last_peered":"2024-04-19T03:39:42.421710+0000","last_clean":"2024-04-19T03:39:42.421710+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:42.421710+0000","last_undegraded":"2024-04-19T03:39:42.421710+0000","last_fullsized":"2024-04-19T03:39:42.421710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413384+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:41.413384+0000","last_peered":"2024-04-19T03:39:41.413384+0000","last_clean":"2024-04-19T03:39:41.413384+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:41.413384+0000","last_undegraded":"2024-04-19T03:39:41.413384+0000","last_fullsized":"2024-04-19T03:39:41.413384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421814+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:42.421814+0000","last_peered":"2024-04-19T03:39:42.421814+0000","last_clean":"2024-04-19T03:39:42.421814+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:42.421814+0000","last_undegraded":"2024-04-19T03:39:42.421814+0000","last_fullsized":"2024-04-19T03:39:42.421814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2065,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413134+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:41.413134+0000","last_peered":"2024-04-19T03:39:41.413134+0000","last_clean":"2024-04-19T03:39:41.413134+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:41.413134+0000","last_undegraded":"2024-04-19T03:39:41.413134+0000","last_fullsized":"2024-04-19T03:39:41.413134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391794+0000","last_change":"2024-04-19T03:39:32.394854+0000","last_active":"2024-04-19T03:39:37.391794+0000","last_peered":"2024-04-19T03:39:37.391794+0000","last_clean":"2024-04-19T03:39:37.391794+0000","last_became_active":"2024-04-19T03:39:32.394482+0000","last_became_peered":"2024-04-19T03:39:32.394482+0000","last_unstale":"2024-04-19T03:39:37.391794+0000","last_undegraded":"2024-04-19T03:39:37.391794+0000","last_fullsized":"2024-04-19T03:39:37.391794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:16.631854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390884+0000","last_change":"2024-04-19T03:39:32.400848+0000","last_active":"2024-04-19T03:39:37.390884+0000","last_peered":"2024-04-19T03:39:37.390884+0000","last_clean":"2024-04-19T03:39:37.390884+0000","last_became_active":"2024-04-19T03:39:32.400572+0000","last_became_peered":"2024-04-19T03:39:32.400572+0000","last_unstale":"2024-04-19T03:39:37.390884+0000","last_undegraded":"2024-04-19T03:39:37.390884+0000","last_fullsized":"2024-04-19T03:39:37.390884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:28.052247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412986+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:41.412986+0000","last_peered":"2024-04-19T03:39:41.412986+0000","last_clean":"2024-04-19T03:39:41.412986+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:41.412986+0000","last_undegraded":"2024-04-19T03:39:41.412986+0000","last_fullsized":"2024-04-19T03:39:41.412986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413041+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:41.413041+0000","last_peered":"2024-04-19T03:39:41.413041+0000","last_clean":"2024-04-19T03:39:41.413041+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:41.413041+0000","last_undegraded":"2024-04-19T03:39:41.413041+0000","last_fullsized":"2024-04-19T03:39:41.413041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413409+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:41.413409+0000","last_peered":"2024-04-19T03:39:41.413409+0000","last_clean":"2024-04-19T03:39:41.413409+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:41.413409+0000","last_undegraded":"2024-04-19T03:39:41.413409+0000","last_fullsized":"2024-04-19T03:39:41.413409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390723+0000","last_change":"2024-04-19T03:39:32.400398+0000","last_active":"2024-04-19T03:39:37.390723+0000","last_peered":"2024-04-19T03:39:37.390723+0000","last_clean":"2024-04-19T03:39:37.390723+0000","last_became_active":"2024-04-19T03:39:32.399453+0000","last_became_peered":"2024-04-19T03:39:32.399453+0000","last_unstale":"2024-04-19T03:39:37.390723+0000","last_undegraded":"2024-04-19T03:39:37.390723+0000","last_fullsized":"2024-04-19T03:39:37.390723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:47.765222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2086,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390416+0000","last_change":"2024-04-19T03:39:32.399370+0000","last_active":"2024-04-19T03:39:37.390416+0000","last_peered":"2024-04-19T03:39:37.390416+0000","last_clean":"2024-04-19T03:39:37.390416+0000","last_became_active":"2024-04-19T03:39:32.398094+0000","last_became_peered":"2024-04-19T03:39:32.398094+0000","last_unstale":"2024-04-19T03:39:37.390416+0000","last_undegraded":"2024-04-19T03:39:37.390416+0000","last_fullsized":"2024-04-19T03:39:37.390416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:58.061381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413825+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:41.413825+0000","last_peered":"2024-04-19T03:39:41.413825+0000","last_clean":"2024-04-19T03:39:41.413825+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:41.413825+0000","last_undegraded":"2024-04-19T03:39:41.413825+0000","last_fullsized":"2024-04-19T03:39:41.413825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":82,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390122+0000","last_change":"2024-04-19T03:39:32.399381+0000","last_active":"2024-04-19T03:39:37.390122+0000","last_peered":"2024-04-19T03:39:37.390122+0000","last_clean":"2024-04-19T03:39:37.390122+0000","last_became_active":"2024-04-19T03:39:32.398858+0000","last_became_peered":"2024-04-19T03:39:32.398858+0000","last_unstale":"2024-04-19T03:39:37.390122+0000","last_undegraded":"2024-04-19T03:39:37.390122+0000","last_fullsized":"2024-04-19T03:39:37.390122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:27.528014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419060+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:42.419060+0000","last_peered":"2024-04-19T03:39:42.419060+0000","last_clean":"2024-04-19T03:39:42.419060+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:42.419060+0000","last_undegraded":"2024-04-19T03:39:42.419060+0000","last_fullsized":"2024-04-19T03:39:42.419060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412882+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:41.412882+0000","last_peered":"2024-04-19T03:39:41.412882+0000","last_clean":"2024-04-19T03:39:41.412882+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:41.412882+0000","last_undegraded":"2024-04-19T03:39:41.412882+0000","last_fullsized":"2024-04-19T03:39:41.412882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420189+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:42.420189+0000","last_peered":"2024-04-19T03:39:42.420189+0000","last_clean":"2024-04-19T03:39:42.420189+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:42.420189+0000","last_undegraded":"2024-04-19T03:39:42.420189+0000","last_fullsized":"2024-04-19T03:39:42.420189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2135,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390302+0000","last_change":"2024-04-19T03:39:32.402322+0000","last_active":"2024-04-19T03:39:37.390302+0000","last_peered":"2024-04-19T03:39:37.390302+0000","last_clean":"2024-04-19T03:39:37.390302+0000","last_became_active":"2024-04-19T03:39:32.401133+0000","last_became_peered":"2024-04-19T03:39:32.401133+0000","last_unstale":"2024-04-19T03:39:37.390302+0000","last_undegraded":"2024-04-19T03:39:37.390302+0000","last_fullsized":"2024-04-19T03:39:37.390302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:33:33.557434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389840+0000","last_change":"2024-04-19T03:39:32.401135+0000","last_active":"2024-04-19T03:39:37.389840+0000","last_peered":"2024-04-19T03:39:37.389840+0000","last_clean":"2024-04-19T03:39:37.389840+0000","last_became_active":"2024-04-19T03:39:32.400869+0000","last_became_peered":"2024-04-19T03:39:32.400869+0000","last_unstale":"2024-04-19T03:39:37.389840+0000","last_undegraded":"2024-04-19T03:39:37.389840+0000","last_fullsized":"2024-04-19T03:39:37.389840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:06.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":99,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417609+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:42.417609+0000","last_peered":"2024-04-19T03:39:42.417609+0000","last_clean":"2024-04-19T03:39:42.417609+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:42.417609+0000","last_undegraded":"2024-04-19T03:39:42.417609+0000","last_fullsized":"2024-04-19T03:39:42.417609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2087,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413001+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:41.413001+0000","last_peered":"2024-04-19T03:39:41.413001+0000","last_clean":"2024-04-19T03:39:41.413001+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:41.413001+0000","last_undegraded":"2024-04-19T03:39:41.413001+0000","last_fullsized":"2024-04-19T03:39:41.413001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421424+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:42.421424+0000","last_peered":"2024-04-19T03:39:42.421424+0000","last_clean":"2024-04-19T03:39:42.421424+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:42.421424+0000","last_undegraded":"2024-04-19T03:39:42.421424+0000","last_fullsized":"2024-04-19T03:39:42.421424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413465+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:41.413465+0000","last_peered":"2024-04-19T03:39:41.413465+0000","last_clean":"2024-04-19T03:39:41.413465+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:41.413465+0000","last_undegraded":"2024-04-19T03:39:41.413465+0000","last_fullsized":"2024-04-19T03:39:41.413465+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481799,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1644,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1683456,"data_stored":1254158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369836,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002004,"statfs":{"total":96636764160,"available":96258052096,"internally_reserved":0,"allocated":1671168,"data_stored":1252936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":782336,"data_stored":378148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:46.151 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T03:39:46.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-19T03:39:46.581 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-19T03:39:46.591 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T03:39:46.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:46.962 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:46.965 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:46.974 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-04-19T03:39:46.336162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795892,"kb_used_data":4040,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319628,"statfs":{"total":289910292480,"available":289095299072,"internally_reserved":0,"allocated":4136960,"data_stored":2885242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.931943"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2066,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413844+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:41.413844+0000","last_peered":"2024-04-19T03:39:41.413844+0000","last_clean":"2024-04-19T03:39:41.413844+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:41.413844+0000","last_undegraded":"2024-04-19T03:39:41.413844+0000","last_fullsized":"2024-04-19T03:39:41.413844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413352+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:41.413352+0000","last_peered":"2024-04-19T03:39:41.413352+0000","last_clean":"2024-04-19T03:39:41.413352+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:41.413352+0000","last_undegraded":"2024-04-19T03:39:41.413352+0000","last_fullsized":"2024-04-19T03:39:41.413352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4081,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391168+0000","last_change":"2024-04-19T03:39:32.399459+0000","last_active":"2024-04-19T03:39:37.391168+0000","last_peered":"2024-04-19T03:39:37.391168+0000","last_clean":"2024-04-19T03:39:37.391168+0000","last_became_active":"2024-04-19T03:39:32.397753+0000","last_became_peered":"2024-04-19T03:39:32.397753+0000","last_unstale":"2024-04-19T03:39:37.391168+0000","last_undegraded":"2024-04-19T03:39:37.391168+0000","last_fullsized":"2024-04-19T03:39:37.391168+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:54.322202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390587+0000","last_change":"2024-04-19T03:39:32.400611+0000","last_active":"2024-04-19T03:39:37.390587+0000","last_peered":"2024-04-19T03:39:37.390587+0000","last_clean":"2024-04-19T03:39:37.390587+0000","last_became_active":"2024-04-19T03:39:32.399743+0000","last_became_peered":"2024-04-19T03:39:32.399743+0000","last_unstale":"2024-04-19T03:39:37.390587+0000","last_undegraded":"2024-04-19T03:39:37.390587+0000","last_fullsized":"2024-04-19T03:39:37.390587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:40:42.830458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413052+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:41.413052+0000","last_peered":"2024-04-19T03:39:41.413052+0000","last_clean":"2024-04-19T03:39:41.413052+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:41.413052+0000","last_undegraded":"2024-04-19T03:39:41.413052+0000","last_fullsized":"2024-04-19T03:39:41.413052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":81,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390192+0000","last_change":"2024-04-19T03:39:32.398542+0000","last_active":"2024-04-19T03:39:37.390192+0000","last_peered":"2024-04-19T03:39:37.390192+0000","last_clean":"2024-04-19T03:39:37.390192+0000","last_became_active":"2024-04-19T03:39:32.398227+0000","last_became_peered":"2024-04-19T03:39:32.398227+0000","last_unstale":"2024-04-19T03:39:37.390192+0000","last_undegraded":"2024-04-19T03:39:37.390192+0000","last_fullsized":"2024-04-19T03:39:37.390192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:10:16.307090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390010+0000","last_change":"2024-04-19T03:39:32.396074+0000","last_active":"2024-04-19T03:39:37.390010+0000","last_peered":"2024-04-19T03:39:37.390010+0000","last_clean":"2024-04-19T03:39:37.390010+0000","last_became_active":"2024-04-19T03:39:32.395729+0000","last_became_peered":"2024-04-19T03:39:32.395729+0000","last_unstale":"2024-04-19T03:39:37.390010+0000","last_undegraded":"2024-04-19T03:39:37.390010+0000","last_fullsized":"2024-04-19T03:39:37.390010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:29.445916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389883+0000","last_change":"2024-04-19T03:39:32.400603+0000","last_active":"2024-04-19T03:39:37.389883+0000","last_peered":"2024-04-19T03:39:37.389883+0000","last_clean":"2024-04-19T03:39:37.389883+0000","last_became_active":"2024-04-19T03:39:32.397995+0000","last_became_peered":"2024-04-19T03:39:32.397995+0000","last_unstale":"2024-04-19T03:39:37.389883+0000","last_undegraded":"2024-04-19T03:39:37.389883+0000","last_fullsized":"2024-04-19T03:39:37.389883+0000","mapping_epoch":85,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:57.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6161,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418326+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:42.418326+0000","last_peered":"2024-04-19T03:39:42.418326+0000","last_clean":"2024-04-19T03:39:42.418326+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:42.418326+0000","last_undegraded":"2024-04-19T03:39:42.418326+0000","last_fullsized":"2024-04-19T03:39:42.418326+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413649+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:41.413649+0000","last_peered":"2024-04-19T03:39:41.413649+0000","last_clean":"2024-04-19T03:39:41.413649+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:41.413649+0000","last_undegraded":"2024-04-19T03:39:41.413649+0000","last_fullsized":"2024-04-19T03:39:41.413649+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4027,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390781+0000","last_change":"2024-04-19T03:39:32.400179+0000","last_active":"2024-04-19T03:39:37.390781+0000","last_peered":"2024-04-19T03:39:37.390781+0000","last_clean":"2024-04-19T03:39:37.390781+0000","last_became_active":"2024-04-19T03:39:32.397994+0000","last_became_peered":"2024-04-19T03:39:32.397994+0000","last_unstale":"2024-04-19T03:39:37.390781+0000","last_undegraded":"2024-04-19T03:39:37.390781+0000","last_fullsized":"2024-04-19T03:39:37.390781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:33.299512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413111+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:41.413111+0000","last_peered":"2024-04-19T03:39:41.413111+0000","last_clean":"2024-04-19T03:39:41.413111+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:41.413111+0000","last_undegraded":"2024-04-19T03:39:41.413111+0000","last_fullsized":"2024-04-19T03:39:41.413111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2079,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412862+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:41.412862+0000","last_peered":"2024-04-19T03:39:41.412862+0000","last_clean":"2024-04-19T03:39:41.412862+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:41.412862+0000","last_undegraded":"2024-04-19T03:39:41.412862+0000","last_fullsized":"2024-04-19T03:39:41.412862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390697+0000","last_change":"2024-04-19T03:39:32.395332+0000","last_active":"2024-04-19T03:39:37.390697+0000","last_peered":"2024-04-19T03:39:37.390697+0000","last_clean":"2024-04-19T03:39:37.390697+0000","last_became_active":"2024-04-19T03:39:32.392604+0000","last_became_peered":"2024-04-19T03:39:32.392604+0000","last_unstale":"2024-04-19T03:39:37.390697+0000","last_undegraded":"2024-04-19T03:39:37.390697+0000","last_fullsized":"2024-04-19T03:39:37.390697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:12.846842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2111,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390584+0000","last_change":"2024-04-19T03:39:32.395011+0000","last_active":"2024-04-19T03:39:37.390584+0000","last_peered":"2024-04-19T03:39:37.390584+0000","last_clean":"2024-04-19T03:39:37.390584+0000","last_became_active":"2024-04-19T03:39:32.392633+0000","last_became_peered":"2024-04-19T03:39:32.392633+0000","last_unstale":"2024-04-19T03:39:37.390584+0000","last_undegraded":"2024-04-19T03:39:37.390584+0000","last_fullsized":"2024-04-19T03:39:37.390584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:56.349038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2088,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389956+0000","last_change":"2024-04-19T03:39:32.396919+0000","last_active":"2024-04-19T03:39:37.389956+0000","last_peered":"2024-04-19T03:39:37.389956+0000","last_clean":"2024-04-19T03:39:37.389956+0000","last_became_active":"2024-04-19T03:39:32.395719+0000","last_became_peered":"2024-04-19T03:39:32.395719+0000","last_unstale":"2024-04-19T03:39:37.389956+0000","last_undegraded":"2024-04-19T03:39:37.389956+0000","last_fullsized":"2024-04-19T03:39:37.389956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:08.092382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419797+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:42.419797+0000","last_peered":"2024-04-19T03:39:42.419797+0000","last_clean":"2024-04-19T03:39:42.419797+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:42.419797+0000","last_undegraded":"2024-04-19T03:39:42.419797+0000","last_fullsized":"2024-04-19T03:39:42.419797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413507+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:41.413507+0000","last_peered":"2024-04-19T03:39:41.413507+0000","last_clean":"2024-04-19T03:39:41.413507+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:41.413507+0000","last_undegraded":"2024-04-19T03:39:41.413507+0000","last_fullsized":"2024-04-19T03:39:41.413507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4139,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419233+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:42.419233+0000","last_peered":"2024-04-19T03:39:42.419233+0000","last_clean":"2024-04-19T03:39:42.419233+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:42.419233+0000","last_undegraded":"2024-04-19T03:39:42.419233+0000","last_fullsized":"2024-04-19T03:39:42.419233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390528+0000","last_change":"2024-04-19T03:39:32.401641+0000","last_active":"2024-04-19T03:39:37.390528+0000","last_peered":"2024-04-19T03:39:37.390528+0000","last_clean":"2024-04-19T03:39:37.390528+0000","last_became_active":"2024-04-19T03:39:32.399814+0000","last_became_peered":"2024-04-19T03:39:32.399814+0000","last_unstale":"2024-04-19T03:39:37.390528+0000","last_undegraded":"2024-04-19T03:39:37.390528+0000","last_fullsized":"2024-04-19T03:39:37.390528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:40.327326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390386+0000","last_change":"2024-04-19T03:39:32.400170+0000","last_active":"2024-04-19T03:39:37.390386+0000","last_peered":"2024-04-19T03:39:37.390386+0000","last_clean":"2024-04-19T03:39:37.390386+0000","last_became_active":"2024-04-19T03:39:32.399694+0000","last_became_peered":"2024-04-19T03:39:32.399694+0000","last_unstale":"2024-04-19T03:39:37.390386+0000","last_undegraded":"2024-04-19T03:39:37.390386+0000","last_fullsized":"2024-04-19T03:39:37.390386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:18.828239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412798+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:41.412798+0000","last_peered":"2024-04-19T03:39:41.412798+0000","last_clean":"2024-04-19T03:39:41.412798+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:41.412798+0000","last_undegraded":"2024-04-19T03:39:41.412798+0000","last_fullsized":"2024-04-19T03:39:41.412798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2155,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418161+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:42.418161+0000","last_peered":"2024-04-19T03:39:42.418161+0000","last_clean":"2024-04-19T03:39:42.418161+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:42.418161+0000","last_undegraded":"2024-04-19T03:39:42.418161+0000","last_fullsized":"2024-04-19T03:39:42.418161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412776+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:41.412776+0000","last_peered":"2024-04-19T03:39:41.412776+0000","last_clean":"2024-04-19T03:39:41.412776+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:41.412776+0000","last_undegraded":"2024-04-19T03:39:41.412776+0000","last_fullsized":"2024-04-19T03:39:41.412776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2094,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413817+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:41.413817+0000","last_peered":"2024-04-19T03:39:41.413817+0000","last_clean":"2024-04-19T03:39:41.413817+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:41.413817+0000","last_undegraded":"2024-04-19T03:39:41.413817+0000","last_fullsized":"2024-04-19T03:39:41.413817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419868+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:42.419868+0000","last_peered":"2024-04-19T03:39:42.419868+0000","last_clean":"2024-04-19T03:39:42.419868+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:42.419868+0000","last_undegraded":"2024-04-19T03:39:42.419868+0000","last_fullsized":"2024-04-19T03:39:42.419868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391435+0000","last_change":"2024-04-19T03:39:32.397511+0000","last_active":"2024-04-19T03:39:37.391435+0000","last_peered":"2024-04-19T03:39:37.391435+0000","last_clean":"2024-04-19T03:39:37.391435+0000","last_became_active":"2024-04-19T03:39:32.396369+0000","last_became_peered":"2024-04-19T03:39:32.396369+0000","last_unstale":"2024-04-19T03:39:37.391435+0000","last_undegraded":"2024-04-19T03:39:37.391435+0000","last_fullsized":"2024-04-19T03:39:37.391435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:02:22.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412750+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:41.412750+0000","last_peered":"2024-04-19T03:39:41.412750+0000","last_clean":"2024-04-19T03:39:41.412750+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:41.412750+0000","last_undegraded":"2024-04-19T03:39:41.412750+0000","last_fullsized":"2024-04-19T03:39:41.412750+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413799+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:41.413799+0000","last_peered":"2024-04-19T03:39:41.413799+0000","last_clean":"2024-04-19T03:39:41.413799+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:41.413799+0000","last_undegraded":"2024-04-19T03:39:41.413799+0000","last_fullsized":"2024-04-19T03:39:41.413799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418408+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:42.418408+0000","last_peered":"2024-04-19T03:39:42.418408+0000","last_clean":"2024-04-19T03:39:42.418408+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:42.418408+0000","last_undegraded":"2024-04-19T03:39:42.418408+0000","last_fullsized":"2024-04-19T03:39:42.418408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418928+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:42.418928+0000","last_peered":"2024-04-19T03:39:42.418928+0000","last_clean":"2024-04-19T03:39:42.418928+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:42.418928+0000","last_undegraded":"2024-04-19T03:39:42.418928+0000","last_fullsized":"2024-04-19T03:39:42.418928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420339+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:42.420339+0000","last_peered":"2024-04-19T03:39:42.420339+0000","last_clean":"2024-04-19T03:39:42.420339+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:42.420339+0000","last_undegraded":"2024-04-19T03:39:42.420339+0000","last_fullsized":"2024-04-19T03:39:42.420339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413707+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:41.413707+0000","last_peered":"2024-04-19T03:39:41.413707+0000","last_clean":"2024-04-19T03:39:41.413707+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:41.413707+0000","last_undegraded":"2024-04-19T03:39:41.413707+0000","last_fullsized":"2024-04-19T03:39:41.413707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420283+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:42.420283+0000","last_peered":"2024-04-19T03:39:42.420283+0000","last_clean":"2024-04-19T03:39:42.420283+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:42.420283+0000","last_undegraded":"2024-04-19T03:39:42.420283+0000","last_fullsized":"2024-04-19T03:39:42.420283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420113+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:42.420113+0000","last_peered":"2024-04-19T03:39:42.420113+0000","last_clean":"2024-04-19T03:39:42.420113+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:42.420113+0000","last_undegraded":"2024-04-19T03:39:42.420113+0000","last_fullsized":"2024-04-19T03:39:42.420113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.400643+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.398090+0000","last_became_peered":"2024-04-19T03:39:32.398090+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:12:38.136122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418025+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:42.418025+0000","last_peered":"2024-04-19T03:39:42.418025+0000","last_clean":"2024-04-19T03:39:42.418025+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:42.418025+0000","last_undegraded":"2024-04-19T03:39:42.418025+0000","last_fullsized":"2024-04-19T03:39:42.418025+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413667+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:41.413667+0000","last_peered":"2024-04-19T03:39:41.413667+0000","last_clean":"2024-04-19T03:39:41.413667+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:41.413667+0000","last_undegraded":"2024-04-19T03:39:41.413667+0000","last_fullsized":"2024-04-19T03:39:41.413667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4150,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420052+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:42.420052+0000","last_peered":"2024-04-19T03:39:42.420052+0000","last_clean":"2024-04-19T03:39:42.420052+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:42.420052+0000","last_undegraded":"2024-04-19T03:39:42.420052+0000","last_fullsized":"2024-04-19T03:39:42.420052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":180,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391107+0000","last_change":"2024-04-19T03:39:32.394904+0000","last_active":"2024-04-19T03:39:37.391107+0000","last_peered":"2024-04-19T03:39:37.391107+0000","last_clean":"2024-04-19T03:39:37.391107+0000","last_became_active":"2024-04-19T03:39:32.394518+0000","last_became_peered":"2024-04-19T03:39:32.394518+0000","last_unstale":"2024-04-19T03:39:37.391107+0000","last_undegraded":"2024-04-19T03:39:37.391107+0000","last_fullsized":"2024-04-19T03:39:37.391107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:49.767040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4171,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390892+0000","last_change":"2024-04-19T03:39:32.395658+0000","last_active":"2024-04-19T03:39:37.390892+0000","last_peered":"2024-04-19T03:39:37.390892+0000","last_clean":"2024-04-19T03:39:37.390892+0000","last_became_active":"2024-04-19T03:39:32.393165+0000","last_became_peered":"2024-04-19T03:39:32.393165+0000","last_unstale":"2024-04-19T03:39:37.390892+0000","last_undegraded":"2024-04-19T03:39:37.390892+0000","last_fullsized":"2024-04-19T03:39:37.390892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:09.225415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390506+0000","last_change":"2024-04-19T03:39:32.400220+0000","last_active":"2024-04-19T03:39:37.390506+0000","last_peered":"2024-04-19T03:39:37.390506+0000","last_clean":"2024-04-19T03:39:37.390506+0000","last_became_active":"2024-04-19T03:39:32.399717+0000","last_became_peered":"2024-04-19T03:39:32.399717+0000","last_unstale":"2024-04-19T03:39:37.390506+0000","last_undegraded":"2024-04-19T03:39:37.390506+0000","last_fullsized":"2024-04-19T03:39:37.390506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:01.543694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2062,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413157+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:41.413157+0000","last_peered":"2024-04-19T03:39:41.413157+0000","last_clean":"2024-04-19T03:39:41.413157+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:41.413157+0000","last_undegraded":"2024-04-19T03:39:41.413157+0000","last_fullsized":"2024-04-19T03:39:41.413157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419933+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:42.419933+0000","last_peered":"2024-04-19T03:39:42.419933+0000","last_clean":"2024-04-19T03:39:42.419933+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:42.419933+0000","last_undegraded":"2024-04-19T03:39:42.419933+0000","last_fullsized":"2024-04-19T03:39:42.419933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413927+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:41.413927+0000","last_peered":"2024-04-19T03:39:41.413927+0000","last_clean":"2024-04-19T03:39:41.413927+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:41.413927+0000","last_undegraded":"2024-04-19T03:39:41.413927+0000","last_fullsized":"2024-04-19T03:39:41.413927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412670+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:41.412670+0000","last_peered":"2024-04-19T03:39:41.412670+0000","last_clean":"2024-04-19T03:39:41.412670+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:41.412670+0000","last_undegraded":"2024-04-19T03:39:41.412670+0000","last_fullsized":"2024-04-19T03:39:41.412670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":110,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419704+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:42.419704+0000","last_peered":"2024-04-19T03:39:42.419704+0000","last_clean":"2024-04-19T03:39:42.419704+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:42.419704+0000","last_undegraded":"2024-04-19T03:39:42.419704+0000","last_fullsized":"2024-04-19T03:39:42.419704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390748+0000","last_change":"2024-04-19T03:39:32.395496+0000","last_active":"2024-04-19T03:39:37.390748+0000","last_peered":"2024-04-19T03:39:37.390748+0000","last_clean":"2024-04-19T03:39:37.390748+0000","last_became_active":"2024-04-19T03:39:32.394631+0000","last_became_peered":"2024-04-19T03:39:32.394631+0000","last_unstale":"2024-04-19T03:39:37.390748+0000","last_undegraded":"2024-04-19T03:39:37.390748+0000","last_fullsized":"2024-04-19T03:39:37.390748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:10.062803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2206,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420401+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:42.420401+0000","last_peered":"2024-04-19T03:39:42.420401+0000","last_clean":"2024-04-19T03:39:42.420401+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:42.420401+0000","last_undegraded":"2024-04-19T03:39:42.420401+0000","last_fullsized":"2024-04-19T03:39:42.420401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391714+0000","last_change":"2024-04-19T03:39:32.396659+0000","last_active":"2024-04-19T03:39:37.391714+0000","last_peered":"2024-04-19T03:39:37.391714+0000","last_clean":"2024-04-19T03:39:37.391714+0000","last_became_active":"2024-04-19T03:39:32.396285+0000","last_became_peered":"2024-04-19T03:39:32.396285+0000","last_unstale":"2024-04-19T03:39:37.391714+0000","last_undegraded":"2024-04-19T03:39:37.391714+0000","last_fullsized":"2024-04-19T03:39:37.391714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:04.132840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412339+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:41.412339+0000","last_peered":"2024-04-19T03:39:41.412339+0000","last_clean":"2024-04-19T03:39:41.412339+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:41.412339+0000","last_undegraded":"2024-04-19T03:39:41.412339+0000","last_fullsized":"2024-04-19T03:39:41.412339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413240+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:41.413240+0000","last_peered":"2024-04-19T03:39:41.413240+0000","last_clean":"2024-04-19T03:39:41.413240+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:41.413240+0000","last_undegraded":"2024-04-19T03:39:41.413240+0000","last_fullsized":"2024-04-19T03:39:41.413240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412785+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:41.412785+0000","last_peered":"2024-04-19T03:39:41.412785+0000","last_clean":"2024-04-19T03:39:41.412785+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:41.412785+0000","last_undegraded":"2024-04-19T03:39:41.412785+0000","last_fullsized":"2024-04-19T03:39:41.412785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391598+0000","last_change":"2024-04-19T03:39:32.398006+0000","last_active":"2024-04-19T03:39:37.391598+0000","last_peered":"2024-04-19T03:39:37.391598+0000","last_clean":"2024-04-19T03:39:37.391598+0000","last_became_active":"2024-04-19T03:39:32.397734+0000","last_became_peered":"2024-04-19T03:39:32.397734+0000","last_unstale":"2024-04-19T03:39:37.391598+0000","last_undegraded":"2024-04-19T03:39:37.391598+0000","last_fullsized":"2024-04-19T03:39:37.391598+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:57:38.017118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2067,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390061+0000","last_change":"2024-04-19T03:39:32.401634+0000","last_active":"2024-04-19T03:39:37.390061+0000","last_peered":"2024-04-19T03:39:37.390061+0000","last_clean":"2024-04-19T03:39:37.390061+0000","last_became_active":"2024-04-19T03:39:32.398779+0000","last_became_peered":"2024-04-19T03:39:32.398779+0000","last_unstale":"2024-04-19T03:39:37.390061+0000","last_undegraded":"2024-04-19T03:39:37.390061+0000","last_fullsized":"2024-04-19T03:39:37.390061+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:42.670329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390983+0000","last_change":"2024-04-19T03:39:32.395971+0000","last_active":"2024-04-19T03:39:37.390983+0000","last_peered":"2024-04-19T03:39:37.390983+0000","last_clean":"2024-04-19T03:39:37.390983+0000","last_became_active":"2024-04-19T03:39:32.395700+0000","last_became_peered":"2024-04-19T03:39:32.395700+0000","last_unstale":"2024-04-19T03:39:37.390983+0000","last_undegraded":"2024-04-19T03:39:37.390983+0000","last_fullsized":"2024-04-19T03:39:37.390983+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:56:26.477882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421316+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:42.421316+0000","last_peered":"2024-04-19T03:39:42.421316+0000","last_clean":"2024-04-19T03:39:42.421316+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:42.421316+0000","last_undegraded":"2024-04-19T03:39:42.421316+0000","last_fullsized":"2024-04-19T03:39:42.421316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421232+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:42.421232+0000","last_peered":"2024-04-19T03:39:42.421232+0000","last_clean":"2024-04-19T03:39:42.421232+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:42.421232+0000","last_undegraded":"2024-04-19T03:39:42.421232+0000","last_fullsized":"2024-04-19T03:39:42.421232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2094,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390678+0000","last_change":"2024-04-19T03:39:32.399496+0000","last_active":"2024-04-19T03:39:37.390678+0000","last_peered":"2024-04-19T03:39:37.390678+0000","last_clean":"2024-04-19T03:39:37.390678+0000","last_became_active":"2024-04-19T03:39:32.398117+0000","last_became_peered":"2024-04-19T03:39:32.398117+0000","last_unstale":"2024-04-19T03:39:37.390678+0000","last_undegraded":"2024-04-19T03:39:37.390678+0000","last_fullsized":"2024-04-19T03:39:37.390678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:05.987207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390258+0000","last_change":"2024-04-19T03:39:32.394935+0000","last_active":"2024-04-19T03:39:37.390258+0000","last_peered":"2024-04-19T03:39:37.390258+0000","last_clean":"2024-04-19T03:39:37.390258+0000","last_became_active":"2024-04-19T03:39:32.394624+0000","last_became_peered":"2024-04-19T03:39:32.394624+0000","last_unstale":"2024-04-19T03:39:37.390258+0000","last_undegraded":"2024-04-19T03:39:37.390258+0000","last_fullsized":"2024-04-19T03:39:37.390258+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:11.842559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391395+0000","last_change":"2024-04-19T03:39:32.396066+0000","last_active":"2024-04-19T03:39:37.391395+0000","last_peered":"2024-04-19T03:39:37.391395+0000","last_clean":"2024-04-19T03:39:37.391395+0000","last_became_active":"2024-04-19T03:39:32.394630+0000","last_became_peered":"2024-04-19T03:39:32.394630+0000","last_unstale":"2024-04-19T03:39:37.391395+0000","last_undegraded":"2024-04-19T03:39:37.391395+0000","last_fullsized":"2024-04-19T03:39:37.391395+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412529+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:41.412529+0000","last_peered":"2024-04-19T03:39:41.412529+0000","last_clean":"2024-04-19T03:39:41.412529+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:41.412529+0000","last_undegraded":"2024-04-19T03:39:41.412529+0000","last_fullsized":"2024-04-19T03:39:41.412529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391415+0000","last_change":"2024-04-19T03:39:32.395663+0000","last_active":"2024-04-19T03:39:37.391415+0000","last_peered":"2024-04-19T03:39:37.391415+0000","last_clean":"2024-04-19T03:39:37.391415+0000","last_became_active":"2024-04-19T03:39:32.394303+0000","last_became_peered":"2024-04-19T03:39:32.394303+0000","last_unstale":"2024-04-19T03:39:37.391415+0000","last_undegraded":"2024-04-19T03:39:37.391415+0000","last_fullsized":"2024-04-19T03:39:37.391415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:42.996316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412603+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:41.412603+0000","last_peered":"2024-04-19T03:39:41.412603+0000","last_clean":"2024-04-19T03:39:41.412603+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:41.412603+0000","last_undegraded":"2024-04-19T03:39:41.412603+0000","last_fullsized":"2024-04-19T03:39:41.412603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6118,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420024+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:42.420024+0000","last_peered":"2024-04-19T03:39:42.420024+0000","last_clean":"2024-04-19T03:39:42.420024+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:42.420024+0000","last_undegraded":"2024-04-19T03:39:42.420024+0000","last_fullsized":"2024-04-19T03:39:42.420024+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419894+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:42.419894+0000","last_peered":"2024-04-19T03:39:42.419894+0000","last_clean":"2024-04-19T03:39:42.419894+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:42.419894+0000","last_undegraded":"2024-04-19T03:39:42.419894+0000","last_fullsized":"2024-04-19T03:39:42.419894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413757+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:41.413757+0000","last_peered":"2024-04-19T03:39:41.413757+0000","last_clean":"2024-04-19T03:39:41.413757+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:41.413757+0000","last_undegraded":"2024-04-19T03:39:41.413757+0000","last_fullsized":"2024-04-19T03:39:41.413757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420461+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:42.420461+0000","last_peered":"2024-04-19T03:39:42.420461+0000","last_clean":"2024-04-19T03:39:42.420461+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:42.420461+0000","last_undegraded":"2024-04-19T03:39:42.420461+0000","last_fullsized":"2024-04-19T03:39:42.420461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413236+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:41.413236+0000","last_peered":"2024-04-19T03:39:41.413236+0000","last_clean":"2024-04-19T03:39:41.413236+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:41.413236+0000","last_undegraded":"2024-04-19T03:39:41.413236+0000","last_fullsized":"2024-04-19T03:39:41.413236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":114,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418792+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:42.418792+0000","last_peered":"2024-04-19T03:39:42.418792+0000","last_clean":"2024-04-19T03:39:42.418792+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:42.418792+0000","last_undegraded":"2024-04-19T03:39:42.418792+0000","last_fullsized":"2024-04-19T03:39:42.418792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412749+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:41.412749+0000","last_peered":"2024-04-19T03:39:41.412749+0000","last_clean":"2024-04-19T03:39:41.412749+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:41.412749+0000","last_undegraded":"2024-04-19T03:39:41.412749+0000","last_fullsized":"2024-04-19T03:39:41.412749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420618+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:42.420618+0000","last_peered":"2024-04-19T03:39:42.420618+0000","last_clean":"2024-04-19T03:39:42.420618+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:42.420618+0000","last_undegraded":"2024-04-19T03:39:42.420618+0000","last_fullsized":"2024-04-19T03:39:42.420618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":277,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.395654+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.395086+0000","last_became_peered":"2024-04-19T03:39:32.395086+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:15.390971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":112,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417330+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:42.417330+0000","last_peered":"2024-04-19T03:39:42.417330+0000","last_clean":"2024-04-19T03:39:42.417330+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:42.417330+0000","last_undegraded":"2024-04-19T03:39:42.417330+0000","last_fullsized":"2024-04-19T03:39:42.417330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8088,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413659+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:41.413659+0000","last_peered":"2024-04-19T03:39:41.413659+0000","last_clean":"2024-04-19T03:39:41.413659+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:41.413659+0000","last_undegraded":"2024-04-19T03:39:41.413659+0000","last_fullsized":"2024-04-19T03:39:41.413659+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390307+0000","last_change":"2024-04-19T03:39:32.399167+0000","last_active":"2024-04-19T03:39:37.390307+0000","last_peered":"2024-04-19T03:39:37.390307+0000","last_clean":"2024-04-19T03:39:37.390307+0000","last_became_active":"2024-04-19T03:39:32.398584+0000","last_became_peered":"2024-04-19T03:39:32.398584+0000","last_unstale":"2024-04-19T03:39:37.390307+0000","last_undegraded":"2024-04-19T03:39:37.390307+0000","last_fullsized":"2024-04-19T03:39:37.390307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:43.337624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412475+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:41.412475+0000","last_peered":"2024-04-19T03:39:41.412475+0000","last_clean":"2024-04-19T03:39:41.412475+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:41.412475+0000","last_undegraded":"2024-04-19T03:39:41.412475+0000","last_fullsized":"2024-04-19T03:39:41.412475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420399+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:42.420399+0000","last_peered":"2024-04-19T03:39:42.420399+0000","last_clean":"2024-04-19T03:39:42.420399+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:42.420399+0000","last_undegraded":"2024-04-19T03:39:42.420399+0000","last_fullsized":"2024-04-19T03:39:42.420399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390450+0000","last_change":"2024-04-19T03:39:32.393622+0000","last_active":"2024-04-19T03:39:37.390450+0000","last_peered":"2024-04-19T03:39:37.390450+0000","last_clean":"2024-04-19T03:39:37.390450+0000","last_became_active":"2024-04-19T03:39:32.393342+0000","last_became_peered":"2024-04-19T03:39:32.393342+0000","last_unstale":"2024-04-19T03:39:37.390450+0000","last_undegraded":"2024-04-19T03:39:37.390450+0000","last_fullsized":"2024-04-19T03:39:37.390450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:42.742836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419973+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:42.419973+0000","last_peered":"2024-04-19T03:39:42.419973+0000","last_clean":"2024-04-19T03:39:42.419973+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:42.419973+0000","last_undegraded":"2024-04-19T03:39:42.419973+0000","last_fullsized":"2024-04-19T03:39:42.419973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391314+0000","last_change":"2024-04-19T03:39:32.395946+0000","last_active":"2024-04-19T03:39:37.391314+0000","last_peered":"2024-04-19T03:39:37.391314+0000","last_clean":"2024-04-19T03:39:37.391314+0000","last_became_active":"2024-04-19T03:39:32.395348+0000","last_became_peered":"2024-04-19T03:39:32.395348+0000","last_unstale":"2024-04-19T03:39:37.391314+0000","last_undegraded":"2024-04-19T03:39:37.391314+0000","last_fullsized":"2024-04-19T03:39:37.391314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:41.036403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412623+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:41.412623+0000","last_peered":"2024-04-19T03:39:41.412623+0000","last_clean":"2024-04-19T03:39:41.412623+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:41.412623+0000","last_undegraded":"2024-04-19T03:39:41.412623+0000","last_fullsized":"2024-04-19T03:39:41.412623+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390632+0000","last_change":"2024-04-19T03:39:32.396079+0000","last_active":"2024-04-19T03:39:37.390632+0000","last_peered":"2024-04-19T03:39:37.390632+0000","last_clean":"2024-04-19T03:39:37.390632+0000","last_became_active":"2024-04-19T03:39:32.395721+0000","last_became_peered":"2024-04-19T03:39:32.395721+0000","last_unstale":"2024-04-19T03:39:37.390632+0000","last_undegraded":"2024-04-19T03:39:37.390632+0000","last_fullsized":"2024-04-19T03:39:37.390632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:08.221132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":96,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421710+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:42.421710+0000","last_peered":"2024-04-19T03:39:42.421710+0000","last_clean":"2024-04-19T03:39:42.421710+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:42.421710+0000","last_undegraded":"2024-04-19T03:39:42.421710+0000","last_fullsized":"2024-04-19T03:39:42.421710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413384+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:41.413384+0000","last_peered":"2024-04-19T03:39:41.413384+0000","last_clean":"2024-04-19T03:39:41.413384+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:41.413384+0000","last_undegraded":"2024-04-19T03:39:41.413384+0000","last_fullsized":"2024-04-19T03:39:41.413384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421814+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:42.421814+0000","last_peered":"2024-04-19T03:39:42.421814+0000","last_clean":"2024-04-19T03:39:42.421814+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:42.421814+0000","last_undegraded":"2024-04-19T03:39:42.421814+0000","last_fullsized":"2024-04-19T03:39:42.421814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2065,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413134+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:41.413134+0000","last_peered":"2024-04-19T03:39:41.413134+0000","last_clean":"2024-04-19T03:39:41.413134+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:41.413134+0000","last_undegraded":"2024-04-19T03:39:41.413134+0000","last_fullsized":"2024-04-19T03:39:41.413134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391794+0000","last_change":"2024-04-19T03:39:32.394854+0000","last_active":"2024-04-19T03:39:37.391794+0000","last_peered":"2024-04-19T03:39:37.391794+0000","last_clean":"2024-04-19T03:39:37.391794+0000","last_became_active":"2024-04-19T03:39:32.394482+0000","last_became_peered":"2024-04-19T03:39:32.394482+0000","last_unstale":"2024-04-19T03:39:37.391794+0000","last_undegraded":"2024-04-19T03:39:37.391794+0000","last_fullsized":"2024-04-19T03:39:37.391794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:16.631854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390884+0000","last_change":"2024-04-19T03:39:32.400848+0000","last_active":"2024-04-19T03:39:37.390884+0000","last_peered":"2024-04-19T03:39:37.390884+0000","last_clean":"2024-04-19T03:39:37.390884+0000","last_became_active":"2024-04-19T03:39:32.400572+0000","last_became_peered":"2024-04-19T03:39:32.400572+0000","last_unstale":"2024-04-19T03:39:37.390884+0000","last_undegraded":"2024-04-19T03:39:37.390884+0000","last_fullsized":"2024-04-19T03:39:37.390884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:28.052247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412986+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:41.412986+0000","last_peered":"2024-04-19T03:39:41.412986+0000","last_clean":"2024-04-19T03:39:41.412986+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:41.412986+0000","last_undegraded":"2024-04-19T03:39:41.412986+0000","last_fullsized":"2024-04-19T03:39:41.412986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413041+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:41.413041+0000","last_peered":"2024-04-19T03:39:41.413041+0000","last_clean":"2024-04-19T03:39:41.413041+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:41.413041+0000","last_undegraded":"2024-04-19T03:39:41.413041+0000","last_fullsized":"2024-04-19T03:39:41.413041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413409+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:41.413409+0000","last_peered":"2024-04-19T03:39:41.413409+0000","last_clean":"2024-04-19T03:39:41.413409+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:41.413409+0000","last_undegraded":"2024-04-19T03:39:41.413409+0000","last_fullsized":"2024-04-19T03:39:41.413409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390723+0000","last_change":"2024-04-19T03:39:32.400398+0000","last_active":"2024-04-19T03:39:37.390723+0000","last_peered":"2024-04-19T03:39:37.390723+0000","last_clean":"2024-04-19T03:39:37.390723+0000","last_became_active":"2024-04-19T03:39:32.399453+0000","last_became_peered":"2024-04-19T03:39:32.399453+0000","last_unstale":"2024-04-19T03:39:37.390723+0000","last_undegraded":"2024-04-19T03:39:37.390723+0000","last_fullsized":"2024-04-19T03:39:37.390723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:47.765222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2086,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390416+0000","last_change":"2024-04-19T03:39:32.399370+0000","last_active":"2024-04-19T03:39:37.390416+0000","last_peered":"2024-04-19T03:39:37.390416+0000","last_clean":"2024-04-19T03:39:37.390416+0000","last_became_active":"2024-04-19T03:39:32.398094+0000","last_became_peered":"2024-04-19T03:39:32.398094+0000","last_unstale":"2024-04-19T03:39:37.390416+0000","last_undegraded":"2024-04-19T03:39:37.390416+0000","last_fullsized":"2024-04-19T03:39:37.390416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:58.061381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413825+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:41.413825+0000","last_peered":"2024-04-19T03:39:41.413825+0000","last_clean":"2024-04-19T03:39:41.413825+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:41.413825+0000","last_undegraded":"2024-04-19T03:39:41.413825+0000","last_fullsized":"2024-04-19T03:39:41.413825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":82,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390122+0000","last_change":"2024-04-19T03:39:32.399381+0000","last_active":"2024-04-19T03:39:37.390122+0000","last_peered":"2024-04-19T03:39:37.390122+0000","last_clean":"2024-04-19T03:39:37.390122+0000","last_became_active":"2024-04-19T03:39:32.398858+0000","last_became_peered":"2024-04-19T03:39:32.398858+0000","last_unstale":"2024-04-19T03:39:37.390122+0000","last_undegraded":"2024-04-19T03:39:37.390122+0000","last_fullsized":"2024-04-19T03:39:37.390122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:27.528014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419060+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:42.419060+0000","last_peered":"2024-04-19T03:39:42.419060+0000","last_clean":"2024-04-19T03:39:42.419060+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:42.419060+0000","last_undegraded":"2024-04-19T03:39:42.419060+0000","last_fullsized":"2024-04-19T03:39:42.419060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412882+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:41.412882+0000","last_peered":"2024-04-19T03:39:41.412882+0000","last_clean":"2024-04-19T03:39:41.412882+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:41.412882+0000","last_undegraded":"2024-04-19T03:39:41.412882+0000","last_fullsized":"2024-04-19T03:39:41.412882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420189+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:42.420189+0000","last_peered":"2024-04-19T03:39:42.420189+0000","last_clean":"2024-04-19T03:39:42.420189+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:42.420189+0000","last_undegraded":"2024-04-19T03:39:42.420189+0000","last_fullsized":"2024-04-19T03:39:42.420189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2135,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390302+0000","last_change":"2024-04-19T03:39:32.402322+0000","last_active":"2024-04-19T03:39:37.390302+0000","last_peered":"2024-04-19T03:39:37.390302+0000","last_clean":"2024-04-19T03:39:37.390302+0000","last_became_active":"2024-04-19T03:39:32.401133+0000","last_became_peered":"2024-04-19T03:39:32.401133+0000","last_unstale":"2024-04-19T03:39:37.390302+0000","last_undegraded":"2024-04-19T03:39:37.390302+0000","last_fullsized":"2024-04-19T03:39:37.390302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:33:33.557434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389840+0000","last_change":"2024-04-19T03:39:32.401135+0000","last_active":"2024-04-19T03:39:37.389840+0000","last_peered":"2024-04-19T03:39:37.389840+0000","last_clean":"2024-04-19T03:39:37.389840+0000","last_became_active":"2024-04-19T03:39:32.400869+0000","last_became_peered":"2024-04-19T03:39:32.400869+0000","last_unstale":"2024-04-19T03:39:37.389840+0000","last_undegraded":"2024-04-19T03:39:37.389840+0000","last_fullsized":"2024-04-19T03:39:37.389840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:06.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":99,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417609+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:42.417609+0000","last_peered":"2024-04-19T03:39:42.417609+0000","last_clean":"2024-04-19T03:39:42.417609+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:42.417609+0000","last_undegraded":"2024-04-19T03:39:42.417609+0000","last_fullsized":"2024-04-19T03:39:42.417609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2087,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413001+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:41.413001+0000","last_peered":"2024-04-19T03:39:41.413001+0000","last_clean":"2024-04-19T03:39:41.413001+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:41.413001+0000","last_undegraded":"2024-04-19T03:39:41.413001+0000","last_fullsized":"2024-04-19T03:39:41.413001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421424+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:42.421424+0000","last_peered":"2024-04-19T03:39:42.421424+0000","last_clean":"2024-04-19T03:39:42.421424+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:42.421424+0000","last_undegraded":"2024-04-19T03:39:42.421424+0000","last_fullsized":"2024-04-19T03:39:42.421424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413465+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:41.413465+0000","last_peered":"2024-04-19T03:39:41.413465+0000","last_clean":"2024-04-19T03:39:41.413465+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:41.413465+0000","last_undegraded":"2024-04-19T03:39:41.413465+0000","last_fullsized":"2024-04-19T03:39:41.413465+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481799,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1644,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1683456,"data_stored":1254158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369836,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002004,"statfs":{"total":96636764160,"available":96258052096,"internally_reserved":0,"allocated":1671168,"data_stored":1252936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":782336,"data_stored":378148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:46.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:47.389 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:47.392 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:47.404 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-04-19T03:39:46.336162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795892,"kb_used_data":4040,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319628,"statfs":{"total":289910292480,"available":289095299072,"internally_reserved":0,"allocated":4136960,"data_stored":2885242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.931943"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2066,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413844+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:41.413844+0000","last_peered":"2024-04-19T03:39:41.413844+0000","last_clean":"2024-04-19T03:39:41.413844+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:41.413844+0000","last_undegraded":"2024-04-19T03:39:41.413844+0000","last_fullsized":"2024-04-19T03:39:41.413844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413352+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:41.413352+0000","last_peered":"2024-04-19T03:39:41.413352+0000","last_clean":"2024-04-19T03:39:41.413352+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:41.413352+0000","last_undegraded":"2024-04-19T03:39:41.413352+0000","last_fullsized":"2024-04-19T03:39:41.413352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4081,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391168+0000","last_change":"2024-04-19T03:39:32.399459+0000","last_active":"2024-04-19T03:39:37.391168+0000","last_peered":"2024-04-19T03:39:37.391168+0000","last_clean":"2024-04-19T03:39:37.391168+0000","last_became_active":"2024-04-19T03:39:32.397753+0000","last_became_peered":"2024-04-19T03:39:32.397753+0000","last_unstale":"2024-04-19T03:39:37.391168+0000","last_undegraded":"2024-04-19T03:39:37.391168+0000","last_fullsized":"2024-04-19T03:39:37.391168+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:54.322202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390587+0000","last_change":"2024-04-19T03:39:32.400611+0000","last_active":"2024-04-19T03:39:37.390587+0000","last_peered":"2024-04-19T03:39:37.390587+0000","last_clean":"2024-04-19T03:39:37.390587+0000","last_became_active":"2024-04-19T03:39:32.399743+0000","last_became_peered":"2024-04-19T03:39:32.399743+0000","last_unstale":"2024-04-19T03:39:37.390587+0000","last_undegraded":"2024-04-19T03:39:37.390587+0000","last_fullsized":"2024-04-19T03:39:37.390587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:40:42.830458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413052+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:41.413052+0000","last_peered":"2024-04-19T03:39:41.413052+0000","last_clean":"2024-04-19T03:39:41.413052+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:41.413052+0000","last_undegraded":"2024-04-19T03:39:41.413052+0000","last_fullsized":"2024-04-19T03:39:41.413052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":81,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390192+0000","last_change":"2024-04-19T03:39:32.398542+0000","last_active":"2024-04-19T03:39:37.390192+0000","last_peered":"2024-04-19T03:39:37.390192+0000","last_clean":"2024-04-19T03:39:37.390192+0000","last_became_active":"2024-04-19T03:39:32.398227+0000","last_became_peered":"2024-04-19T03:39:32.398227+0000","last_unstale":"2024-04-19T03:39:37.390192+0000","last_undegraded":"2024-04-19T03:39:37.390192+0000","last_fullsized":"2024-04-19T03:39:37.390192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:10:16.307090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390010+0000","last_change":"2024-04-19T03:39:32.396074+0000","last_active":"2024-04-19T03:39:37.390010+0000","last_peered":"2024-04-19T03:39:37.390010+0000","last_clean":"2024-04-19T03:39:37.390010+0000","last_became_active":"2024-04-19T03:39:32.395729+0000","last_became_peered":"2024-04-19T03:39:32.395729+0000","last_unstale":"2024-04-19T03:39:37.390010+0000","last_undegraded":"2024-04-19T03:39:37.390010+0000","last_fullsized":"2024-04-19T03:39:37.390010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:29.445916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389883+0000","last_change":"2024-04-19T03:39:32.400603+0000","last_active":"2024-04-19T03:39:37.389883+0000","last_peered":"2024-04-19T03:39:37.389883+0000","last_clean":"2024-04-19T03:39:37.389883+0000","last_became_active":"2024-04-19T03:39:32.397995+0000","last_became_peered":"2024-04-19T03:39:32.397995+0000","last_unstale":"2024-04-19T03:39:37.389883+0000","last_undegraded":"2024-04-19T03:39:37.389883+0000","last_fullsized":"2024-04-19T03:39:37.389883+0000","mapping_epoch":85,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:57.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6161,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418326+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:42.418326+0000","last_peered":"2024-04-19T03:39:42.418326+0000","last_clean":"2024-04-19T03:39:42.418326+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:42.418326+0000","last_undegraded":"2024-04-19T03:39:42.418326+0000","last_fullsized":"2024-04-19T03:39:42.418326+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413649+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:41.413649+0000","last_peered":"2024-04-19T03:39:41.413649+0000","last_clean":"2024-04-19T03:39:41.413649+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:41.413649+0000","last_undegraded":"2024-04-19T03:39:41.413649+0000","last_fullsized":"2024-04-19T03:39:41.413649+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4027,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390781+0000","last_change":"2024-04-19T03:39:32.400179+0000","last_active":"2024-04-19T03:39:37.390781+0000","last_peered":"2024-04-19T03:39:37.390781+0000","last_clean":"2024-04-19T03:39:37.390781+0000","last_became_active":"2024-04-19T03:39:32.397994+0000","last_became_peered":"2024-04-19T03:39:32.397994+0000","last_unstale":"2024-04-19T03:39:37.390781+0000","last_undegraded":"2024-04-19T03:39:37.390781+0000","last_fullsized":"2024-04-19T03:39:37.390781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:33.299512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413111+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:41.413111+0000","last_peered":"2024-04-19T03:39:41.413111+0000","last_clean":"2024-04-19T03:39:41.413111+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:41.413111+0000","last_undegraded":"2024-04-19T03:39:41.413111+0000","last_fullsized":"2024-04-19T03:39:41.413111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2079,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412862+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:41.412862+0000","last_peered":"2024-04-19T03:39:41.412862+0000","last_clean":"2024-04-19T03:39:41.412862+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:41.412862+0000","last_undegraded":"2024-04-19T03:39:41.412862+0000","last_fullsized":"2024-04-19T03:39:41.412862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390697+0000","last_change":"2024-04-19T03:39:32.395332+0000","last_active":"2024-04-19T03:39:37.390697+0000","last_peered":"2024-04-19T03:39:37.390697+0000","last_clean":"2024-04-19T03:39:37.390697+0000","last_became_active":"2024-04-19T03:39:32.392604+0000","last_became_peered":"2024-04-19T03:39:32.392604+0000","last_unstale":"2024-04-19T03:39:37.390697+0000","last_undegraded":"2024-04-19T03:39:37.390697+0000","last_fullsized":"2024-04-19T03:39:37.390697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:12.846842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2111,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390584+0000","last_change":"2024-04-19T03:39:32.395011+0000","last_active":"2024-04-19T03:39:37.390584+0000","last_peered":"2024-04-19T03:39:37.390584+0000","last_clean":"2024-04-19T03:39:37.390584+0000","last_became_active":"2024-04-19T03:39:32.392633+0000","last_became_peered":"2024-04-19T03:39:32.392633+0000","last_unstale":"2024-04-19T03:39:37.390584+0000","last_undegraded":"2024-04-19T03:39:37.390584+0000","last_fullsized":"2024-04-19T03:39:37.390584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:56.349038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2088,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389956+0000","last_change":"2024-04-19T03:39:32.396919+0000","last_active":"2024-04-19T03:39:37.389956+0000","last_peered":"2024-04-19T03:39:37.389956+0000","last_clean":"2024-04-19T03:39:37.389956+0000","last_became_active":"2024-04-19T03:39:32.395719+0000","last_became_peered":"2024-04-19T03:39:32.395719+0000","last_unstale":"2024-04-19T03:39:37.389956+0000","last_undegraded":"2024-04-19T03:39:37.389956+0000","last_fullsized":"2024-04-19T03:39:37.389956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:08.092382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419797+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:42.419797+0000","last_peered":"2024-04-19T03:39:42.419797+0000","last_clean":"2024-04-19T03:39:42.419797+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:42.419797+0000","last_undegraded":"2024-04-19T03:39:42.419797+0000","last_fullsized":"2024-04-19T03:39:42.419797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413507+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:41.413507+0000","last_peered":"2024-04-19T03:39:41.413507+0000","last_clean":"2024-04-19T03:39:41.413507+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:41.413507+0000","last_undegraded":"2024-04-19T03:39:41.413507+0000","last_fullsized":"2024-04-19T03:39:41.413507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4139,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419233+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:42.419233+0000","last_peered":"2024-04-19T03:39:42.419233+0000","last_clean":"2024-04-19T03:39:42.419233+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:42.419233+0000","last_undegraded":"2024-04-19T03:39:42.419233+0000","last_fullsized":"2024-04-19T03:39:42.419233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390528+0000","last_change":"2024-04-19T03:39:32.401641+0000","last_active":"2024-04-19T03:39:37.390528+0000","last_peered":"2024-04-19T03:39:37.390528+0000","last_clean":"2024-04-19T03:39:37.390528+0000","last_became_active":"2024-04-19T03:39:32.399814+0000","last_became_peered":"2024-04-19T03:39:32.399814+0000","last_unstale":"2024-04-19T03:39:37.390528+0000","last_undegraded":"2024-04-19T03:39:37.390528+0000","last_fullsized":"2024-04-19T03:39:37.390528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:40.327326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390386+0000","last_change":"2024-04-19T03:39:32.400170+0000","last_active":"2024-04-19T03:39:37.390386+0000","last_peered":"2024-04-19T03:39:37.390386+0000","last_clean":"2024-04-19T03:39:37.390386+0000","last_became_active":"2024-04-19T03:39:32.399694+0000","last_became_peered":"2024-04-19T03:39:32.399694+0000","last_unstale":"2024-04-19T03:39:37.390386+0000","last_undegraded":"2024-04-19T03:39:37.390386+0000","last_fullsized":"2024-04-19T03:39:37.390386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:18.828239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412798+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:41.412798+0000","last_peered":"2024-04-19T03:39:41.412798+0000","last_clean":"2024-04-19T03:39:41.412798+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:41.412798+0000","last_undegraded":"2024-04-19T03:39:41.412798+0000","last_fullsized":"2024-04-19T03:39:41.412798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2155,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418161+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:42.418161+0000","last_peered":"2024-04-19T03:39:42.418161+0000","last_clean":"2024-04-19T03:39:42.418161+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:42.418161+0000","last_undegraded":"2024-04-19T03:39:42.418161+0000","last_fullsized":"2024-04-19T03:39:42.418161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412776+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:41.412776+0000","last_peered":"2024-04-19T03:39:41.412776+0000","last_clean":"2024-04-19T03:39:41.412776+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:41.412776+0000","last_undegraded":"2024-04-19T03:39:41.412776+0000","last_fullsized":"2024-04-19T03:39:41.412776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2094,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413817+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:41.413817+0000","last_peered":"2024-04-19T03:39:41.413817+0000","last_clean":"2024-04-19T03:39:41.413817+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:41.413817+0000","last_undegraded":"2024-04-19T03:39:41.413817+0000","last_fullsized":"2024-04-19T03:39:41.413817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419868+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:42.419868+0000","last_peered":"2024-04-19T03:39:42.419868+0000","last_clean":"2024-04-19T03:39:42.419868+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:42.419868+0000","last_undegraded":"2024-04-19T03:39:42.419868+0000","last_fullsized":"2024-04-19T03:39:42.419868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391435+0000","last_change":"2024-04-19T03:39:32.397511+0000","last_active":"2024-04-19T03:39:37.391435+0000","last_peered":"2024-04-19T03:39:37.391435+0000","last_clean":"2024-04-19T03:39:37.391435+0000","last_became_active":"2024-04-19T03:39:32.396369+0000","last_became_peered":"2024-04-19T03:39:32.396369+0000","last_unstale":"2024-04-19T03:39:37.391435+0000","last_undegraded":"2024-04-19T03:39:37.391435+0000","last_fullsized":"2024-04-19T03:39:37.391435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:02:22.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412750+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:41.412750+0000","last_peered":"2024-04-19T03:39:41.412750+0000","last_clean":"2024-04-19T03:39:41.412750+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:41.412750+0000","last_undegraded":"2024-04-19T03:39:41.412750+0000","last_fullsized":"2024-04-19T03:39:41.412750+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413799+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:41.413799+0000","last_peered":"2024-04-19T03:39:41.413799+0000","last_clean":"2024-04-19T03:39:41.413799+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:41.413799+0000","last_undegraded":"2024-04-19T03:39:41.413799+0000","last_fullsized":"2024-04-19T03:39:41.413799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418408+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:42.418408+0000","last_peered":"2024-04-19T03:39:42.418408+0000","last_clean":"2024-04-19T03:39:42.418408+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:42.418408+0000","last_undegraded":"2024-04-19T03:39:42.418408+0000","last_fullsized":"2024-04-19T03:39:42.418408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418928+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:42.418928+0000","last_peered":"2024-04-19T03:39:42.418928+0000","last_clean":"2024-04-19T03:39:42.418928+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:42.418928+0000","last_undegraded":"2024-04-19T03:39:42.418928+0000","last_fullsized":"2024-04-19T03:39:42.418928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420339+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:42.420339+0000","last_peered":"2024-04-19T03:39:42.420339+0000","last_clean":"2024-04-19T03:39:42.420339+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:42.420339+0000","last_undegraded":"2024-04-19T03:39:42.420339+0000","last_fullsized":"2024-04-19T03:39:42.420339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413707+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:41.413707+0000","last_peered":"2024-04-19T03:39:41.413707+0000","last_clean":"2024-04-19T03:39:41.413707+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:41.413707+0000","last_undegraded":"2024-04-19T03:39:41.413707+0000","last_fullsized":"2024-04-19T03:39:41.413707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420283+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:42.420283+0000","last_peered":"2024-04-19T03:39:42.420283+0000","last_clean":"2024-04-19T03:39:42.420283+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:42.420283+0000","last_undegraded":"2024-04-19T03:39:42.420283+0000","last_fullsized":"2024-04-19T03:39:42.420283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420113+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:42.420113+0000","last_peered":"2024-04-19T03:39:42.420113+0000","last_clean":"2024-04-19T03:39:42.420113+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:42.420113+0000","last_undegraded":"2024-04-19T03:39:42.420113+0000","last_fullsized":"2024-04-19T03:39:42.420113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.400643+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.398090+0000","last_became_peered":"2024-04-19T03:39:32.398090+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:12:38.136122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418025+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:42.418025+0000","last_peered":"2024-04-19T03:39:42.418025+0000","last_clean":"2024-04-19T03:39:42.418025+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:42.418025+0000","last_undegraded":"2024-04-19T03:39:42.418025+0000","last_fullsized":"2024-04-19T03:39:42.418025+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413667+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:41.413667+0000","last_peered":"2024-04-19T03:39:41.413667+0000","last_clean":"2024-04-19T03:39:41.413667+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:41.413667+0000","last_undegraded":"2024-04-19T03:39:41.413667+0000","last_fullsized":"2024-04-19T03:39:41.413667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4150,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420052+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:42.420052+0000","last_peered":"2024-04-19T03:39:42.420052+0000","last_clean":"2024-04-19T03:39:42.420052+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:42.420052+0000","last_undegraded":"2024-04-19T03:39:42.420052+0000","last_fullsized":"2024-04-19T03:39:42.420052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":180,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391107+0000","last_change":"2024-04-19T03:39:32.394904+0000","last_active":"2024-04-19T03:39:37.391107+0000","last_peered":"2024-04-19T03:39:37.391107+0000","last_clean":"2024-04-19T03:39:37.391107+0000","last_became_active":"2024-04-19T03:39:32.394518+0000","last_became_peered":"2024-04-19T03:39:32.394518+0000","last_unstale":"2024-04-19T03:39:37.391107+0000","last_undegraded":"2024-04-19T03:39:37.391107+0000","last_fullsized":"2024-04-19T03:39:37.391107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:49.767040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4171,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390892+0000","last_change":"2024-04-19T03:39:32.395658+0000","last_active":"2024-04-19T03:39:37.390892+0000","last_peered":"2024-04-19T03:39:37.390892+0000","last_clean":"2024-04-19T03:39:37.390892+0000","last_became_active":"2024-04-19T03:39:32.393165+0000","last_became_peered":"2024-04-19T03:39:32.393165+0000","last_unstale":"2024-04-19T03:39:37.390892+0000","last_undegraded":"2024-04-19T03:39:37.390892+0000","last_fullsized":"2024-04-19T03:39:37.390892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:09.225415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390506+0000","last_change":"2024-04-19T03:39:32.400220+0000","last_active":"2024-04-19T03:39:37.390506+0000","last_peered":"2024-04-19T03:39:37.390506+0000","last_clean":"2024-04-19T03:39:37.390506+0000","last_became_active":"2024-04-19T03:39:32.399717+0000","last_became_peered":"2024-04-19T03:39:32.399717+0000","last_unstale":"2024-04-19T03:39:37.390506+0000","last_undegraded":"2024-04-19T03:39:37.390506+0000","last_fullsized":"2024-04-19T03:39:37.390506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:01.543694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2062,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413157+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:41.413157+0000","last_peered":"2024-04-19T03:39:41.413157+0000","last_clean":"2024-04-19T03:39:41.413157+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:41.413157+0000","last_undegraded":"2024-04-19T03:39:41.413157+0000","last_fullsized":"2024-04-19T03:39:41.413157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419933+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:42.419933+0000","last_peered":"2024-04-19T03:39:42.419933+0000","last_clean":"2024-04-19T03:39:42.419933+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:42.419933+0000","last_undegraded":"2024-04-19T03:39:42.419933+0000","last_fullsized":"2024-04-19T03:39:42.419933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413927+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:41.413927+0000","last_peered":"2024-04-19T03:39:41.413927+0000","last_clean":"2024-04-19T03:39:41.413927+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:41.413927+0000","last_undegraded":"2024-04-19T03:39:41.413927+0000","last_fullsized":"2024-04-19T03:39:41.413927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412670+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:41.412670+0000","last_peered":"2024-04-19T03:39:41.412670+0000","last_clean":"2024-04-19T03:39:41.412670+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:41.412670+0000","last_undegraded":"2024-04-19T03:39:41.412670+0000","last_fullsized":"2024-04-19T03:39:41.412670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":110,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419704+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:42.419704+0000","last_peered":"2024-04-19T03:39:42.419704+0000","last_clean":"2024-04-19T03:39:42.419704+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:42.419704+0000","last_undegraded":"2024-04-19T03:39:42.419704+0000","last_fullsized":"2024-04-19T03:39:42.419704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390748+0000","last_change":"2024-04-19T03:39:32.395496+0000","last_active":"2024-04-19T03:39:37.390748+0000","last_peered":"2024-04-19T03:39:37.390748+0000","last_clean":"2024-04-19T03:39:37.390748+0000","last_became_active":"2024-04-19T03:39:32.394631+0000","last_became_peered":"2024-04-19T03:39:32.394631+0000","last_unstale":"2024-04-19T03:39:37.390748+0000","last_undegraded":"2024-04-19T03:39:37.390748+0000","last_fullsized":"2024-04-19T03:39:37.390748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:10.062803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2206,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420401+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:42.420401+0000","last_peered":"2024-04-19T03:39:42.420401+0000","last_clean":"2024-04-19T03:39:42.420401+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:42.420401+0000","last_undegraded":"2024-04-19T03:39:42.420401+0000","last_fullsized":"2024-04-19T03:39:42.420401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391714+0000","last_change":"2024-04-19T03:39:32.396659+0000","last_active":"2024-04-19T03:39:37.391714+0000","last_peered":"2024-04-19T03:39:37.391714+0000","last_clean":"2024-04-19T03:39:37.391714+0000","last_became_active":"2024-04-19T03:39:32.396285+0000","last_became_peered":"2024-04-19T03:39:32.396285+0000","last_unstale":"2024-04-19T03:39:37.391714+0000","last_undegraded":"2024-04-19T03:39:37.391714+0000","last_fullsized":"2024-04-19T03:39:37.391714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:04.132840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412339+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:41.412339+0000","last_peered":"2024-04-19T03:39:41.412339+0000","last_clean":"2024-04-19T03:39:41.412339+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:41.412339+0000","last_undegraded":"2024-04-19T03:39:41.412339+0000","last_fullsized":"2024-04-19T03:39:41.412339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413240+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:41.413240+0000","last_peered":"2024-04-19T03:39:41.413240+0000","last_clean":"2024-04-19T03:39:41.413240+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:41.413240+0000","last_undegraded":"2024-04-19T03:39:41.413240+0000","last_fullsized":"2024-04-19T03:39:41.413240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412785+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:41.412785+0000","last_peered":"2024-04-19T03:39:41.412785+0000","last_clean":"2024-04-19T03:39:41.412785+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:41.412785+0000","last_undegraded":"2024-04-19T03:39:41.412785+0000","last_fullsized":"2024-04-19T03:39:41.412785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391598+0000","last_change":"2024-04-19T03:39:32.398006+0000","last_active":"2024-04-19T03:39:37.391598+0000","last_peered":"2024-04-19T03:39:37.391598+0000","last_clean":"2024-04-19T03:39:37.391598+0000","last_became_active":"2024-04-19T03:39:32.397734+0000","last_became_peered":"2024-04-19T03:39:32.397734+0000","last_unstale":"2024-04-19T03:39:37.391598+0000","last_undegraded":"2024-04-19T03:39:37.391598+0000","last_fullsized":"2024-04-19T03:39:37.391598+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:57:38.017118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2067,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390061+0000","last_change":"2024-04-19T03:39:32.401634+0000","last_active":"2024-04-19T03:39:37.390061+0000","last_peered":"2024-04-19T03:39:37.390061+0000","last_clean":"2024-04-19T03:39:37.390061+0000","last_became_active":"2024-04-19T03:39:32.398779+0000","last_became_peered":"2024-04-19T03:39:32.398779+0000","last_unstale":"2024-04-19T03:39:37.390061+0000","last_undegraded":"2024-04-19T03:39:37.390061+0000","last_fullsized":"2024-04-19T03:39:37.390061+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:42.670329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390983+0000","last_change":"2024-04-19T03:39:32.395971+0000","last_active":"2024-04-19T03:39:37.390983+0000","last_peered":"2024-04-19T03:39:37.390983+0000","last_clean":"2024-04-19T03:39:37.390983+0000","last_became_active":"2024-04-19T03:39:32.395700+0000","last_became_peered":"2024-04-19T03:39:32.395700+0000","last_unstale":"2024-04-19T03:39:37.390983+0000","last_undegraded":"2024-04-19T03:39:37.390983+0000","last_fullsized":"2024-04-19T03:39:37.390983+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:56:26.477882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421316+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:42.421316+0000","last_peered":"2024-04-19T03:39:42.421316+0000","last_clean":"2024-04-19T03:39:42.421316+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:42.421316+0000","last_undegraded":"2024-04-19T03:39:42.421316+0000","last_fullsized":"2024-04-19T03:39:42.421316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421232+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:42.421232+0000","last_peered":"2024-04-19T03:39:42.421232+0000","last_clean":"2024-04-19T03:39:42.421232+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:42.421232+0000","last_undegraded":"2024-04-19T03:39:42.421232+0000","last_fullsized":"2024-04-19T03:39:42.421232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2094,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390678+0000","last_change":"2024-04-19T03:39:32.399496+0000","last_active":"2024-04-19T03:39:37.390678+0000","last_peered":"2024-04-19T03:39:37.390678+0000","last_clean":"2024-04-19T03:39:37.390678+0000","last_became_active":"2024-04-19T03:39:32.398117+0000","last_became_peered":"2024-04-19T03:39:32.398117+0000","last_unstale":"2024-04-19T03:39:37.390678+0000","last_undegraded":"2024-04-19T03:39:37.390678+0000","last_fullsized":"2024-04-19T03:39:37.390678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:05.987207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390258+0000","last_change":"2024-04-19T03:39:32.394935+0000","last_active":"2024-04-19T03:39:37.390258+0000","last_peered":"2024-04-19T03:39:37.390258+0000","last_clean":"2024-04-19T03:39:37.390258+0000","last_became_active":"2024-04-19T03:39:32.394624+0000","last_became_peered":"2024-04-19T03:39:32.394624+0000","last_unstale":"2024-04-19T03:39:37.390258+0000","last_undegraded":"2024-04-19T03:39:37.390258+0000","last_fullsized":"2024-04-19T03:39:37.390258+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:11.842559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391395+0000","last_change":"2024-04-19T03:39:32.396066+0000","last_active":"2024-04-19T03:39:37.391395+0000","last_peered":"2024-04-19T03:39:37.391395+0000","last_clean":"2024-04-19T03:39:37.391395+0000","last_became_active":"2024-04-19T03:39:32.394630+0000","last_became_peered":"2024-04-19T03:39:32.394630+0000","last_unstale":"2024-04-19T03:39:37.391395+0000","last_undegraded":"2024-04-19T03:39:37.391395+0000","last_fullsized":"2024-04-19T03:39:37.391395+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412529+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:41.412529+0000","last_peered":"2024-04-19T03:39:41.412529+0000","last_clean":"2024-04-19T03:39:41.412529+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:41.412529+0000","last_undegraded":"2024-04-19T03:39:41.412529+0000","last_fullsized":"2024-04-19T03:39:41.412529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391415+0000","last_change":"2024-04-19T03:39:32.395663+0000","last_active":"2024-04-19T03:39:37.391415+0000","last_peered":"2024-04-19T03:39:37.391415+0000","last_clean":"2024-04-19T03:39:37.391415+0000","last_became_active":"2024-04-19T03:39:32.394303+0000","last_became_peered":"2024-04-19T03:39:32.394303+0000","last_unstale":"2024-04-19T03:39:37.391415+0000","last_undegraded":"2024-04-19T03:39:37.391415+0000","last_fullsized":"2024-04-19T03:39:37.391415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:42.996316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412603+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:41.412603+0000","last_peered":"2024-04-19T03:39:41.412603+0000","last_clean":"2024-04-19T03:39:41.412603+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:41.412603+0000","last_undegraded":"2024-04-19T03:39:41.412603+0000","last_fullsized":"2024-04-19T03:39:41.412603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6118,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420024+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:42.420024+0000","last_peered":"2024-04-19T03:39:42.420024+0000","last_clean":"2024-04-19T03:39:42.420024+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:42.420024+0000","last_undegraded":"2024-04-19T03:39:42.420024+0000","last_fullsized":"2024-04-19T03:39:42.420024+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419894+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:42.419894+0000","last_peered":"2024-04-19T03:39:42.419894+0000","last_clean":"2024-04-19T03:39:42.419894+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:42.419894+0000","last_undegraded":"2024-04-19T03:39:42.419894+0000","last_fullsized":"2024-04-19T03:39:42.419894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413757+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:41.413757+0000","last_peered":"2024-04-19T03:39:41.413757+0000","last_clean":"2024-04-19T03:39:41.413757+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:41.413757+0000","last_undegraded":"2024-04-19T03:39:41.413757+0000","last_fullsized":"2024-04-19T03:39:41.413757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420461+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:42.420461+0000","last_peered":"2024-04-19T03:39:42.420461+0000","last_clean":"2024-04-19T03:39:42.420461+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:42.420461+0000","last_undegraded":"2024-04-19T03:39:42.420461+0000","last_fullsized":"2024-04-19T03:39:42.420461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413236+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:41.413236+0000","last_peered":"2024-04-19T03:39:41.413236+0000","last_clean":"2024-04-19T03:39:41.413236+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:41.413236+0000","last_undegraded":"2024-04-19T03:39:41.413236+0000","last_fullsized":"2024-04-19T03:39:41.413236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":114,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418792+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:42.418792+0000","last_peered":"2024-04-19T03:39:42.418792+0000","last_clean":"2024-04-19T03:39:42.418792+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:42.418792+0000","last_undegraded":"2024-04-19T03:39:42.418792+0000","last_fullsized":"2024-04-19T03:39:42.418792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412749+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:41.412749+0000","last_peered":"2024-04-19T03:39:41.412749+0000","last_clean":"2024-04-19T03:39:41.412749+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:41.412749+0000","last_undegraded":"2024-04-19T03:39:41.412749+0000","last_fullsized":"2024-04-19T03:39:41.412749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420618+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:42.420618+0000","last_peered":"2024-04-19T03:39:42.420618+0000","last_clean":"2024-04-19T03:39:42.420618+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:42.420618+0000","last_undegraded":"2024-04-19T03:39:42.420618+0000","last_fullsized":"2024-04-19T03:39:42.420618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":277,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.395654+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.395086+0000","last_became_peered":"2024-04-19T03:39:32.395086+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:15.390971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":112,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417330+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:42.417330+0000","last_peered":"2024-04-19T03:39:42.417330+0000","last_clean":"2024-04-19T03:39:42.417330+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:42.417330+0000","last_undegraded":"2024-04-19T03:39:42.417330+0000","last_fullsized":"2024-04-19T03:39:42.417330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8088,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413659+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:41.413659+0000","last_peered":"2024-04-19T03:39:41.413659+0000","last_clean":"2024-04-19T03:39:41.413659+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:41.413659+0000","last_undegraded":"2024-04-19T03:39:41.413659+0000","last_fullsized":"2024-04-19T03:39:41.413659+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390307+0000","last_change":"2024-04-19T03:39:32.399167+0000","last_active":"2024-04-19T03:39:37.390307+0000","last_peered":"2024-04-19T03:39:37.390307+0000","last_clean":"2024-04-19T03:39:37.390307+0000","last_became_active":"2024-04-19T03:39:32.398584+0000","last_became_peered":"2024-04-19T03:39:32.398584+0000","last_unstale":"2024-04-19T03:39:37.390307+0000","last_undegraded":"2024-04-19T03:39:37.390307+0000","last_fullsized":"2024-04-19T03:39:37.390307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:43.337624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412475+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:41.412475+0000","last_peered":"2024-04-19T03:39:41.412475+0000","last_clean":"2024-04-19T03:39:41.412475+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:41.412475+0000","last_undegraded":"2024-04-19T03:39:41.412475+0000","last_fullsized":"2024-04-19T03:39:41.412475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420399+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:42.420399+0000","last_peered":"2024-04-19T03:39:42.420399+0000","last_clean":"2024-04-19T03:39:42.420399+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:42.420399+0000","last_undegraded":"2024-04-19T03:39:42.420399+0000","last_fullsized":"2024-04-19T03:39:42.420399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390450+0000","last_change":"2024-04-19T03:39:32.393622+0000","last_active":"2024-04-19T03:39:37.390450+0000","last_peered":"2024-04-19T03:39:37.390450+0000","last_clean":"2024-04-19T03:39:37.390450+0000","last_became_active":"2024-04-19T03:39:32.393342+0000","last_became_peered":"2024-04-19T03:39:32.393342+0000","last_unstale":"2024-04-19T03:39:37.390450+0000","last_undegraded":"2024-04-19T03:39:37.390450+0000","last_fullsized":"2024-04-19T03:39:37.390450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:42.742836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419973+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:42.419973+0000","last_peered":"2024-04-19T03:39:42.419973+0000","last_clean":"2024-04-19T03:39:42.419973+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:42.419973+0000","last_undegraded":"2024-04-19T03:39:42.419973+0000","last_fullsized":"2024-04-19T03:39:42.419973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391314+0000","last_change":"2024-04-19T03:39:32.395946+0000","last_active":"2024-04-19T03:39:37.391314+0000","last_peered":"2024-04-19T03:39:37.391314+0000","last_clean":"2024-04-19T03:39:37.391314+0000","last_became_active":"2024-04-19T03:39:32.395348+0000","last_became_peered":"2024-04-19T03:39:32.395348+0000","last_unstale":"2024-04-19T03:39:37.391314+0000","last_undegraded":"2024-04-19T03:39:37.391314+0000","last_fullsized":"2024-04-19T03:39:37.391314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:41.036403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412623+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:41.412623+0000","last_peered":"2024-04-19T03:39:41.412623+0000","last_clean":"2024-04-19T03:39:41.412623+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:41.412623+0000","last_undegraded":"2024-04-19T03:39:41.412623+0000","last_fullsized":"2024-04-19T03:39:41.412623+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390632+0000","last_change":"2024-04-19T03:39:32.396079+0000","last_active":"2024-04-19T03:39:37.390632+0000","last_peered":"2024-04-19T03:39:37.390632+0000","last_clean":"2024-04-19T03:39:37.390632+0000","last_became_active":"2024-04-19T03:39:32.395721+0000","last_became_peered":"2024-04-19T03:39:32.395721+0000","last_unstale":"2024-04-19T03:39:37.390632+0000","last_undegraded":"2024-04-19T03:39:37.390632+0000","last_fullsized":"2024-04-19T03:39:37.390632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:08.221132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":96,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421710+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:42.421710+0000","last_peered":"2024-04-19T03:39:42.421710+0000","last_clean":"2024-04-19T03:39:42.421710+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:42.421710+0000","last_undegraded":"2024-04-19T03:39:42.421710+0000","last_fullsized":"2024-04-19T03:39:42.421710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413384+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:41.413384+0000","last_peered":"2024-04-19T03:39:41.413384+0000","last_clean":"2024-04-19T03:39:41.413384+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:41.413384+0000","last_undegraded":"2024-04-19T03:39:41.413384+0000","last_fullsized":"2024-04-19T03:39:41.413384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421814+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:42.421814+0000","last_peered":"2024-04-19T03:39:42.421814+0000","last_clean":"2024-04-19T03:39:42.421814+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:42.421814+0000","last_undegraded":"2024-04-19T03:39:42.421814+0000","last_fullsized":"2024-04-19T03:39:42.421814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2065,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413134+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:41.413134+0000","last_peered":"2024-04-19T03:39:41.413134+0000","last_clean":"2024-04-19T03:39:41.413134+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:41.413134+0000","last_undegraded":"2024-04-19T03:39:41.413134+0000","last_fullsized":"2024-04-19T03:39:41.413134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391794+0000","last_change":"2024-04-19T03:39:32.394854+0000","last_active":"2024-04-19T03:39:37.391794+0000","last_peered":"2024-04-19T03:39:37.391794+0000","last_clean":"2024-04-19T03:39:37.391794+0000","last_became_active":"2024-04-19T03:39:32.394482+0000","last_became_peered":"2024-04-19T03:39:32.394482+0000","last_unstale":"2024-04-19T03:39:37.391794+0000","last_undegraded":"2024-04-19T03:39:37.391794+0000","last_fullsized":"2024-04-19T03:39:37.391794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:16.631854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390884+0000","last_change":"2024-04-19T03:39:32.400848+0000","last_active":"2024-04-19T03:39:37.390884+0000","last_peered":"2024-04-19T03:39:37.390884+0000","last_clean":"2024-04-19T03:39:37.390884+0000","last_became_active":"2024-04-19T03:39:32.400572+0000","last_became_peered":"2024-04-19T03:39:32.400572+0000","last_unstale":"2024-04-19T03:39:37.390884+0000","last_undegraded":"2024-04-19T03:39:37.390884+0000","last_fullsized":"2024-04-19T03:39:37.390884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:28.052247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412986+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:41.412986+0000","last_peered":"2024-04-19T03:39:41.412986+0000","last_clean":"2024-04-19T03:39:41.412986+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:41.412986+0000","last_undegraded":"2024-04-19T03:39:41.412986+0000","last_fullsized":"2024-04-19T03:39:41.412986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413041+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:41.413041+0000","last_peered":"2024-04-19T03:39:41.413041+0000","last_clean":"2024-04-19T03:39:41.413041+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:41.413041+0000","last_undegraded":"2024-04-19T03:39:41.413041+0000","last_fullsized":"2024-04-19T03:39:41.413041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413409+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:41.413409+0000","last_peered":"2024-04-19T03:39:41.413409+0000","last_clean":"2024-04-19T03:39:41.413409+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:41.413409+0000","last_undegraded":"2024-04-19T03:39:41.413409+0000","last_fullsized":"2024-04-19T03:39:41.413409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390723+0000","last_change":"2024-04-19T03:39:32.400398+0000","last_active":"2024-04-19T03:39:37.390723+0000","last_peered":"2024-04-19T03:39:37.390723+0000","last_clean":"2024-04-19T03:39:37.390723+0000","last_became_active":"2024-04-19T03:39:32.399453+0000","last_became_peered":"2024-04-19T03:39:32.399453+0000","last_unstale":"2024-04-19T03:39:37.390723+0000","last_undegraded":"2024-04-19T03:39:37.390723+0000","last_fullsized":"2024-04-19T03:39:37.390723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:47.765222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2086,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390416+0000","last_change":"2024-04-19T03:39:32.399370+0000","last_active":"2024-04-19T03:39:37.390416+0000","last_peered":"2024-04-19T03:39:37.390416+0000","last_clean":"2024-04-19T03:39:37.390416+0000","last_became_active":"2024-04-19T03:39:32.398094+0000","last_became_peered":"2024-04-19T03:39:32.398094+0000","last_unstale":"2024-04-19T03:39:37.390416+0000","last_undegraded":"2024-04-19T03:39:37.390416+0000","last_fullsized":"2024-04-19T03:39:37.390416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:58.061381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413825+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:41.413825+0000","last_peered":"2024-04-19T03:39:41.413825+0000","last_clean":"2024-04-19T03:39:41.413825+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:41.413825+0000","last_undegraded":"2024-04-19T03:39:41.413825+0000","last_fullsized":"2024-04-19T03:39:41.413825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":82,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390122+0000","last_change":"2024-04-19T03:39:32.399381+0000","last_active":"2024-04-19T03:39:37.390122+0000","last_peered":"2024-04-19T03:39:37.390122+0000","last_clean":"2024-04-19T03:39:37.390122+0000","last_became_active":"2024-04-19T03:39:32.398858+0000","last_became_peered":"2024-04-19T03:39:32.398858+0000","last_unstale":"2024-04-19T03:39:37.390122+0000","last_undegraded":"2024-04-19T03:39:37.390122+0000","last_fullsized":"2024-04-19T03:39:37.390122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:27.528014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419060+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:42.419060+0000","last_peered":"2024-04-19T03:39:42.419060+0000","last_clean":"2024-04-19T03:39:42.419060+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:42.419060+0000","last_undegraded":"2024-04-19T03:39:42.419060+0000","last_fullsized":"2024-04-19T03:39:42.419060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412882+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:41.412882+0000","last_peered":"2024-04-19T03:39:41.412882+0000","last_clean":"2024-04-19T03:39:41.412882+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:41.412882+0000","last_undegraded":"2024-04-19T03:39:41.412882+0000","last_fullsized":"2024-04-19T03:39:41.412882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420189+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:42.420189+0000","last_peered":"2024-04-19T03:39:42.420189+0000","last_clean":"2024-04-19T03:39:42.420189+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:42.420189+0000","last_undegraded":"2024-04-19T03:39:42.420189+0000","last_fullsized":"2024-04-19T03:39:42.420189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2135,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390302+0000","last_change":"2024-04-19T03:39:32.402322+0000","last_active":"2024-04-19T03:39:37.390302+0000","last_peered":"2024-04-19T03:39:37.390302+0000","last_clean":"2024-04-19T03:39:37.390302+0000","last_became_active":"2024-04-19T03:39:32.401133+0000","last_became_peered":"2024-04-19T03:39:32.401133+0000","last_unstale":"2024-04-19T03:39:37.390302+0000","last_undegraded":"2024-04-19T03:39:37.390302+0000","last_fullsized":"2024-04-19T03:39:37.390302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:33:33.557434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389840+0000","last_change":"2024-04-19T03:39:32.401135+0000","last_active":"2024-04-19T03:39:37.389840+0000","last_peered":"2024-04-19T03:39:37.389840+0000","last_clean":"2024-04-19T03:39:37.389840+0000","last_became_active":"2024-04-19T03:39:32.400869+0000","last_became_peered":"2024-04-19T03:39:32.400869+0000","last_unstale":"2024-04-19T03:39:37.389840+0000","last_undegraded":"2024-04-19T03:39:37.389840+0000","last_fullsized":"2024-04-19T03:39:37.389840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:06.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":99,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417609+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:42.417609+0000","last_peered":"2024-04-19T03:39:42.417609+0000","last_clean":"2024-04-19T03:39:42.417609+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:42.417609+0000","last_undegraded":"2024-04-19T03:39:42.417609+0000","last_fullsized":"2024-04-19T03:39:42.417609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2087,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413001+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:41.413001+0000","last_peered":"2024-04-19T03:39:41.413001+0000","last_clean":"2024-04-19T03:39:41.413001+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:41.413001+0000","last_undegraded":"2024-04-19T03:39:41.413001+0000","last_fullsized":"2024-04-19T03:39:41.413001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421424+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:42.421424+0000","last_peered":"2024-04-19T03:39:42.421424+0000","last_clean":"2024-04-19T03:39:42.421424+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:42.421424+0000","last_undegraded":"2024-04-19T03:39:42.421424+0000","last_fullsized":"2024-04-19T03:39:42.421424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413465+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:41.413465+0000","last_peered":"2024-04-19T03:39:41.413465+0000","last_clean":"2024-04-19T03:39:41.413465+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:41.413465+0000","last_undegraded":"2024-04-19T03:39:41.413465+0000","last_fullsized":"2024-04-19T03:39:41.413465+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481799,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1644,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1683456,"data_stored":1254158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369836,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002004,"statfs":{"total":96636764160,"available":96258052096,"internally_reserved":0,"allocated":1671168,"data_stored":1252936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":782336,"data_stored":378148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:47.409 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T03:39:47.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:47.815 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:47.830 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-04-19T03:39:46.336162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795892,"kb_used_data":4040,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319628,"statfs":{"total":289910292480,"available":289095299072,"internally_reserved":0,"allocated":4136960,"data_stored":2885242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.931943"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2066,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413844+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:41.413844+0000","last_peered":"2024-04-19T03:39:41.413844+0000","last_clean":"2024-04-19T03:39:41.413844+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:41.413844+0000","last_undegraded":"2024-04-19T03:39:41.413844+0000","last_fullsized":"2024-04-19T03:39:41.413844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413352+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:41.413352+0000","last_peered":"2024-04-19T03:39:41.413352+0000","last_clean":"2024-04-19T03:39:41.413352+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:41.413352+0000","last_undegraded":"2024-04-19T03:39:41.413352+0000","last_fullsized":"2024-04-19T03:39:41.413352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4081,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391168+0000","last_change":"2024-04-19T03:39:32.399459+0000","last_active":"2024-04-19T03:39:37.391168+0000","last_peered":"2024-04-19T03:39:37.391168+0000","last_clean":"2024-04-19T03:39:37.391168+0000","last_became_active":"2024-04-19T03:39:32.397753+0000","last_became_peered":"2024-04-19T03:39:32.397753+0000","last_unstale":"2024-04-19T03:39:37.391168+0000","last_undegraded":"2024-04-19T03:39:37.391168+0000","last_fullsized":"2024-04-19T03:39:37.391168+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:54.322202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390587+0000","last_change":"2024-04-19T03:39:32.400611+0000","last_active":"2024-04-19T03:39:37.390587+0000","last_peered":"2024-04-19T03:39:37.390587+0000","last_clean":"2024-04-19T03:39:37.390587+0000","last_became_active":"2024-04-19T03:39:32.399743+0000","last_became_peered":"2024-04-19T03:39:32.399743+0000","last_unstale":"2024-04-19T03:39:37.390587+0000","last_undegraded":"2024-04-19T03:39:37.390587+0000","last_fullsized":"2024-04-19T03:39:37.390587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:40:42.830458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2138,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413052+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:41.413052+0000","last_peered":"2024-04-19T03:39:41.413052+0000","last_clean":"2024-04-19T03:39:41.413052+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:41.413052+0000","last_undegraded":"2024-04-19T03:39:41.413052+0000","last_fullsized":"2024-04-19T03:39:41.413052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":81,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390192+0000","last_change":"2024-04-19T03:39:32.398542+0000","last_active":"2024-04-19T03:39:37.390192+0000","last_peered":"2024-04-19T03:39:37.390192+0000","last_clean":"2024-04-19T03:39:37.390192+0000","last_became_active":"2024-04-19T03:39:32.398227+0000","last_became_peered":"2024-04-19T03:39:32.398227+0000","last_unstale":"2024-04-19T03:39:37.390192+0000","last_undegraded":"2024-04-19T03:39:37.390192+0000","last_fullsized":"2024-04-19T03:39:37.390192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:10:16.307090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390010+0000","last_change":"2024-04-19T03:39:32.396074+0000","last_active":"2024-04-19T03:39:37.390010+0000","last_peered":"2024-04-19T03:39:37.390010+0000","last_clean":"2024-04-19T03:39:37.390010+0000","last_became_active":"2024-04-19T03:39:32.395729+0000","last_became_peered":"2024-04-19T03:39:32.395729+0000","last_unstale":"2024-04-19T03:39:37.390010+0000","last_undegraded":"2024-04-19T03:39:37.390010+0000","last_fullsized":"2024-04-19T03:39:37.390010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:17:29.445916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389883+0000","last_change":"2024-04-19T03:39:32.400603+0000","last_active":"2024-04-19T03:39:37.389883+0000","last_peered":"2024-04-19T03:39:37.389883+0000","last_clean":"2024-04-19T03:39:37.389883+0000","last_became_active":"2024-04-19T03:39:32.397995+0000","last_became_peered":"2024-04-19T03:39:32.397995+0000","last_unstale":"2024-04-19T03:39:37.389883+0000","last_undegraded":"2024-04-19T03:39:37.389883+0000","last_fullsized":"2024-04-19T03:39:37.389883+0000","mapping_epoch":85,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:25:57.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6161,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418326+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:42.418326+0000","last_peered":"2024-04-19T03:39:42.418326+0000","last_clean":"2024-04-19T03:39:42.418326+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:42.418326+0000","last_undegraded":"2024-04-19T03:39:42.418326+0000","last_fullsized":"2024-04-19T03:39:42.418326+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413649+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:41.413649+0000","last_peered":"2024-04-19T03:39:41.413649+0000","last_clean":"2024-04-19T03:39:41.413649+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:41.413649+0000","last_undegraded":"2024-04-19T03:39:41.413649+0000","last_fullsized":"2024-04-19T03:39:41.413649+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4027,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390781+0000","last_change":"2024-04-19T03:39:32.400179+0000","last_active":"2024-04-19T03:39:37.390781+0000","last_peered":"2024-04-19T03:39:37.390781+0000","last_clean":"2024-04-19T03:39:37.390781+0000","last_became_active":"2024-04-19T03:39:32.397994+0000","last_became_peered":"2024-04-19T03:39:32.397994+0000","last_unstale":"2024-04-19T03:39:37.390781+0000","last_undegraded":"2024-04-19T03:39:37.390781+0000","last_fullsized":"2024-04-19T03:39:37.390781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:58:33.299512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413111+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:41.413111+0000","last_peered":"2024-04-19T03:39:41.413111+0000","last_clean":"2024-04-19T03:39:41.413111+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:41.413111+0000","last_undegraded":"2024-04-19T03:39:41.413111+0000","last_fullsized":"2024-04-19T03:39:41.413111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2079,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412862+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:41.412862+0000","last_peered":"2024-04-19T03:39:41.412862+0000","last_clean":"2024-04-19T03:39:41.412862+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:41.412862+0000","last_undegraded":"2024-04-19T03:39:41.412862+0000","last_fullsized":"2024-04-19T03:39:41.412862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390697+0000","last_change":"2024-04-19T03:39:32.395332+0000","last_active":"2024-04-19T03:39:37.390697+0000","last_peered":"2024-04-19T03:39:37.390697+0000","last_clean":"2024-04-19T03:39:37.390697+0000","last_became_active":"2024-04-19T03:39:32.392604+0000","last_became_peered":"2024-04-19T03:39:32.392604+0000","last_unstale":"2024-04-19T03:39:37.390697+0000","last_undegraded":"2024-04-19T03:39:37.390697+0000","last_fullsized":"2024-04-19T03:39:37.390697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:12.846842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2111,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390584+0000","last_change":"2024-04-19T03:39:32.395011+0000","last_active":"2024-04-19T03:39:37.390584+0000","last_peered":"2024-04-19T03:39:37.390584+0000","last_clean":"2024-04-19T03:39:37.390584+0000","last_became_active":"2024-04-19T03:39:32.392633+0000","last_became_peered":"2024-04-19T03:39:32.392633+0000","last_unstale":"2024-04-19T03:39:37.390584+0000","last_undegraded":"2024-04-19T03:39:37.390584+0000","last_fullsized":"2024-04-19T03:39:37.390584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:56.349038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2088,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389956+0000","last_change":"2024-04-19T03:39:32.396919+0000","last_active":"2024-04-19T03:39:37.389956+0000","last_peered":"2024-04-19T03:39:37.389956+0000","last_clean":"2024-04-19T03:39:37.389956+0000","last_became_active":"2024-04-19T03:39:32.395719+0000","last_became_peered":"2024-04-19T03:39:32.395719+0000","last_unstale":"2024-04-19T03:39:37.389956+0000","last_undegraded":"2024-04-19T03:39:37.389956+0000","last_fullsized":"2024-04-19T03:39:37.389956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:10:08.092382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419797+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:42.419797+0000","last_peered":"2024-04-19T03:39:42.419797+0000","last_clean":"2024-04-19T03:39:42.419797+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:42.419797+0000","last_undegraded":"2024-04-19T03:39:42.419797+0000","last_fullsized":"2024-04-19T03:39:42.419797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413507+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:41.413507+0000","last_peered":"2024-04-19T03:39:41.413507+0000","last_clean":"2024-04-19T03:39:41.413507+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:41.413507+0000","last_undegraded":"2024-04-19T03:39:41.413507+0000","last_fullsized":"2024-04-19T03:39:41.413507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4139,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419233+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:42.419233+0000","last_peered":"2024-04-19T03:39:42.419233+0000","last_clean":"2024-04-19T03:39:42.419233+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:42.419233+0000","last_undegraded":"2024-04-19T03:39:42.419233+0000","last_fullsized":"2024-04-19T03:39:42.419233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4174,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390528+0000","last_change":"2024-04-19T03:39:32.401641+0000","last_active":"2024-04-19T03:39:37.390528+0000","last_peered":"2024-04-19T03:39:37.390528+0000","last_clean":"2024-04-19T03:39:37.390528+0000","last_became_active":"2024-04-19T03:39:32.399814+0000","last_became_peered":"2024-04-19T03:39:32.399814+0000","last_unstale":"2024-04-19T03:39:37.390528+0000","last_undegraded":"2024-04-19T03:39:37.390528+0000","last_fullsized":"2024-04-19T03:39:37.390528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:40.327326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390386+0000","last_change":"2024-04-19T03:39:32.400170+0000","last_active":"2024-04-19T03:39:37.390386+0000","last_peered":"2024-04-19T03:39:37.390386+0000","last_clean":"2024-04-19T03:39:37.390386+0000","last_became_active":"2024-04-19T03:39:32.399694+0000","last_became_peered":"2024-04-19T03:39:32.399694+0000","last_unstale":"2024-04-19T03:39:37.390386+0000","last_undegraded":"2024-04-19T03:39:37.390386+0000","last_fullsized":"2024-04-19T03:39:37.390386+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:08:18.828239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2160,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412798+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:41.412798+0000","last_peered":"2024-04-19T03:39:41.412798+0000","last_clean":"2024-04-19T03:39:41.412798+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:41.412798+0000","last_undegraded":"2024-04-19T03:39:41.412798+0000","last_fullsized":"2024-04-19T03:39:41.412798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2155,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418161+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:42.418161+0000","last_peered":"2024-04-19T03:39:42.418161+0000","last_clean":"2024-04-19T03:39:42.418161+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:42.418161+0000","last_undegraded":"2024-04-19T03:39:42.418161+0000","last_fullsized":"2024-04-19T03:39:42.418161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412776+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:41.412776+0000","last_peered":"2024-04-19T03:39:41.412776+0000","last_clean":"2024-04-19T03:39:41.412776+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:41.412776+0000","last_undegraded":"2024-04-19T03:39:41.412776+0000","last_fullsized":"2024-04-19T03:39:41.412776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2094,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413817+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:41.413817+0000","last_peered":"2024-04-19T03:39:41.413817+0000","last_clean":"2024-04-19T03:39:41.413817+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:41.413817+0000","last_undegraded":"2024-04-19T03:39:41.413817+0000","last_fullsized":"2024-04-19T03:39:41.413817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419868+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:42.419868+0000","last_peered":"2024-04-19T03:39:42.419868+0000","last_clean":"2024-04-19T03:39:42.419868+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:42.419868+0000","last_undegraded":"2024-04-19T03:39:42.419868+0000","last_fullsized":"2024-04-19T03:39:42.419868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391435+0000","last_change":"2024-04-19T03:39:32.397511+0000","last_active":"2024-04-19T03:39:37.391435+0000","last_peered":"2024-04-19T03:39:37.391435+0000","last_clean":"2024-04-19T03:39:37.391435+0000","last_became_active":"2024-04-19T03:39:32.396369+0000","last_became_peered":"2024-04-19T03:39:32.396369+0000","last_unstale":"2024-04-19T03:39:37.391435+0000","last_undegraded":"2024-04-19T03:39:37.391435+0000","last_fullsized":"2024-04-19T03:39:37.391435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:02:22.436647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412750+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:41.412750+0000","last_peered":"2024-04-19T03:39:41.412750+0000","last_clean":"2024-04-19T03:39:41.412750+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:41.412750+0000","last_undegraded":"2024-04-19T03:39:41.412750+0000","last_fullsized":"2024-04-19T03:39:41.412750+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413799+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:41.413799+0000","last_peered":"2024-04-19T03:39:41.413799+0000","last_clean":"2024-04-19T03:39:41.413799+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:41.413799+0000","last_undegraded":"2024-04-19T03:39:41.413799+0000","last_fullsized":"2024-04-19T03:39:41.413799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418408+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:42.418408+0000","last_peered":"2024-04-19T03:39:42.418408+0000","last_clean":"2024-04-19T03:39:42.418408+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:42.418408+0000","last_undegraded":"2024-04-19T03:39:42.418408+0000","last_fullsized":"2024-04-19T03:39:42.418408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418928+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:42.418928+0000","last_peered":"2024-04-19T03:39:42.418928+0000","last_clean":"2024-04-19T03:39:42.418928+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:42.418928+0000","last_undegraded":"2024-04-19T03:39:42.418928+0000","last_fullsized":"2024-04-19T03:39:42.418928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420339+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:42.420339+0000","last_peered":"2024-04-19T03:39:42.420339+0000","last_clean":"2024-04-19T03:39:42.420339+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:42.420339+0000","last_undegraded":"2024-04-19T03:39:42.420339+0000","last_fullsized":"2024-04-19T03:39:42.420339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413707+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:41.413707+0000","last_peered":"2024-04-19T03:39:41.413707+0000","last_clean":"2024-04-19T03:39:41.413707+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:41.413707+0000","last_undegraded":"2024-04-19T03:39:41.413707+0000","last_fullsized":"2024-04-19T03:39:41.413707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420283+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:42.420283+0000","last_peered":"2024-04-19T03:39:42.420283+0000","last_clean":"2024-04-19T03:39:42.420283+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:42.420283+0000","last_undegraded":"2024-04-19T03:39:42.420283+0000","last_fullsized":"2024-04-19T03:39:42.420283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420113+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:42.420113+0000","last_peered":"2024-04-19T03:39:42.420113+0000","last_clean":"2024-04-19T03:39:42.420113+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:42.420113+0000","last_undegraded":"2024-04-19T03:39:42.420113+0000","last_fullsized":"2024-04-19T03:39:42.420113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.400643+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.398090+0000","last_became_peered":"2024-04-19T03:39:32.398090+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:12:38.136122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418025+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:42.418025+0000","last_peered":"2024-04-19T03:39:42.418025+0000","last_clean":"2024-04-19T03:39:42.418025+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:42.418025+0000","last_undegraded":"2024-04-19T03:39:42.418025+0000","last_fullsized":"2024-04-19T03:39:42.418025+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413667+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:41.413667+0000","last_peered":"2024-04-19T03:39:41.413667+0000","last_clean":"2024-04-19T03:39:41.413667+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:41.413667+0000","last_undegraded":"2024-04-19T03:39:41.413667+0000","last_fullsized":"2024-04-19T03:39:41.413667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4150,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420052+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:42.420052+0000","last_peered":"2024-04-19T03:39:42.420052+0000","last_clean":"2024-04-19T03:39:42.420052+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:42.420052+0000","last_undegraded":"2024-04-19T03:39:42.420052+0000","last_fullsized":"2024-04-19T03:39:42.420052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":180,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391107+0000","last_change":"2024-04-19T03:39:32.394904+0000","last_active":"2024-04-19T03:39:37.391107+0000","last_peered":"2024-04-19T03:39:37.391107+0000","last_clean":"2024-04-19T03:39:37.391107+0000","last_became_active":"2024-04-19T03:39:32.394518+0000","last_became_peered":"2024-04-19T03:39:32.394518+0000","last_unstale":"2024-04-19T03:39:37.391107+0000","last_undegraded":"2024-04-19T03:39:37.391107+0000","last_fullsized":"2024-04-19T03:39:37.391107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:54:49.767040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4171,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390892+0000","last_change":"2024-04-19T03:39:32.395658+0000","last_active":"2024-04-19T03:39:37.390892+0000","last_peered":"2024-04-19T03:39:37.390892+0000","last_clean":"2024-04-19T03:39:37.390892+0000","last_became_active":"2024-04-19T03:39:32.393165+0000","last_became_peered":"2024-04-19T03:39:32.393165+0000","last_unstale":"2024-04-19T03:39:37.390892+0000","last_undegraded":"2024-04-19T03:39:37.390892+0000","last_fullsized":"2024-04-19T03:39:37.390892+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:09.225415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390506+0000","last_change":"2024-04-19T03:39:32.400220+0000","last_active":"2024-04-19T03:39:37.390506+0000","last_peered":"2024-04-19T03:39:37.390506+0000","last_clean":"2024-04-19T03:39:37.390506+0000","last_became_active":"2024-04-19T03:39:32.399717+0000","last_became_peered":"2024-04-19T03:39:32.399717+0000","last_unstale":"2024-04-19T03:39:37.390506+0000","last_undegraded":"2024-04-19T03:39:37.390506+0000","last_fullsized":"2024-04-19T03:39:37.390506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:01.543694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2062,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413157+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:41.413157+0000","last_peered":"2024-04-19T03:39:41.413157+0000","last_clean":"2024-04-19T03:39:41.413157+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:41.413157+0000","last_undegraded":"2024-04-19T03:39:41.413157+0000","last_fullsized":"2024-04-19T03:39:41.413157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419933+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:42.419933+0000","last_peered":"2024-04-19T03:39:42.419933+0000","last_clean":"2024-04-19T03:39:42.419933+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:42.419933+0000","last_undegraded":"2024-04-19T03:39:42.419933+0000","last_fullsized":"2024-04-19T03:39:42.419933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413927+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:41.413927+0000","last_peered":"2024-04-19T03:39:41.413927+0000","last_clean":"2024-04-19T03:39:41.413927+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:41.413927+0000","last_undegraded":"2024-04-19T03:39:41.413927+0000","last_fullsized":"2024-04-19T03:39:41.413927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412670+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:41.412670+0000","last_peered":"2024-04-19T03:39:41.412670+0000","last_clean":"2024-04-19T03:39:41.412670+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:41.412670+0000","last_undegraded":"2024-04-19T03:39:41.412670+0000","last_fullsized":"2024-04-19T03:39:41.412670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":110,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419704+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:42.419704+0000","last_peered":"2024-04-19T03:39:42.419704+0000","last_clean":"2024-04-19T03:39:42.419704+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:42.419704+0000","last_undegraded":"2024-04-19T03:39:42.419704+0000","last_fullsized":"2024-04-19T03:39:42.419704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390748+0000","last_change":"2024-04-19T03:39:32.395496+0000","last_active":"2024-04-19T03:39:37.390748+0000","last_peered":"2024-04-19T03:39:37.390748+0000","last_clean":"2024-04-19T03:39:37.390748+0000","last_became_active":"2024-04-19T03:39:32.394631+0000","last_became_peered":"2024-04-19T03:39:32.394631+0000","last_unstale":"2024-04-19T03:39:37.390748+0000","last_undegraded":"2024-04-19T03:39:37.390748+0000","last_fullsized":"2024-04-19T03:39:37.390748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:10.062803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2206,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420401+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:42.420401+0000","last_peered":"2024-04-19T03:39:42.420401+0000","last_clean":"2024-04-19T03:39:42.420401+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:42.420401+0000","last_undegraded":"2024-04-19T03:39:42.420401+0000","last_fullsized":"2024-04-19T03:39:42.420401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391714+0000","last_change":"2024-04-19T03:39:32.396659+0000","last_active":"2024-04-19T03:39:37.391714+0000","last_peered":"2024-04-19T03:39:37.391714+0000","last_clean":"2024-04-19T03:39:37.391714+0000","last_became_active":"2024-04-19T03:39:32.396285+0000","last_became_peered":"2024-04-19T03:39:32.396285+0000","last_unstale":"2024-04-19T03:39:37.391714+0000","last_undegraded":"2024-04-19T03:39:37.391714+0000","last_fullsized":"2024-04-19T03:39:37.391714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:04.132840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2165,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412339+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:41.412339+0000","last_peered":"2024-04-19T03:39:41.412339+0000","last_clean":"2024-04-19T03:39:41.412339+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:41.412339+0000","last_undegraded":"2024-04-19T03:39:41.412339+0000","last_fullsized":"2024-04-19T03:39:41.412339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413240+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:41.413240+0000","last_peered":"2024-04-19T03:39:41.413240+0000","last_clean":"2024-04-19T03:39:41.413240+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:41.413240+0000","last_undegraded":"2024-04-19T03:39:41.413240+0000","last_fullsized":"2024-04-19T03:39:41.413240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412785+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:41.412785+0000","last_peered":"2024-04-19T03:39:41.412785+0000","last_clean":"2024-04-19T03:39:41.412785+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:41.412785+0000","last_undegraded":"2024-04-19T03:39:41.412785+0000","last_fullsized":"2024-04-19T03:39:41.412785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391598+0000","last_change":"2024-04-19T03:39:32.398006+0000","last_active":"2024-04-19T03:39:37.391598+0000","last_peered":"2024-04-19T03:39:37.391598+0000","last_clean":"2024-04-19T03:39:37.391598+0000","last_became_active":"2024-04-19T03:39:32.397734+0000","last_became_peered":"2024-04-19T03:39:32.397734+0000","last_unstale":"2024-04-19T03:39:37.391598+0000","last_undegraded":"2024-04-19T03:39:37.391598+0000","last_fullsized":"2024-04-19T03:39:37.391598+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:57:38.017118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2067,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390061+0000","last_change":"2024-04-19T03:39:32.401634+0000","last_active":"2024-04-19T03:39:37.390061+0000","last_peered":"2024-04-19T03:39:37.390061+0000","last_clean":"2024-04-19T03:39:37.390061+0000","last_became_active":"2024-04-19T03:39:32.398779+0000","last_became_peered":"2024-04-19T03:39:32.398779+0000","last_unstale":"2024-04-19T03:39:37.390061+0000","last_undegraded":"2024-04-19T03:39:37.390061+0000","last_fullsized":"2024-04-19T03:39:37.390061+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:54:42.670329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390983+0000","last_change":"2024-04-19T03:39:32.395971+0000","last_active":"2024-04-19T03:39:37.390983+0000","last_peered":"2024-04-19T03:39:37.390983+0000","last_clean":"2024-04-19T03:39:37.390983+0000","last_became_active":"2024-04-19T03:39:32.395700+0000","last_became_peered":"2024-04-19T03:39:32.395700+0000","last_unstale":"2024-04-19T03:39:37.390983+0000","last_undegraded":"2024-04-19T03:39:37.390983+0000","last_fullsized":"2024-04-19T03:39:37.390983+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:56:26.477882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421316+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:42.421316+0000","last_peered":"2024-04-19T03:39:42.421316+0000","last_clean":"2024-04-19T03:39:42.421316+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:42.421316+0000","last_undegraded":"2024-04-19T03:39:42.421316+0000","last_fullsized":"2024-04-19T03:39:42.421316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421232+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:42.421232+0000","last_peered":"2024-04-19T03:39:42.421232+0000","last_clean":"2024-04-19T03:39:42.421232+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:42.421232+0000","last_undegraded":"2024-04-19T03:39:42.421232+0000","last_fullsized":"2024-04-19T03:39:42.421232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2094,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390678+0000","last_change":"2024-04-19T03:39:32.399496+0000","last_active":"2024-04-19T03:39:37.390678+0000","last_peered":"2024-04-19T03:39:37.390678+0000","last_clean":"2024-04-19T03:39:37.390678+0000","last_became_active":"2024-04-19T03:39:32.398117+0000","last_became_peered":"2024-04-19T03:39:32.398117+0000","last_unstale":"2024-04-19T03:39:37.390678+0000","last_undegraded":"2024-04-19T03:39:37.390678+0000","last_fullsized":"2024-04-19T03:39:37.390678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:05.987207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390258+0000","last_change":"2024-04-19T03:39:32.394935+0000","last_active":"2024-04-19T03:39:37.390258+0000","last_peered":"2024-04-19T03:39:37.390258+0000","last_clean":"2024-04-19T03:39:37.390258+0000","last_became_active":"2024-04-19T03:39:32.394624+0000","last_became_peered":"2024-04-19T03:39:32.394624+0000","last_unstale":"2024-04-19T03:39:37.390258+0000","last_undegraded":"2024-04-19T03:39:37.390258+0000","last_fullsized":"2024-04-19T03:39:37.390258+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:11.842559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391395+0000","last_change":"2024-04-19T03:39:32.396066+0000","last_active":"2024-04-19T03:39:37.391395+0000","last_peered":"2024-04-19T03:39:37.391395+0000","last_clean":"2024-04-19T03:39:37.391395+0000","last_became_active":"2024-04-19T03:39:32.394630+0000","last_became_peered":"2024-04-19T03:39:32.394630+0000","last_unstale":"2024-04-19T03:39:37.391395+0000","last_undegraded":"2024-04-19T03:39:37.391395+0000","last_fullsized":"2024-04-19T03:39:37.391395+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:46:06.929054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412529+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:41.412529+0000","last_peered":"2024-04-19T03:39:41.412529+0000","last_clean":"2024-04-19T03:39:41.412529+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:41.412529+0000","last_undegraded":"2024-04-19T03:39:41.412529+0000","last_fullsized":"2024-04-19T03:39:41.412529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391415+0000","last_change":"2024-04-19T03:39:32.395663+0000","last_active":"2024-04-19T03:39:37.391415+0000","last_peered":"2024-04-19T03:39:37.391415+0000","last_clean":"2024-04-19T03:39:37.391415+0000","last_became_active":"2024-04-19T03:39:32.394303+0000","last_became_peered":"2024-04-19T03:39:32.394303+0000","last_unstale":"2024-04-19T03:39:37.391415+0000","last_undegraded":"2024-04-19T03:39:37.391415+0000","last_fullsized":"2024-04-19T03:39:37.391415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:23:42.996316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412603+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:41.412603+0000","last_peered":"2024-04-19T03:39:41.412603+0000","last_clean":"2024-04-19T03:39:41.412603+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:41.412603+0000","last_undegraded":"2024-04-19T03:39:41.412603+0000","last_fullsized":"2024-04-19T03:39:41.412603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6118,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420024+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:42.420024+0000","last_peered":"2024-04-19T03:39:42.420024+0000","last_clean":"2024-04-19T03:39:42.420024+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:42.420024+0000","last_undegraded":"2024-04-19T03:39:42.420024+0000","last_fullsized":"2024-04-19T03:39:42.420024+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419894+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:42.419894+0000","last_peered":"2024-04-19T03:39:42.419894+0000","last_clean":"2024-04-19T03:39:42.419894+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:42.419894+0000","last_undegraded":"2024-04-19T03:39:42.419894+0000","last_fullsized":"2024-04-19T03:39:42.419894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413757+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:41.413757+0000","last_peered":"2024-04-19T03:39:41.413757+0000","last_clean":"2024-04-19T03:39:41.413757+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:41.413757+0000","last_undegraded":"2024-04-19T03:39:41.413757+0000","last_fullsized":"2024-04-19T03:39:41.413757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420461+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:42.420461+0000","last_peered":"2024-04-19T03:39:42.420461+0000","last_clean":"2024-04-19T03:39:42.420461+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:42.420461+0000","last_undegraded":"2024-04-19T03:39:42.420461+0000","last_fullsized":"2024-04-19T03:39:42.420461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413236+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:41.413236+0000","last_peered":"2024-04-19T03:39:41.413236+0000","last_clean":"2024-04-19T03:39:41.413236+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:41.413236+0000","last_undegraded":"2024-04-19T03:39:41.413236+0000","last_fullsized":"2024-04-19T03:39:41.413236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":114,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418792+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:42.418792+0000","last_peered":"2024-04-19T03:39:42.418792+0000","last_clean":"2024-04-19T03:39:42.418792+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:42.418792+0000","last_undegraded":"2024-04-19T03:39:42.418792+0000","last_fullsized":"2024-04-19T03:39:42.418792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412749+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:41.412749+0000","last_peered":"2024-04-19T03:39:41.412749+0000","last_clean":"2024-04-19T03:39:41.412749+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:41.412749+0000","last_undegraded":"2024-04-19T03:39:41.412749+0000","last_fullsized":"2024-04-19T03:39:41.412749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420618+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:42.420618+0000","last_peered":"2024-04-19T03:39:42.420618+0000","last_clean":"2024-04-19T03:39:42.420618+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:42.420618+0000","last_undegraded":"2024-04-19T03:39:42.420618+0000","last_fullsized":"2024-04-19T03:39:42.420618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":277,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390843+0000","last_change":"2024-04-19T03:39:32.395654+0000","last_active":"2024-04-19T03:39:37.390843+0000","last_peered":"2024-04-19T03:39:37.390843+0000","last_clean":"2024-04-19T03:39:37.390843+0000","last_became_active":"2024-04-19T03:39:32.395086+0000","last_became_peered":"2024-04-19T03:39:32.395086+0000","last_unstale":"2024-04-19T03:39:37.390843+0000","last_undegraded":"2024-04-19T03:39:37.390843+0000","last_fullsized":"2024-04-19T03:39:37.390843+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:15.390971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":112,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417330+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:42.417330+0000","last_peered":"2024-04-19T03:39:42.417330+0000","last_clean":"2024-04-19T03:39:42.417330+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:42.417330+0000","last_undegraded":"2024-04-19T03:39:42.417330+0000","last_fullsized":"2024-04-19T03:39:42.417330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8088,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413659+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:41.413659+0000","last_peered":"2024-04-19T03:39:41.413659+0000","last_clean":"2024-04-19T03:39:41.413659+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:41.413659+0000","last_undegraded":"2024-04-19T03:39:41.413659+0000","last_fullsized":"2024-04-19T03:39:41.413659+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390307+0000","last_change":"2024-04-19T03:39:32.399167+0000","last_active":"2024-04-19T03:39:37.390307+0000","last_peered":"2024-04-19T03:39:37.390307+0000","last_clean":"2024-04-19T03:39:37.390307+0000","last_became_active":"2024-04-19T03:39:32.398584+0000","last_became_peered":"2024-04-19T03:39:32.398584+0000","last_unstale":"2024-04-19T03:39:37.390307+0000","last_undegraded":"2024-04-19T03:39:37.390307+0000","last_fullsized":"2024-04-19T03:39:37.390307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:25:43.337624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412475+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:41.412475+0000","last_peered":"2024-04-19T03:39:41.412475+0000","last_clean":"2024-04-19T03:39:41.412475+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:41.412475+0000","last_undegraded":"2024-04-19T03:39:41.412475+0000","last_fullsized":"2024-04-19T03:39:41.412475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420399+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:42.420399+0000","last_peered":"2024-04-19T03:39:42.420399+0000","last_clean":"2024-04-19T03:39:42.420399+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:42.420399+0000","last_undegraded":"2024-04-19T03:39:42.420399+0000","last_fullsized":"2024-04-19T03:39:42.420399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390450+0000","last_change":"2024-04-19T03:39:32.393622+0000","last_active":"2024-04-19T03:39:37.390450+0000","last_peered":"2024-04-19T03:39:37.390450+0000","last_clean":"2024-04-19T03:39:37.390450+0000","last_became_active":"2024-04-19T03:39:32.393342+0000","last_became_peered":"2024-04-19T03:39:32.393342+0000","last_unstale":"2024-04-19T03:39:37.390450+0000","last_undegraded":"2024-04-19T03:39:37.390450+0000","last_fullsized":"2024-04-19T03:39:37.390450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:42.742836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419973+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:42.419973+0000","last_peered":"2024-04-19T03:39:42.419973+0000","last_clean":"2024-04-19T03:39:42.419973+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:42.419973+0000","last_undegraded":"2024-04-19T03:39:42.419973+0000","last_fullsized":"2024-04-19T03:39:42.419973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":80,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391314+0000","last_change":"2024-04-19T03:39:32.395946+0000","last_active":"2024-04-19T03:39:37.391314+0000","last_peered":"2024-04-19T03:39:37.391314+0000","last_clean":"2024-04-19T03:39:37.391314+0000","last_became_active":"2024-04-19T03:39:32.395348+0000","last_became_peered":"2024-04-19T03:39:32.395348+0000","last_unstale":"2024-04-19T03:39:37.391314+0000","last_undegraded":"2024-04-19T03:39:37.391314+0000","last_fullsized":"2024-04-19T03:39:37.391314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:41.036403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412623+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:41.412623+0000","last_peered":"2024-04-19T03:39:41.412623+0000","last_clean":"2024-04-19T03:39:41.412623+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:41.412623+0000","last_undegraded":"2024-04-19T03:39:41.412623+0000","last_fullsized":"2024-04-19T03:39:41.412623+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390632+0000","last_change":"2024-04-19T03:39:32.396079+0000","last_active":"2024-04-19T03:39:37.390632+0000","last_peered":"2024-04-19T03:39:37.390632+0000","last_clean":"2024-04-19T03:39:37.390632+0000","last_became_active":"2024-04-19T03:39:32.395721+0000","last_became_peered":"2024-04-19T03:39:32.395721+0000","last_unstale":"2024-04-19T03:39:37.390632+0000","last_undegraded":"2024-04-19T03:39:37.390632+0000","last_fullsized":"2024-04-19T03:39:37.390632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:31:08.221132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":96,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421710+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:42.421710+0000","last_peered":"2024-04-19T03:39:42.421710+0000","last_clean":"2024-04-19T03:39:42.421710+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:42.421710+0000","last_undegraded":"2024-04-19T03:39:42.421710+0000","last_fullsized":"2024-04-19T03:39:42.421710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413384+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:41.413384+0000","last_peered":"2024-04-19T03:39:41.413384+0000","last_clean":"2024-04-19T03:39:41.413384+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:41.413384+0000","last_undegraded":"2024-04-19T03:39:41.413384+0000","last_fullsized":"2024-04-19T03:39:41.413384+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421814+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:42.421814+0000","last_peered":"2024-04-19T03:39:42.421814+0000","last_clean":"2024-04-19T03:39:42.421814+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:42.421814+0000","last_undegraded":"2024-04-19T03:39:42.421814+0000","last_fullsized":"2024-04-19T03:39:42.421814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2065,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413134+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:41.413134+0000","last_peered":"2024-04-19T03:39:41.413134+0000","last_clean":"2024-04-19T03:39:41.413134+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:41.413134+0000","last_undegraded":"2024-04-19T03:39:41.413134+0000","last_fullsized":"2024-04-19T03:39:41.413134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.391794+0000","last_change":"2024-04-19T03:39:32.394854+0000","last_active":"2024-04-19T03:39:37.391794+0000","last_peered":"2024-04-19T03:39:37.391794+0000","last_clean":"2024-04-19T03:39:37.391794+0000","last_became_active":"2024-04-19T03:39:32.394482+0000","last_became_peered":"2024-04-19T03:39:32.394482+0000","last_unstale":"2024-04-19T03:39:37.391794+0000","last_undegraded":"2024-04-19T03:39:37.391794+0000","last_fullsized":"2024-04-19T03:39:37.391794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:16.631854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390884+0000","last_change":"2024-04-19T03:39:32.400848+0000","last_active":"2024-04-19T03:39:37.390884+0000","last_peered":"2024-04-19T03:39:37.390884+0000","last_clean":"2024-04-19T03:39:37.390884+0000","last_became_active":"2024-04-19T03:39:32.400572+0000","last_became_peered":"2024-04-19T03:39:32.400572+0000","last_unstale":"2024-04-19T03:39:37.390884+0000","last_undegraded":"2024-04-19T03:39:37.390884+0000","last_fullsized":"2024-04-19T03:39:37.390884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:28.052247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412986+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:41.412986+0000","last_peered":"2024-04-19T03:39:41.412986+0000","last_clean":"2024-04-19T03:39:41.412986+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:41.412986+0000","last_undegraded":"2024-04-19T03:39:41.412986+0000","last_fullsized":"2024-04-19T03:39:41.412986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413041+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:41.413041+0000","last_peered":"2024-04-19T03:39:41.413041+0000","last_clean":"2024-04-19T03:39:41.413041+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:41.413041+0000","last_undegraded":"2024-04-19T03:39:41.413041+0000","last_fullsized":"2024-04-19T03:39:41.413041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2143,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413409+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:41.413409+0000","last_peered":"2024-04-19T03:39:41.413409+0000","last_clean":"2024-04-19T03:39:41.413409+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:41.413409+0000","last_undegraded":"2024-04-19T03:39:41.413409+0000","last_fullsized":"2024-04-19T03:39:41.413409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390723+0000","last_change":"2024-04-19T03:39:32.400398+0000","last_active":"2024-04-19T03:39:37.390723+0000","last_peered":"2024-04-19T03:39:37.390723+0000","last_clean":"2024-04-19T03:39:37.390723+0000","last_became_active":"2024-04-19T03:39:32.399453+0000","last_became_peered":"2024-04-19T03:39:32.399453+0000","last_unstale":"2024-04-19T03:39:37.390723+0000","last_undegraded":"2024-04-19T03:39:37.390723+0000","last_fullsized":"2024-04-19T03:39:37.390723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:04:47.765222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2086,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390416+0000","last_change":"2024-04-19T03:39:32.399370+0000","last_active":"2024-04-19T03:39:37.390416+0000","last_peered":"2024-04-19T03:39:37.390416+0000","last_clean":"2024-04-19T03:39:37.390416+0000","last_became_active":"2024-04-19T03:39:32.398094+0000","last_became_peered":"2024-04-19T03:39:32.398094+0000","last_unstale":"2024-04-19T03:39:37.390416+0000","last_undegraded":"2024-04-19T03:39:37.390416+0000","last_fullsized":"2024-04-19T03:39:37.390416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:58.061381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413825+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:41.413825+0000","last_peered":"2024-04-19T03:39:41.413825+0000","last_clean":"2024-04-19T03:39:41.413825+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:41.413825+0000","last_undegraded":"2024-04-19T03:39:41.413825+0000","last_fullsized":"2024-04-19T03:39:41.413825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":82,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390122+0000","last_change":"2024-04-19T03:39:32.399381+0000","last_active":"2024-04-19T03:39:37.390122+0000","last_peered":"2024-04-19T03:39:37.390122+0000","last_clean":"2024-04-19T03:39:37.390122+0000","last_became_active":"2024-04-19T03:39:32.398858+0000","last_became_peered":"2024-04-19T03:39:32.398858+0000","last_unstale":"2024-04-19T03:39:37.390122+0000","last_undegraded":"2024-04-19T03:39:37.390122+0000","last_fullsized":"2024-04-19T03:39:37.390122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:39:27.528014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419060+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:42.419060+0000","last_peered":"2024-04-19T03:39:42.419060+0000","last_clean":"2024-04-19T03:39:42.419060+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:42.419060+0000","last_undegraded":"2024-04-19T03:39:42.419060+0000","last_fullsized":"2024-04-19T03:39:42.419060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.412882+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:41.412882+0000","last_peered":"2024-04-19T03:39:41.412882+0000","last_clean":"2024-04-19T03:39:41.412882+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:41.412882+0000","last_undegraded":"2024-04-19T03:39:41.412882+0000","last_fullsized":"2024-04-19T03:39:41.412882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420189+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:42.420189+0000","last_peered":"2024-04-19T03:39:42.420189+0000","last_clean":"2024-04-19T03:39:42.420189+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:42.420189+0000","last_undegraded":"2024-04-19T03:39:42.420189+0000","last_fullsized":"2024-04-19T03:39:42.420189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2135,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.390302+0000","last_change":"2024-04-19T03:39:32.402322+0000","last_active":"2024-04-19T03:39:37.390302+0000","last_peered":"2024-04-19T03:39:37.390302+0000","last_clean":"2024-04-19T03:39:37.390302+0000","last_became_active":"2024-04-19T03:39:32.401133+0000","last_became_peered":"2024-04-19T03:39:32.401133+0000","last_unstale":"2024-04-19T03:39:37.390302+0000","last_undegraded":"2024-04-19T03:39:37.390302+0000","last_fullsized":"2024-04-19T03:39:37.390302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:33:33.557434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-19T03:39:37.389840+0000","last_change":"2024-04-19T03:39:32.401135+0000","last_active":"2024-04-19T03:39:37.389840+0000","last_peered":"2024-04-19T03:39:37.389840+0000","last_clean":"2024-04-19T03:39:37.389840+0000","last_became_active":"2024-04-19T03:39:32.400869+0000","last_became_peered":"2024-04-19T03:39:32.400869+0000","last_unstale":"2024-04-19T03:39:37.389840+0000","last_undegraded":"2024-04-19T03:39:37.389840+0000","last_fullsized":"2024-04-19T03:39:37.389840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:06.596789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":99,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417609+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:42.417609+0000","last_peered":"2024-04-19T03:39:42.417609+0000","last_clean":"2024-04-19T03:39:42.417609+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:42.417609+0000","last_undegraded":"2024-04-19T03:39:42.417609+0000","last_fullsized":"2024-04-19T03:39:42.417609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2087,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413001+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:41.413001+0000","last_peered":"2024-04-19T03:39:41.413001+0000","last_clean":"2024-04-19T03:39:41.413001+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:41.413001+0000","last_undegraded":"2024-04-19T03:39:41.413001+0000","last_fullsized":"2024-04-19T03:39:41.413001+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421424+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:42.421424+0000","last_peered":"2024-04-19T03:39:42.421424+0000","last_clean":"2024-04-19T03:39:42.421424+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:42.421424+0000","last_undegraded":"2024-04-19T03:39:42.421424+0000","last_fullsized":"2024-04-19T03:39:42.421424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2164,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-19T03:39:41.413465+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:41.413465+0000","last_peered":"2024-04-19T03:39:41.413465+0000","last_clean":"2024-04-19T03:39:41.413465+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:41.413465+0000","last_undegraded":"2024-04-19T03:39:41.413465+0000","last_fullsized":"2024-04-19T03:39:41.413465+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481799,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1644,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1683456,"data_stored":1254158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369836,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002004,"statfs":{"total":96636764160,"available":96258052096,"internally_reserved":0,"allocated":1671168,"data_stored":1252936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":782336,"data_stored":378148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.68300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:47.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:39:48.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:48.239 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":93,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:39:43.419100+0000","last_up_change":"2024-04-19T03:39:18.391293+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":19,"up_from":77,"up_thru":92,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":5986},{"type":"v1","addr":"172.21.15.129:6801","nonce":5986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":5986},{"type":"v1","addr":"172.21.15.129:6803","nonce":5986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":5986},{"type":"v1","addr":"172.21.15.129:6807","nonce":5986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":5986},{"type":"v1","addr":"172.21.15.129:6805","nonce":5986}]},"public_addr":"172.21.15.129:6801/5986","cluster_addr":"172.21.15.129:6803/5986","heartbeat_back_addr":"172.21.15.129:6807/5986","heartbeat_front_addr":"172.21.15.129:6805/5986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":19}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:39:49.256 INFO:tasks.ceph:Scrubbing osd.0 2024-04-19T03:39:49.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-19T03:39:49.428 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-19T03:39:49.429 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T03:39:49.429 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-19T03:39:49.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-19T03:39:49.812 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-04-19T03:39:49.825 INFO:tasks.ceph:Scrubbing osd.1 2024-04-19T03:39:49.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-19T03:39:49.989 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-19T03:39:49.989 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T03:39:49.989 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-19T03:39:50.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-19T03:39:50.371 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-04-19T03:39:50.384 INFO:tasks.ceph:Scrubbing osd.2 2024-04-19T03:39:50.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-19T03:39:50.550 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-19T03:39:50.550 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-19T03:39:50.550 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-19T03:39:50.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-19T03:39:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-04-19T03:39:50.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:39:51.312 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:39:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:39:51.325 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-19T03:39:50.336898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795920,"kb_used_data":4064,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319600,"statfs":{"total":289910292480,"available":289095270400,"internally_reserved":0,"allocated":4161536,"data_stored":2897938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001777"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421069+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:42.421069+0000","last_peered":"2024-04-19T03:39:42.421069+0000","last_clean":"2024-04-19T03:39:42.421069+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:42.421069+0000","last_undegraded":"2024-04-19T03:39:42.421069+0000","last_fullsized":"2024-04-19T03:39:42.421069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419494+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:42.419494+0000","last_peered":"2024-04-19T03:39:42.419494+0000","last_clean":"2024-04-19T03:39:42.419494+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:42.419494+0000","last_undegraded":"2024-04-19T03:39:42.419494+0000","last_fullsized":"2024-04-19T03:39:42.419494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438617+0000","last_change":"2024-04-19T03:39:43.438617+0000","last_active":"2024-04-19T03:39:43.438617+0000","last_peered":"2024-04-19T03:39:43.438617+0000","last_clean":"2024-04-19T03:39:43.438617+0000","last_became_active":"2024-04-19T03:39:43.437251+0000","last_became_peered":"2024-04-19T03:39:43.437251+0000","last_unstale":"2024-04-19T03:39:43.438617+0000","last_undegraded":"2024-04-19T03:39:43.438617+0000","last_fullsized":"2024-04-19T03:39:43.438617+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:14:43.261944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437080+0000","last_change":"2024-04-19T03:39:43.437080+0000","last_active":"2024-04-19T03:39:43.437080+0000","last_peered":"2024-04-19T03:39:43.437080+0000","last_clean":"2024-04-19T03:39:43.437080+0000","last_became_active":"2024-04-19T03:39:43.434583+0000","last_became_peered":"2024-04-19T03:39:43.434583+0000","last_unstale":"2024-04-19T03:39:43.437080+0000","last_undegraded":"2024-04-19T03:39:43.437080+0000","last_fullsized":"2024-04-19T03:39:43.437080+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:13:03.169095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2139,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419246+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:42.419246+0000","last_peered":"2024-04-19T03:39:42.419246+0000","last_clean":"2024-04-19T03:39:42.419246+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:42.419246+0000","last_undegraded":"2024-04-19T03:39:42.419246+0000","last_fullsized":"2024-04-19T03:39:42.419246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:12.382872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.434424+0000","last_change":"2024-04-19T03:39:43.434424+0000","last_active":"2024-04-19T03:39:43.434424+0000","last_peered":"2024-04-19T03:39:43.434424+0000","last_clean":"2024-04-19T03:39:43.434424+0000","last_became_active":"2024-04-19T03:39:43.429508+0000","last_became_peered":"2024-04-19T03:39:43.429508+0000","last_unstale":"2024-04-19T03:39:43.434424+0000","last_undegraded":"2024-04-19T03:39:43.434424+0000","last_fullsized":"2024-04-19T03:39:43.434424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:13:25.908070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.429434+0000","last_change":"2024-04-19T03:39:43.429434+0000","last_active":"2024-04-19T03:39:43.429434+0000","last_peered":"2024-04-19T03:39:43.429434+0000","last_clean":"2024-04-19T03:39:43.429434+0000","last_became_active":"2024-04-19T03:39:43.428726+0000","last_became_peered":"2024-04-19T03:39:43.428726+0000","last_unstale":"2024-04-19T03:39:43.429434+0000","last_undegraded":"2024-04-19T03:39:43.429434+0000","last_fullsized":"2024-04-19T03:39:43.429434+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:15:13.073507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438518+0000","last_change":"2024-04-19T03:39:43.438518+0000","last_active":"2024-04-19T03:39:43.438518+0000","last_peered":"2024-04-19T03:39:43.438518+0000","last_clean":"2024-04-19T03:39:43.438518+0000","last_became_active":"2024-04-19T03:39:43.433063+0000","last_became_peered":"2024-04-19T03:39:43.433063+0000","last_unstale":"2024-04-19T03:39:43.438518+0000","last_undegraded":"2024-04-19T03:39:43.438518+0000","last_fullsized":"2024-04-19T03:39:43.438518+0000","mapping_epoch":92,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:24:19.050109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6161,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418326+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:42.418326+0000","last_peered":"2024-04-19T03:39:42.418326+0000","last_clean":"2024-04-19T03:39:42.418326+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:42.418326+0000","last_undegraded":"2024-04-19T03:39:42.418326+0000","last_fullsized":"2024-04-19T03:39:42.418326+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:53.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6174,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420003+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:42.420003+0000","last_peered":"2024-04-19T03:39:42.420003+0000","last_clean":"2024-04-19T03:39:42.420003+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:42.420003+0000","last_undegraded":"2024-04-19T03:39:42.420003+0000","last_fullsized":"2024-04-19T03:39:42.420003+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4026,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.435209+0000","last_change":"2024-04-19T03:39:43.435209+0000","last_active":"2024-04-19T03:39:43.435209+0000","last_peered":"2024-04-19T03:39:43.435209+0000","last_clean":"2024-04-19T03:39:43.435209+0000","last_became_active":"2024-04-19T03:39:43.431742+0000","last_became_peered":"2024-04-19T03:39:43.431742+0000","last_unstale":"2024-04-19T03:39:43.435209+0000","last_undegraded":"2024-04-19T03:39:43.435209+0000","last_fullsized":"2024-04-19T03:39:43.435209+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:20.127904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2179,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418580+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:42.418580+0000","last_peered":"2024-04-19T03:39:42.418580+0000","last_clean":"2024-04-19T03:39:42.418580+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:42.418580+0000","last_undegraded":"2024-04-19T03:39:42.418580+0000","last_fullsized":"2024-04-19T03:39:42.418580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:26:46.738924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2080,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418821+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:42.418821+0000","last_peered":"2024-04-19T03:39:42.418821+0000","last_clean":"2024-04-19T03:39:42.418821+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:42.418821+0000","last_undegraded":"2024-04-19T03:39:42.418821+0000","last_fullsized":"2024-04-19T03:39:42.418821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436519+0000","last_change":"2024-04-19T03:39:43.436519+0000","last_active":"2024-04-19T03:39:43.436519+0000","last_peered":"2024-04-19T03:39:43.436519+0000","last_clean":"2024-04-19T03:39:43.436519+0000","last_became_active":"2024-04-19T03:39:43.435748+0000","last_became_peered":"2024-04-19T03:39:43.435748+0000","last_unstale":"2024-04-19T03:39:43.436519+0000","last_undegraded":"2024-04-19T03:39:43.436519+0000","last_fullsized":"2024-04-19T03:39:43.436519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:12:44.959967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2112,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.431885+0000","last_change":"2024-04-19T03:39:43.431885+0000","last_active":"2024-04-19T03:39:43.431885+0000","last_peered":"2024-04-19T03:39:43.431885+0000","last_clean":"2024-04-19T03:39:43.431885+0000","last_became_active":"2024-04-19T03:39:43.430447+0000","last_became_peered":"2024-04-19T03:39:43.430447+0000","last_unstale":"2024-04-19T03:39:43.431885+0000","last_undegraded":"2024-04-19T03:39:43.431885+0000","last_fullsized":"2024-04-19T03:39:43.431885+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:51.146392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2089,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438507+0000","last_change":"2024-04-19T03:39:43.438507+0000","last_active":"2024-04-19T03:39:43.438507+0000","last_peered":"2024-04-19T03:39:43.438507+0000","last_clean":"2024-04-19T03:39:43.438507+0000","last_became_active":"2024-04-19T03:39:43.433748+0000","last_became_peered":"2024-04-19T03:39:43.433748+0000","last_unstale":"2024-04-19T03:39:43.438507+0000","last_undegraded":"2024-04-19T03:39:43.438507+0000","last_fullsized":"2024-04-19T03:39:43.438507+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:05.275594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419797+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:42.419797+0000","last_peered":"2024-04-19T03:39:42.419797+0000","last_clean":"2024-04-19T03:39:42.419797+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:42.419797+0000","last_undegraded":"2024-04-19T03:39:42.419797+0000","last_fullsized":"2024-04-19T03:39:42.419797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2146,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419855+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:42.419855+0000","last_peered":"2024-04-19T03:39:42.419855+0000","last_clean":"2024-04-19T03:39:42.419855+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:42.419855+0000","last_undegraded":"2024-04-19T03:39:42.419855+0000","last_fullsized":"2024-04-19T03:39:42.419855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:02:11.852910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4139,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419233+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:42.419233+0000","last_peered":"2024-04-19T03:39:42.419233+0000","last_clean":"2024-04-19T03:39:42.419233+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:42.419233+0000","last_undegraded":"2024-04-19T03:39:42.419233+0000","last_fullsized":"2024-04-19T03:39:42.419233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4173,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.435252+0000","last_change":"2024-04-19T03:39:43.435252+0000","last_active":"2024-04-19T03:39:43.435252+0000","last_peered":"2024-04-19T03:39:43.435252+0000","last_clean":"2024-04-19T03:39:43.435252+0000","last_became_active":"2024-04-19T03:39:43.431899+0000","last_became_peered":"2024-04-19T03:39:43.431899+0000","last_unstale":"2024-04-19T03:39:43.435252+0000","last_undegraded":"2024-04-19T03:39:43.435252+0000","last_fullsized":"2024-04-19T03:39:43.435252+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:44:42.176456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.434484+0000","last_change":"2024-04-19T03:39:43.434484+0000","last_active":"2024-04-19T03:39:43.434484+0000","last_peered":"2024-04-19T03:39:43.434484+0000","last_clean":"2024-04-19T03:39:43.434484+0000","last_became_active":"2024-04-19T03:39:43.431732+0000","last_became_peered":"2024-04-19T03:39:43.431732+0000","last_unstale":"2024-04-19T03:39:43.434484+0000","last_undegraded":"2024-04-19T03:39:43.434484+0000","last_fullsized":"2024-04-19T03:39:43.434484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:49:38.724258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2161,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418341+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:42.418341+0000","last_peered":"2024-04-19T03:39:42.418341+0000","last_clean":"2024-04-19T03:39:42.418341+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:42.418341+0000","last_undegraded":"2024-04-19T03:39:42.418341+0000","last_fullsized":"2024-04-19T03:39:42.418341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:49:53.274880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2155,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418161+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:42.418161+0000","last_peered":"2024-04-19T03:39:42.418161+0000","last_clean":"2024-04-19T03:39:42.418161+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:42.418161+0000","last_undegraded":"2024-04-19T03:39:42.418161+0000","last_fullsized":"2024-04-19T03:39:42.418161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:02:54.030504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4109,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419457+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:42.419457+0000","last_peered":"2024-04-19T03:39:42.419457+0000","last_clean":"2024-04-19T03:39:42.419457+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:42.419457+0000","last_undegraded":"2024-04-19T03:39:42.419457+0000","last_fullsized":"2024-04-19T03:39:42.419457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:59:02.437597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2095,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420987+0000","last_change":"2024-04-19T03:39:22.425040+0000","last_active":"2024-04-19T03:39:42.420987+0000","last_peered":"2024-04-19T03:39:42.420987+0000","last_clean":"2024-04-19T03:39:42.420987+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:39:42.420987+0000","last_undegraded":"2024-04-19T03:39:42.420987+0000","last_fullsized":"2024-04-19T03:39:42.420987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:11.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419868+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:42.419868+0000","last_peered":"2024-04-19T03:39:42.419868+0000","last_clean":"2024-04-19T03:39:42.419868+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:42.419868+0000","last_undegraded":"2024-04-19T03:39:42.419868+0000","last_fullsized":"2024-04-19T03:39:42.419868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:04.709731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438480+0000","last_change":"2024-04-19T03:39:43.438480+0000","last_active":"2024-04-19T03:39:43.438480+0000","last_peered":"2024-04-19T03:39:43.438480+0000","last_clean":"2024-04-19T03:39:43.438480+0000","last_became_active":"2024-04-19T03:39:43.437065+0000","last_became_peered":"2024-04-19T03:39:43.437065+0000","last_unstale":"2024-04-19T03:39:43.438480+0000","last_undegraded":"2024-04-19T03:39:43.438480+0000","last_fullsized":"2024-04-19T03:39:43.438480+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:31:35.202144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":90,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418206+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:42.418206+0000","last_peered":"2024-04-19T03:39:42.418206+0000","last_clean":"2024-04-19T03:39:42.418206+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:42.418206+0000","last_undegraded":"2024-04-19T03:39:42.418206+0000","last_fullsized":"2024-04-19T03:39:42.418206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:38.558225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":116,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421399+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:42.421399+0000","last_peered":"2024-04-19T03:39:42.421399+0000","last_clean":"2024-04-19T03:39:42.421399+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:42.421399+0000","last_undegraded":"2024-04-19T03:39:42.421399+0000","last_fullsized":"2024-04-19T03:39:42.421399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:45.979366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418408+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:42.418408+0000","last_peered":"2024-04-19T03:39:42.418408+0000","last_clean":"2024-04-19T03:39:42.418408+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:42.418408+0000","last_undegraded":"2024-04-19T03:39:42.418408+0000","last_fullsized":"2024-04-19T03:39:42.418408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418928+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:42.418928+0000","last_peered":"2024-04-19T03:39:42.418928+0000","last_clean":"2024-04-19T03:39:42.418928+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:42.418928+0000","last_undegraded":"2024-04-19T03:39:42.418928+0000","last_fullsized":"2024-04-19T03:39:42.418928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:36:40.518117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420339+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:42.420339+0000","last_peered":"2024-04-19T03:39:42.420339+0000","last_clean":"2024-04-19T03:39:42.420339+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:42.420339+0000","last_undegraded":"2024-04-19T03:39:42.420339+0000","last_fullsized":"2024-04-19T03:39:42.420339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:03.376898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":107,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420837+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:42.420837+0000","last_peered":"2024-04-19T03:39:42.420837+0000","last_clean":"2024-04-19T03:39:42.420837+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:42.420837+0000","last_undegraded":"2024-04-19T03:39:42.420837+0000","last_fullsized":"2024-04-19T03:39:42.420837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:55:42.884963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420283+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:42.420283+0000","last_peered":"2024-04-19T03:39:42.420283+0000","last_clean":"2024-04-19T03:39:42.420283+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:42.420283+0000","last_undegraded":"2024-04-19T03:39:42.420283+0000","last_fullsized":"2024-04-19T03:39:42.420283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:11.218501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420113+0000","last_change":"2024-04-19T03:35:59.882629+0000","last_active":"2024-04-19T03:39:42.420113+0000","last_peered":"2024-04-19T03:39:42.420113+0000","last_clean":"2024-04-19T03:39:42.420113+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:42.420113+0000","last_undegraded":"2024-04-19T03:39:42.420113+0000","last_fullsized":"2024-04-19T03:39:42.420113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:12:15.729984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.430440+0000","last_change":"2024-04-19T03:39:43.430440+0000","last_active":"2024-04-19T03:39:43.430440+0000","last_peered":"2024-04-19T03:39:43.430440+0000","last_clean":"2024-04-19T03:39:43.430440+0000","last_became_active":"2024-04-19T03:39:43.429210+0000","last_became_peered":"2024-04-19T03:39:43.429210+0000","last_unstale":"2024-04-19T03:39:43.430440+0000","last_undegraded":"2024-04-19T03:39:43.430440+0000","last_fullsized":"2024-04-19T03:39:43.430440+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:15:13.323416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6067,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418025+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:42.418025+0000","last_peered":"2024-04-19T03:39:42.418025+0000","last_clean":"2024-04-19T03:39:42.418025+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:42.418025+0000","last_undegraded":"2024-04-19T03:39:42.418025+0000","last_fullsized":"2024-04-19T03:39:42.418025+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.078495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":113,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421218+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:42.421218+0000","last_peered":"2024-04-19T03:39:42.421218+0000","last_clean":"2024-04-19T03:39:42.421218+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:42.421218+0000","last_undegraded":"2024-04-19T03:39:42.421218+0000","last_fullsized":"2024-04-19T03:39:42.421218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:12.586537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4150,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420052+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:42.420052+0000","last_peered":"2024-04-19T03:39:42.420052+0000","last_clean":"2024-04-19T03:39:42.420052+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:42.420052+0000","last_undegraded":"2024-04-19T03:39:42.420052+0000","last_fullsized":"2024-04-19T03:39:42.420052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:58:28.354948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437653+0000","last_change":"2024-04-19T03:39:43.437653+0000","last_active":"2024-04-19T03:39:43.437653+0000","last_peered":"2024-04-19T03:39:43.437653+0000","last_clean":"2024-04-19T03:39:43.437653+0000","last_became_active":"2024-04-19T03:39:43.437298+0000","last_became_peered":"2024-04-19T03:39:43.437298+0000","last_unstale":"2024-04-19T03:39:43.437653+0000","last_undegraded":"2024-04-19T03:39:43.437653+0000","last_fullsized":"2024-04-19T03:39:43.437653+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:03:17.212104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4170,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437031+0000","last_change":"2024-04-19T03:39:43.437031+0000","last_active":"2024-04-19T03:39:43.437031+0000","last_peered":"2024-04-19T03:39:43.437031+0000","last_clean":"2024-04-19T03:39:43.437031+0000","last_became_active":"2024-04-19T03:39:43.434605+0000","last_became_peered":"2024-04-19T03:39:43.434605+0000","last_unstale":"2024-04-19T03:39:43.437031+0000","last_undegraded":"2024-04-19T03:39:43.437031+0000","last_fullsized":"2024-04-19T03:39:43.437031+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:59:42.327472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.433646+0000","last_change":"2024-04-19T03:39:43.433646+0000","last_active":"2024-04-19T03:39:43.433646+0000","last_peered":"2024-04-19T03:39:43.433646+0000","last_clean":"2024-04-19T03:39:43.433646+0000","last_became_active":"2024-04-19T03:39:43.431842+0000","last_became_peered":"2024-04-19T03:39:43.431842+0000","last_unstale":"2024-04-19T03:39:43.433646+0000","last_undegraded":"2024-04-19T03:39:43.433646+0000","last_fullsized":"2024-04-19T03:39:43.433646+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:59:47.412765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2063,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419559+0000","last_change":"2024-04-19T03:35:59.882869+0000","last_active":"2024-04-19T03:39:42.419559+0000","last_peered":"2024-04-19T03:39:42.419559+0000","last_clean":"2024-04-19T03:39:42.419559+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:39:42.419559+0000","last_undegraded":"2024-04-19T03:39:42.419559+0000","last_fullsized":"2024-04-19T03:39:42.419559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:04.829412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419933+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:42.419933+0000","last_peered":"2024-04-19T03:39:42.419933+0000","last_clean":"2024-04-19T03:39:42.419933+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:42.419933+0000","last_undegraded":"2024-04-19T03:39:42.419933+0000","last_fullsized":"2024-04-19T03:39:42.419933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:17:26.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2121,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421546+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:42.421546+0000","last_peered":"2024-04-19T03:39:42.421546+0000","last_clean":"2024-04-19T03:39:42.421546+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:42.421546+0000","last_undegraded":"2024-04-19T03:39:42.421546+0000","last_fullsized":"2024-04-19T03:39:42.421546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418316+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:42.418316+0000","last_peered":"2024-04-19T03:39:42.418316+0000","last_clean":"2024-04-19T03:39:42.418316+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:42.418316+0000","last_undegraded":"2024-04-19T03:39:42.418316+0000","last_fullsized":"2024-04-19T03:39:42.418316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:16.801026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":110,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419704+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:42.419704+0000","last_peered":"2024-04-19T03:39:42.419704+0000","last_clean":"2024-04-19T03:39:42.419704+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:42.419704+0000","last_undegraded":"2024-04-19T03:39:42.419704+0000","last_fullsized":"2024-04-19T03:39:42.419704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:56.576101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439038+0000","last_change":"2024-04-19T03:39:43.439038+0000","last_active":"2024-04-19T03:39:43.439038+0000","last_peered":"2024-04-19T03:39:43.439038+0000","last_clean":"2024-04-19T03:39:43.439038+0000","last_became_active":"2024-04-19T03:39:43.436291+0000","last_became_peered":"2024-04-19T03:39:43.436291+0000","last_unstale":"2024-04-19T03:39:43.439038+0000","last_undegraded":"2024-04-19T03:39:43.439038+0000","last_fullsized":"2024-04-19T03:39:43.439038+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:32.215619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2206,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420401+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:42.420401+0000","last_peered":"2024-04-19T03:39:42.420401+0000","last_clean":"2024-04-19T03:39:42.420401+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:42.420401+0000","last_undegraded":"2024-04-19T03:39:42.420401+0000","last_fullsized":"2024-04-19T03:39:42.420401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:18:33.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.432218+0000","last_change":"2024-04-19T03:39:43.432218+0000","last_active":"2024-04-19T03:39:43.432218+0000","last_peered":"2024-04-19T03:39:43.432218+0000","last_clean":"2024-04-19T03:39:43.432218+0000","last_became_active":"2024-04-19T03:39:43.431751+0000","last_became_peered":"2024-04-19T03:39:43.431751+0000","last_unstale":"2024-04-19T03:39:43.432218+0000","last_undegraded":"2024-04-19T03:39:43.432218+0000","last_fullsized":"2024-04-19T03:39:43.432218+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:53:15.359784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2166,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417681+0000","last_change":"2024-04-19T03:39:22.424221+0000","last_active":"2024-04-19T03:39:42.417681+0000","last_peered":"2024-04-19T03:39:42.417681+0000","last_clean":"2024-04-19T03:39:42.417681+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:39:42.417681+0000","last_undegraded":"2024-04-19T03:39:42.417681+0000","last_fullsized":"2024-04-19T03:39:42.417681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:24:29.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":104,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419346+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:42.419346+0000","last_peered":"2024-04-19T03:39:42.419346+0000","last_clean":"2024-04-19T03:39:42.419346+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:42.419346+0000","last_undegraded":"2024-04-19T03:39:42.419346+0000","last_fullsized":"2024-04-19T03:39:42.419346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:44:59.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":90,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418697+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:42.418697+0000","last_peered":"2024-04-19T03:39:42.418697+0000","last_clean":"2024-04-19T03:39:42.418697+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:42.418697+0000","last_undegraded":"2024-04-19T03:39:42.418697+0000","last_fullsized":"2024-04-19T03:39:42.418697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438008+0000","last_change":"2024-04-19T03:39:43.438008+0000","last_active":"2024-04-19T03:39:43.438008+0000","last_peered":"2024-04-19T03:39:43.438008+0000","last_clean":"2024-04-19T03:39:43.438008+0000","last_became_active":"2024-04-19T03:39:43.436323+0000","last_became_peered":"2024-04-19T03:39:43.436323+0000","last_unstale":"2024-04-19T03:39:43.438008+0000","last_undegraded":"2024-04-19T03:39:43.438008+0000","last_fullsized":"2024-04-19T03:39:43.438008+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:37:18.450592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2068,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436430+0000","last_change":"2024-04-19T03:39:43.436430+0000","last_active":"2024-04-19T03:39:43.436430+0000","last_peered":"2024-04-19T03:39:43.436430+0000","last_clean":"2024-04-19T03:39:43.436430+0000","last_became_active":"2024-04-19T03:39:43.434807+0000","last_became_peered":"2024-04-19T03:39:43.434807+0000","last_unstale":"2024-04-19T03:39:43.436430+0000","last_undegraded":"2024-04-19T03:39:43.436430+0000","last_fullsized":"2024-04-19T03:39:43.436430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:40.177683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.434961+0000","last_change":"2024-04-19T03:39:43.434961+0000","last_active":"2024-04-19T03:39:43.434961+0000","last_peered":"2024-04-19T03:39:43.434961+0000","last_clean":"2024-04-19T03:39:43.434961+0000","last_became_active":"2024-04-19T03:39:43.432885+0000","last_became_peered":"2024-04-19T03:39:43.432885+0000","last_unstale":"2024-04-19T03:39:43.434961+0000","last_undegraded":"2024-04-19T03:39:43.434961+0000","last_fullsized":"2024-04-19T03:39:43.434961+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:39:00.862425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421316+0000","last_change":"2024-04-19T03:39:19.427223+0000","last_active":"2024-04-19T03:39:42.421316+0000","last_peered":"2024-04-19T03:39:42.421316+0000","last_clean":"2024-04-19T03:39:42.421316+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:42.421316+0000","last_undegraded":"2024-04-19T03:39:42.421316+0000","last_fullsized":"2024-04-19T03:39:42.421316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:38.364762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421232+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:42.421232+0000","last_peered":"2024-04-19T03:39:42.421232+0000","last_clean":"2024-04-19T03:39:42.421232+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:42.421232+0000","last_undegraded":"2024-04-19T03:39:42.421232+0000","last_fullsized":"2024-04-19T03:39:42.421232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:37.076042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2095,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.435754+0000","last_change":"2024-04-19T03:39:43.435754+0000","last_active":"2024-04-19T03:39:43.435754+0000","last_peered":"2024-04-19T03:39:43.435754+0000","last_clean":"2024-04-19T03:39:43.435754+0000","last_became_active":"2024-04-19T03:39:43.433630+0000","last_became_peered":"2024-04-19T03:39:43.433630+0000","last_unstale":"2024-04-19T03:39:43.435754+0000","last_undegraded":"2024-04-19T03:39:43.435754+0000","last_fullsized":"2024-04-19T03:39:43.435754+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:48.144906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.434600+0000","last_change":"2024-04-19T03:39:43.434600+0000","last_active":"2024-04-19T03:39:43.434600+0000","last_peered":"2024-04-19T03:39:43.434600+0000","last_clean":"2024-04-19T03:39:43.434600+0000","last_became_active":"2024-04-19T03:39:43.430616+0000","last_became_peered":"2024-04-19T03:39:43.430616+0000","last_unstale":"2024-04-19T03:39:43.434600+0000","last_undegraded":"2024-04-19T03:39:43.434600+0000","last_fullsized":"2024-04-19T03:39:43.434600+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:04:57.998568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437657+0000","last_change":"2024-04-19T03:39:43.437657+0000","last_active":"2024-04-19T03:39:43.437657+0000","last_peered":"2024-04-19T03:39:43.437657+0000","last_clean":"2024-04-19T03:39:43.437657+0000","last_became_active":"2024-04-19T03:39:43.434699+0000","last_became_peered":"2024-04-19T03:39:43.434699+0000","last_unstale":"2024-04-19T03:39:43.437657+0000","last_undegraded":"2024-04-19T03:39:43.437657+0000","last_fullsized":"2024-04-19T03:39:43.437657+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:56.869164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417939+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:42.417939+0000","last_peered":"2024-04-19T03:39:42.417939+0000","last_clean":"2024-04-19T03:39:42.417939+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:42.417939+0000","last_undegraded":"2024-04-19T03:39:42.417939+0000","last_fullsized":"2024-04-19T03:39:42.417939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:37.360479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2132,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.433730+0000","last_change":"2024-04-19T03:39:43.433730+0000","last_active":"2024-04-19T03:39:43.433730+0000","last_peered":"2024-04-19T03:39:43.433730+0000","last_clean":"2024-04-19T03:39:43.433730+0000","last_became_active":"2024-04-19T03:39:43.431921+0000","last_became_peered":"2024-04-19T03:39:43.431921+0000","last_unstale":"2024-04-19T03:39:43.433730+0000","last_undegraded":"2024-04-19T03:39:43.433730+0000","last_fullsized":"2024-04-19T03:39:43.433730+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:29.796342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418053+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:42.418053+0000","last_peered":"2024-04-19T03:39:42.418053+0000","last_clean":"2024-04-19T03:39:42.418053+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:42.418053+0000","last_undegraded":"2024-04-19T03:39:42.418053+0000","last_fullsized":"2024-04-19T03:39:42.418053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6118,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420024+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:42.420024+0000","last_peered":"2024-04-19T03:39:42.420024+0000","last_clean":"2024-04-19T03:39:42.420024+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:42.420024+0000","last_undegraded":"2024-04-19T03:39:42.420024+0000","last_fullsized":"2024-04-19T03:39:42.420024+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:52.631958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419894+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:42.419894+0000","last_peered":"2024-04-19T03:39:42.419894+0000","last_clean":"2024-04-19T03:39:42.419894+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:42.419894+0000","last_undegraded":"2024-04-19T03:39:42.419894+0000","last_fullsized":"2024-04-19T03:39:42.419894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:45:41.237022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421286+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:42.421286+0000","last_peered":"2024-04-19T03:39:42.421286+0000","last_clean":"2024-04-19T03:39:42.421286+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:42.421286+0000","last_undegraded":"2024-04-19T03:39:42.421286+0000","last_fullsized":"2024-04-19T03:39:42.421286+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:57.817587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":108,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420461+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:42.420461+0000","last_peered":"2024-04-19T03:39:42.420461+0000","last_clean":"2024-04-19T03:39:42.420461+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:42.420461+0000","last_undegraded":"2024-04-19T03:39:42.420461+0000","last_fullsized":"2024-04-19T03:39:42.420461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:52:09.761330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":106,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419569+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:42.419569+0000","last_peered":"2024-04-19T03:39:42.419569+0000","last_clean":"2024-04-19T03:39:42.419569+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:42.419569+0000","last_undegraded":"2024-04-19T03:39:42.419569+0000","last_fullsized":"2024-04-19T03:39:42.419569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:26.256537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":114,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418792+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:42.418792+0000","last_peered":"2024-04-19T03:39:42.418792+0000","last_clean":"2024-04-19T03:39:42.418792+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:42.418792+0000","last_undegraded":"2024-04-19T03:39:42.418792+0000","last_fullsized":"2024-04-19T03:39:42.418792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:09.451728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":106,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418434+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:42.418434+0000","last_peered":"2024-04-19T03:39:42.418434+0000","last_clean":"2024-04-19T03:39:42.418434+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:42.418434+0000","last_undegraded":"2024-04-19T03:39:42.418434+0000","last_fullsized":"2024-04-19T03:39:42.418434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:46:56.771751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420618+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:42.420618+0000","last_peered":"2024-04-19T03:39:42.420618+0000","last_clean":"2024-04-19T03:39:42.420618+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:42.420618+0000","last_undegraded":"2024-04-19T03:39:42.420618+0000","last_fullsized":"2024-04-19T03:39:42.420618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:27:21.055601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":230,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439200+0000","last_change":"2024-04-19T03:39:43.439200+0000","last_active":"2024-04-19T03:39:43.439200+0000","last_peered":"2024-04-19T03:39:43.439200+0000","last_clean":"2024-04-19T03:39:43.439200+0000","last_became_active":"2024-04-19T03:39:43.438741+0000","last_became_peered":"2024-04-19T03:39:43.438741+0000","last_unstale":"2024-04-19T03:39:43.439200+0000","last_undegraded":"2024-04-19T03:39:43.439200+0000","last_fullsized":"2024-04-19T03:39:43.439200+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:59.242180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":112,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417330+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:42.417330+0000","last_peered":"2024-04-19T03:39:42.417330+0000","last_clean":"2024-04-19T03:39:42.417330+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:42.417330+0000","last_undegraded":"2024-04-19T03:39:42.417330+0000","last_fullsized":"2024-04-19T03:39:42.417330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:20:56.591788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8089,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420051+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:42.420051+0000","last_peered":"2024-04-19T03:39:42.420051+0000","last_clean":"2024-04-19T03:39:42.420051+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:42.420051+0000","last_undegraded":"2024-04-19T03:39:42.420051+0000","last_fullsized":"2024-04-19T03:39:42.420051+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:32:33.770692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.433683+0000","last_change":"2024-04-19T03:39:43.433683+0000","last_active":"2024-04-19T03:39:43.433683+0000","last_peered":"2024-04-19T03:39:43.433683+0000","last_clean":"2024-04-19T03:39:43.433683+0000","last_became_active":"2024-04-19T03:39:43.430609+0000","last_became_peered":"2024-04-19T03:39:43.430609+0000","last_unstale":"2024-04-19T03:39:43.433683+0000","last_undegraded":"2024-04-19T03:39:43.433683+0000","last_fullsized":"2024-04-19T03:39:43.433683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:18:09.914987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417922+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:42.417922+0000","last_peered":"2024-04-19T03:39:42.417922+0000","last_clean":"2024-04-19T03:39:42.417922+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:42.417922+0000","last_undegraded":"2024-04-19T03:39:42.417922+0000","last_fullsized":"2024-04-19T03:39:42.417922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420399+0000","last_change":"2024-04-19T03:35:59.880278+0000","last_active":"2024-04-19T03:39:42.420399+0000","last_peered":"2024-04-19T03:39:42.420399+0000","last_clean":"2024-04-19T03:39:42.420399+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:42.420399+0000","last_undegraded":"2024-04-19T03:39:42.420399+0000","last_fullsized":"2024-04-19T03:39:42.420399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438709+0000","last_change":"2024-04-19T03:39:43.438709+0000","last_active":"2024-04-19T03:39:43.438709+0000","last_peered":"2024-04-19T03:39:43.438709+0000","last_clean":"2024-04-19T03:39:43.438709+0000","last_became_active":"2024-04-19T03:39:43.435880+0000","last_became_peered":"2024-04-19T03:39:43.435880+0000","last_unstale":"2024-04-19T03:39:43.438709+0000","last_undegraded":"2024-04-19T03:39:43.438709+0000","last_fullsized":"2024-04-19T03:39:43.438709+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:40.539139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419973+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:42.419973+0000","last_peered":"2024-04-19T03:39:42.419973+0000","last_clean":"2024-04-19T03:39:42.419973+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:42.419973+0000","last_undegraded":"2024-04-19T03:39:42.419973+0000","last_fullsized":"2024-04-19T03:39:42.419973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:46:55.907044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437845+0000","last_change":"2024-04-19T03:39:43.437845+0000","last_active":"2024-04-19T03:39:43.437845+0000","last_peered":"2024-04-19T03:39:43.437845+0000","last_clean":"2024-04-19T03:39:43.437845+0000","last_became_active":"2024-04-19T03:39:43.436182+0000","last_became_peered":"2024-04-19T03:39:43.436182+0000","last_unstale":"2024-04-19T03:39:43.437845+0000","last_undegraded":"2024-04-19T03:39:43.437845+0000","last_fullsized":"2024-04-19T03:39:43.437845+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:40:11.163476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418089+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:42.418089+0000","last_peered":"2024-04-19T03:39:42.418089+0000","last_clean":"2024-04-19T03:39:42.418089+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:42.418089+0000","last_undegraded":"2024-04-19T03:39:42.418089+0000","last_fullsized":"2024-04-19T03:39:42.418089+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:28:31.432221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.431395+0000","last_change":"2024-04-19T03:39:43.431395+0000","last_active":"2024-04-19T03:39:43.431395+0000","last_peered":"2024-04-19T03:39:43.431395+0000","last_clean":"2024-04-19T03:39:43.431395+0000","last_became_active":"2024-04-19T03:39:43.430100+0000","last_became_peered":"2024-04-19T03:39:43.430100+0000","last_unstale":"2024-04-19T03:39:43.431395+0000","last_undegraded":"2024-04-19T03:39:43.431395+0000","last_fullsized":"2024-04-19T03:39:43.431395+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:42:29.722281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":96,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421710+0000","last_change":"2024-04-19T03:35:59.885414+0000","last_active":"2024-04-19T03:39:42.421710+0000","last_peered":"2024-04-19T03:39:42.421710+0000","last_clean":"2024-04-19T03:39:42.421710+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:42.421710+0000","last_undegraded":"2024-04-19T03:39:42.421710+0000","last_fullsized":"2024-04-19T03:39:42.421710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:45.732898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":106,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419687+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:42.419687+0000","last_peered":"2024-04-19T03:39:42.419687+0000","last_clean":"2024-04-19T03:39:42.419687+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:42.419687+0000","last_undegraded":"2024-04-19T03:39:42.419687+0000","last_fullsized":"2024-04-19T03:39:42.419687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:19.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421814+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:42.421814+0000","last_peered":"2024-04-19T03:39:42.421814+0000","last_clean":"2024-04-19T03:39:42.421814+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:42.421814+0000","last_undegraded":"2024-04-19T03:39:42.421814+0000","last_fullsized":"2024-04-19T03:39:42.421814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:10.373136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2066,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419757+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:42.419757+0000","last_peered":"2024-04-19T03:39:42.419757+0000","last_clean":"2024-04-19T03:39:42.419757+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:42.419757+0000","last_undegraded":"2024-04-19T03:39:42.419757+0000","last_fullsized":"2024-04-19T03:39:42.419757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:24.522606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.434989+0000","last_change":"2024-04-19T03:39:43.434989+0000","last_active":"2024-04-19T03:39:43.434989+0000","last_peered":"2024-04-19T03:39:43.434989+0000","last_clean":"2024-04-19T03:39:43.434989+0000","last_became_active":"2024-04-19T03:39:43.434441+0000","last_became_peered":"2024-04-19T03:39:43.434441+0000","last_unstale":"2024-04-19T03:39:43.434989+0000","last_undegraded":"2024-04-19T03:39:43.434989+0000","last_fullsized":"2024-04-19T03:39:43.434989+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:32.994678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.433776+0000","last_change":"2024-04-19T03:39:43.433776+0000","last_active":"2024-04-19T03:39:43.433776+0000","last_peered":"2024-04-19T03:39:43.433776+0000","last_clean":"2024-04-19T03:39:43.433776+0000","last_became_active":"2024-04-19T03:39:43.431591+0000","last_became_peered":"2024-04-19T03:39:43.431591+0000","last_unstale":"2024-04-19T03:39:43.433776+0000","last_undegraded":"2024-04-19T03:39:43.433776+0000","last_fullsized":"2024-04-19T03:39:43.433776+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:35.753671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":109,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418467+0000","last_change":"2024-04-19T03:39:19.423741+0000","last_active":"2024-04-19T03:39:42.418467+0000","last_peered":"2024-04-19T03:39:42.418467+0000","last_clean":"2024-04-19T03:39:42.418467+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:39:42.418467+0000","last_undegraded":"2024-04-19T03:39:42.418467+0000","last_fullsized":"2024-04-19T03:39:42.418467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:38:05.738591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419080+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:42.419080+0000","last_peered":"2024-04-19T03:39:42.419080+0000","last_clean":"2024-04-19T03:39:42.419080+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:42.419080+0000","last_undegraded":"2024-04-19T03:39:42.419080+0000","last_fullsized":"2024-04-19T03:39:42.419080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:58.822700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2144,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419737+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:42.419737+0000","last_peered":"2024-04-19T03:39:42.419737+0000","last_clean":"2024-04-19T03:39:42.419737+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:42.419737+0000","last_undegraded":"2024-04-19T03:39:42.419737+0000","last_fullsized":"2024-04-19T03:39:42.419737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:07.403545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.431391+0000","last_change":"2024-04-19T03:39:43.431391+0000","last_active":"2024-04-19T03:39:43.431391+0000","last_peered":"2024-04-19T03:39:43.431391+0000","last_clean":"2024-04-19T03:39:43.431391+0000","last_became_active":"2024-04-19T03:39:43.430259+0000","last_became_peered":"2024-04-19T03:39:43.430259+0000","last_unstale":"2024-04-19T03:39:43.431391+0000","last_undegraded":"2024-04-19T03:39:43.431391+0000","last_fullsized":"2024-04-19T03:39:43.431391+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:08.938092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2087,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.433046+0000","last_change":"2024-04-19T03:39:43.433046+0000","last_active":"2024-04-19T03:39:43.433046+0000","last_peered":"2024-04-19T03:39:43.433046+0000","last_clean":"2024-04-19T03:39:43.433046+0000","last_became_active":"2024-04-19T03:39:43.430703+0000","last_became_peered":"2024-04-19T03:39:43.430703+0000","last_unstale":"2024-04-19T03:39:43.433046+0000","last_undegraded":"2024-04-19T03:39:43.433046+0000","last_fullsized":"2024-04-19T03:39:43.433046+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:51:36.545663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":106,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421488+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:42.421488+0000","last_peered":"2024-04-19T03:39:42.421488+0000","last_clean":"2024-04-19T03:39:42.421488+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:42.421488+0000","last_undegraded":"2024-04-19T03:39:42.421488+0000","last_fullsized":"2024-04-19T03:39:42.421488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:16:22.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.434935+0000","last_change":"2024-04-19T03:39:43.434935+0000","last_active":"2024-04-19T03:39:43.434935+0000","last_peered":"2024-04-19T03:39:43.434935+0000","last_clean":"2024-04-19T03:39:43.434935+0000","last_became_active":"2024-04-19T03:39:43.433233+0000","last_became_peered":"2024-04-19T03:39:43.433233+0000","last_unstale":"2024-04-19T03:39:43.434935+0000","last_undegraded":"2024-04-19T03:39:43.434935+0000","last_fullsized":"2024-04-19T03:39:43.434935+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:16.505444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419060+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:42.419060+0000","last_peered":"2024-04-19T03:39:42.419060+0000","last_clean":"2024-04-19T03:39:42.419060+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:42.419060+0000","last_undegraded":"2024-04-19T03:39:42.419060+0000","last_fullsized":"2024-04-19T03:39:42.419060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:38.660017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4150,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418854+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:42.418854+0000","last_peered":"2024-04-19T03:39:42.418854+0000","last_clean":"2024-04-19T03:39:42.418854+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:42.418854+0000","last_undegraded":"2024-04-19T03:39:42.418854+0000","last_fullsized":"2024-04-19T03:39:42.418854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.420189+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:42.420189+0000","last_peered":"2024-04-19T03:39:42.420189+0000","last_clean":"2024-04-19T03:39:42.420189+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:42.420189+0000","last_undegraded":"2024-04-19T03:39:42.420189+0000","last_fullsized":"2024-04-19T03:39:42.420189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:06:18.234268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2136,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438910+0000","last_change":"2024-04-19T03:39:43.438910+0000","last_active":"2024-04-19T03:39:43.438910+0000","last_peered":"2024-04-19T03:39:43.438910+0000","last_clean":"2024-04-19T03:39:43.438910+0000","last_became_active":"2024-04-19T03:39:43.435662+0000","last_became_peered":"2024-04-19T03:39:43.435662+0000","last_unstale":"2024-04-19T03:39:43.438910+0000","last_undegraded":"2024-04-19T03:39:43.438910+0000","last_fullsized":"2024-04-19T03:39:43.438910+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:29:25.928985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436452+0000","last_change":"2024-04-19T03:39:43.436452+0000","last_active":"2024-04-19T03:39:43.436452+0000","last_peered":"2024-04-19T03:39:43.436452+0000","last_clean":"2024-04-19T03:39:43.436452+0000","last_became_active":"2024-04-19T03:39:43.433006+0000","last_became_peered":"2024-04-19T03:39:43.433006+0000","last_unstale":"2024-04-19T03:39:43.436452+0000","last_undegraded":"2024-04-19T03:39:43.436452+0000","last_fullsized":"2024-04-19T03:39:43.436452+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:05:07.867329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":99,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.417609+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:42.417609+0000","last_peered":"2024-04-19T03:39:42.417609+0000","last_clean":"2024-04-19T03:39:42.417609+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:42.417609+0000","last_undegraded":"2024-04-19T03:39:42.417609+0000","last_fullsized":"2024-04-19T03:39:42.417609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:37:31.162226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2088,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.418629+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:42.418629+0000","last_peered":"2024-04-19T03:39:42.418629+0000","last_clean":"2024-04-19T03:39:42.418629+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:42.418629+0000","last_undegraded":"2024-04-19T03:39:42.418629+0000","last_fullsized":"2024-04-19T03:39:42.418629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:59:58.782759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.421424+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:42.421424+0000","last_peered":"2024-04-19T03:39:42.421424+0000","last_clean":"2024-04-19T03:39:42.421424+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:42.421424+0000","last_undegraded":"2024-04-19T03:39:42.421424+0000","last_fullsized":"2024-04-19T03:39:42.421424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:13:30.261057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2165,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-19T03:39:42.419887+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:42.419887+0000","last_peered":"2024-04-19T03:39:42.419887+0000","last_clean":"2024-04-19T03:39:42.419887+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:42.419887+0000","last_undegraded":"2024-04-19T03:39:42.419887+0000","last_fullsized":"2024-04-19T03:39:42.419887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:08:05.642471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481800,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47240,"kb_used_data":1652,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324600,"statfs":{"total":96636764160,"available":96588390400,"internally_reserved":0,"allocated":1691648,"data_stored":1258390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369848,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94001992,"statfs":{"total":96636764160,"available":96258039808,"internally_reserved":0,"allocated":1679360,"data_stored":1257168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.39600000000000002,"15min":0.42299999999999999},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.39800000000000002,"15min":0.42399999999999999},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378832,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993008,"statfs":{"total":96636764160,"available":96248840192,"internally_reserved":0,"allocated":790528,"data_stored":382380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:38:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.47499999999999998,"15min":0.44500000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.7610000000000001,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40100000000000002,"15min":0.41999999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:39:51.334 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.334 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.334 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.334 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.335 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.335 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.335 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.335 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.335 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.335 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.335 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.336 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.336 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.336 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.336 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.336 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.336 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.336 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.337 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.337 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.337 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.337 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.337 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.337 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.337 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.337 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.337 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.338 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.338 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.338 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.338 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.338 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.338 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.338 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.338 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.339 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.339 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.339 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.339 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.339 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.339 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.339 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.339 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.340 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.340 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.340 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.340 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.340 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.340 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.340 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.341 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.341 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.341 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.341 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.341 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.341 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.341 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.341 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.341 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.342 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.342 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.342 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.342 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.342 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.342 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.342 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.343 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.343 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.343 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.343 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.343 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.343 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.343 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T03:35:54.393544+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=54, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.343 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.344 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.344 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.344 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.344 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.344 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.344 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.344 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.344 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.345 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.345 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.345 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.345 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.345 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.345 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.345 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.345 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.345 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.346 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.346 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.346 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.346 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.346 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.346 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.346 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.346 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.347 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.347 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.347 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.347 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.347 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.347 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:39:51.347 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:40:11.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:40:11.732 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:40:11.734 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:40:11.745 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-04-19T03:40:10.341864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115803,"ondisk_log_size":115803,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795896,"kb_used_data":4064,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319624,"statfs":{"total":289910292480,"available":289095294976,"internally_reserved":0,"allocated":4161536,"data_stored":2897938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003206"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2068,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426323+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:43.426323+0000","last_peered":"2024-04-19T03:39:43.426323+0000","last_clean":"2024-04-19T03:39:43.426323+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:43.426323+0000","last_undegraded":"2024-04-19T03:39:43.426323+0000","last_fullsized":"2024-04-19T03:39:43.426323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":93,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425890+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:43.425890+0000","last_peered":"2024-04-19T03:39:43.425890+0000","last_clean":"2024-04-19T03:39:43.425890+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:43.425890+0000","last_undegraded":"2024-04-19T03:39:43.425890+0000","last_fullsized":"2024-04-19T03:39:43.425890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439186+0000","last_change":"2024-04-19T03:39:43.438617+0000","last_active":"2024-04-19T03:39:43.439186+0000","last_peered":"2024-04-19T03:39:43.439186+0000","last_clean":"2024-04-19T03:39:43.439186+0000","last_became_active":"2024-04-19T03:39:43.437251+0000","last_became_peered":"2024-04-19T03:39:43.437251+0000","last_unstale":"2024-04-19T03:39:43.439186+0000","last_undegraded":"2024-04-19T03:39:43.439186+0000","last_fullsized":"2024-04-19T03:39:43.439186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.425776+0000","last_change":"2024-04-19T03:40:04.425893+0000","last_active":"2024-04-19T03:40:04.425776+0000","last_peered":"2024-04-19T03:40:04.425776+0000","last_clean":"2024-04-19T03:40:04.425776+0000","last_became_active":"2024-04-19T03:39:43.434583+0000","last_became_peered":"2024-04-19T03:39:43.434583+0000","last_unstale":"2024-04-19T03:40:04.425776+0000","last_undegraded":"2024-04-19T03:40:04.425776+0000","last_fullsized":"2024-04-19T03:40:04.425776+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.425751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:07.588193+0000","scrub_duration":0.002196057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425492+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:43.425492+0000","last_peered":"2024-04-19T03:39:43.425492+0000","last_clean":"2024-04-19T03:39:43.425492+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:43.425492+0000","last_undegraded":"2024-04-19T03:39:43.425492+0000","last_fullsized":"2024-04-19T03:39:43.425492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436364+0000","last_change":"2024-04-19T03:39:43.434424+0000","last_active":"2024-04-19T03:39:43.436364+0000","last_peered":"2024-04-19T03:39:43.436364+0000","last_clean":"2024-04-19T03:39:43.436364+0000","last_became_active":"2024-04-19T03:39:43.429508+0000","last_became_peered":"2024-04-19T03:39:43.429508+0000","last_unstale":"2024-04-19T03:39:43.436364+0000","last_undegraded":"2024-04-19T03:39:43.436364+0000","last_fullsized":"2024-04-19T03:39:43.436364+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.432195+0000","last_change":"2024-04-19T03:39:43.429434+0000","last_active":"2024-04-19T03:39:43.432195+0000","last_peered":"2024-04-19T03:39:43.432195+0000","last_clean":"2024-04-19T03:39:43.432195+0000","last_became_active":"2024-04-19T03:39:43.428726+0000","last_became_peered":"2024-04-19T03:39:43.428726+0000","last_unstale":"2024-04-19T03:39:43.432195+0000","last_undegraded":"2024-04-19T03:39:43.432195+0000","last_fullsized":"2024-04-19T03:39:43.432195+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:03.416041+0000","last_change":"2024-04-19T03:40:03.416142+0000","last_active":"2024-04-19T03:40:03.416041+0000","last_peered":"2024-04-19T03:40:03.416041+0000","last_clean":"2024-04-19T03:40:03.416041+0000","last_became_active":"2024-04-19T03:39:43.433063+0000","last_became_peered":"2024-04-19T03:39:43.433063+0000","last_unstale":"2024-04-19T03:40:03.416041+0000","last_undegraded":"2024-04-19T03:40:03.416041+0000","last_fullsized":"2024-04-19T03:40:03.416041+0000","mapping_epoch":92,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8029","last_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_deep_scrub":"70'8029","last_deep_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_clean_scrub_stamp":"2024-04-19T03:40:03.416008+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:39.795688+0000","scrub_duration":0.002564808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423305+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:43.423305+0000","last_peered":"2024-04-19T03:39:43.423305+0000","last_clean":"2024-04-19T03:39:43.423305+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:43.423305+0000","last_undegraded":"2024-04-19T03:39:43.423305+0000","last_fullsized":"2024-04-19T03:39:43.423305+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426346+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:43.426346+0000","last_peered":"2024-04-19T03:39:43.426346+0000","last_clean":"2024-04-19T03:39:43.426346+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:43.426346+0000","last_undegraded":"2024-04-19T03:39:43.426346+0000","last_fullsized":"2024-04-19T03:39:43.426346+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4027,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437538+0000","last_change":"2024-04-19T03:39:43.435209+0000","last_active":"2024-04-19T03:39:43.437538+0000","last_peered":"2024-04-19T03:39:43.437538+0000","last_clean":"2024-04-19T03:39:43.437538+0000","last_became_active":"2024-04-19T03:39:43.431742+0000","last_became_peered":"2024-04-19T03:39:43.431742+0000","last_unstale":"2024-04-19T03:39:43.437538+0000","last_undegraded":"2024-04-19T03:39:43.437538+0000","last_fullsized":"2024-04-19T03:39:43.437538+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2180,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426148+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:43.426148+0000","last_peered":"2024-04-19T03:39:43.426148+0000","last_clean":"2024-04-19T03:39:43.426148+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:43.426148+0000","last_undegraded":"2024-04-19T03:39:43.426148+0000","last_fullsized":"2024-04-19T03:39:43.426148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425360+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:43.425360+0000","last_peered":"2024-04-19T03:39:43.425360+0000","last_clean":"2024-04-19T03:39:43.425360+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:43.425360+0000","last_undegraded":"2024-04-19T03:39:43.425360+0000","last_fullsized":"2024-04-19T03:39:43.425360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437828+0000","last_change":"2024-04-19T03:39:43.436519+0000","last_active":"2024-04-19T03:39:43.437828+0000","last_peered":"2024-04-19T03:39:43.437828+0000","last_clean":"2024-04-19T03:39:43.437828+0000","last_became_active":"2024-04-19T03:39:43.435748+0000","last_became_peered":"2024-04-19T03:39:43.435748+0000","last_unstale":"2024-04-19T03:39:43.437828+0000","last_undegraded":"2024-04-19T03:39:43.437828+0000","last_fullsized":"2024-04-19T03:39:43.437828+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2113,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.434332+0000","last_change":"2024-04-19T03:39:43.431885+0000","last_active":"2024-04-19T03:39:43.434332+0000","last_peered":"2024-04-19T03:39:43.434332+0000","last_clean":"2024-04-19T03:39:43.434332+0000","last_became_active":"2024-04-19T03:39:43.430447+0000","last_became_peered":"2024-04-19T03:39:43.430447+0000","last_unstale":"2024-04-19T03:39:43.434332+0000","last_undegraded":"2024-04-19T03:39:43.434332+0000","last_fullsized":"2024-04-19T03:39:43.434332+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2090,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439268+0000","last_change":"2024-04-19T03:39:43.438507+0000","last_active":"2024-04-19T03:39:43.439268+0000","last_peered":"2024-04-19T03:39:43.439268+0000","last_clean":"2024-04-19T03:39:43.439268+0000","last_became_active":"2024-04-19T03:39:43.433748+0000","last_became_peered":"2024-04-19T03:39:43.433748+0000","last_unstale":"2024-04-19T03:39:43.439268+0000","last_undegraded":"2024-04-19T03:39:43.439268+0000","last_fullsized":"2024-04-19T03:39:43.439268+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2068,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423337+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:43.423337+0000","last_peered":"2024-04-19T03:39:43.423337+0000","last_clean":"2024-04-19T03:39:43.423337+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:43.423337+0000","last_undegraded":"2024-04-19T03:39:43.423337+0000","last_fullsized":"2024-04-19T03:39:43.423337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2147,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426426+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:43.426426+0000","last_peered":"2024-04-19T03:39:43.426426+0000","last_clean":"2024-04-19T03:39:43.426426+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:43.426426+0000","last_undegraded":"2024-04-19T03:39:43.426426+0000","last_fullsized":"2024-04-19T03:39:43.426426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423338+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:43.423338+0000","last_peered":"2024-04-19T03:39:43.423338+0000","last_clean":"2024-04-19T03:39:43.423338+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:43.423338+0000","last_undegraded":"2024-04-19T03:39:43.423338+0000","last_fullsized":"2024-04-19T03:39:43.423338+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437754+0000","last_change":"2024-04-19T03:39:43.435252+0000","last_active":"2024-04-19T03:39:43.437754+0000","last_peered":"2024-04-19T03:39:43.437754+0000","last_clean":"2024-04-19T03:39:43.437754+0000","last_became_active":"2024-04-19T03:39:43.431899+0000","last_became_peered":"2024-04-19T03:39:43.431899+0000","last_unstale":"2024-04-19T03:39:43.437754+0000","last_undegraded":"2024-04-19T03:39:43.437754+0000","last_fullsized":"2024-04-19T03:39:43.437754+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:07.410632+0000","last_change":"2024-04-19T03:40:07.410737+0000","last_active":"2024-04-19T03:40:07.410632+0000","last_peered":"2024-04-19T03:40:07.410632+0000","last_clean":"2024-04-19T03:40:07.410632+0000","last_became_active":"2024-04-19T03:39:43.431732+0000","last_became_peered":"2024-04-19T03:39:43.431732+0000","last_unstale":"2024-04-19T03:40:07.410632+0000","last_undegraded":"2024-04-19T03:40:07.410632+0000","last_fullsized":"2024-04-19T03:40:07.410632+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'11","last_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_deep_scrub":"70'11","last_deep_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_clean_scrub_stamp":"2024-04-19T03:40:07.410606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:58.262646+0000","scrub_duration":0.0023107370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425281+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:43.425281+0000","last_peered":"2024-04-19T03:39:43.425281+0000","last_clean":"2024-04-19T03:39:43.425281+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:43.425281+0000","last_undegraded":"2024-04-19T03:39:43.425281+0000","last_fullsized":"2024-04-19T03:39:43.425281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2156,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422653+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:43.422653+0000","last_peered":"2024-04-19T03:39:43.422653+0000","last_clean":"2024-04-19T03:39:43.422653+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:43.422653+0000","last_undegraded":"2024-04-19T03:39:43.422653+0000","last_fullsized":"2024-04-19T03:39:43.422653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4110,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425124+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:43.425124+0000","last_peered":"2024-04-19T03:39:43.425124+0000","last_clean":"2024-04-19T03:39:43.425124+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:43.425124+0000","last_undegraded":"2024-04-19T03:39:43.425124+0000","last_fullsized":"2024-04-19T03:39:43.425124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.324204+0000","last_change":"2024-04-19T03:40:04.324323+0000","last_active":"2024-04-19T03:40:04.324204+0000","last_peered":"2024-04-19T03:40:04.324204+0000","last_clean":"2024-04-19T03:40:04.324204+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:40:04.324204+0000","last_undegraded":"2024-04-19T03:40:04.324204+0000","last_fullsized":"2024-04-19T03:40:04.324204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1983","last_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_deep_scrub":"70'1983","last_deep_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.324180+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:46.731044+0000","scrub_duration":0.0027598010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423737+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:43.423737+0000","last_peered":"2024-04-19T03:39:43.423737+0000","last_clean":"2024-04-19T03:39:43.423737+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:43.423737+0000","last_undegraded":"2024-04-19T03:39:43.423737+0000","last_fullsized":"2024-04-19T03:39:43.423737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2127,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:52.486220+0000","last_change":"2024-04-19T03:39:52.486333+0000","last_active":"2024-04-19T03:39:52.486220+0000","last_peered":"2024-04-19T03:39:52.486220+0000","last_clean":"2024-04-19T03:39:52.486220+0000","last_became_active":"2024-04-19T03:39:43.437065+0000","last_became_peered":"2024-04-19T03:39:43.437065+0000","last_unstale":"2024-04-19T03:39:52.486220+0000","last_undegraded":"2024-04-19T03:39:52.486220+0000","last_fullsized":"2024-04-19T03:39:52.486220+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2028","last_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_deep_scrub":"70'2028","last_deep_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_clean_scrub_stamp":"2024-04-19T03:39:52.486195+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:49.821209+0000","scrub_duration":0.0024754260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":91,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425142+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:43.425142+0000","last_peered":"2024-04-19T03:39:43.425142+0000","last_clean":"2024-04-19T03:39:43.425142+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:43.425142+0000","last_undegraded":"2024-04-19T03:39:43.425142+0000","last_fullsized":"2024-04-19T03:39:43.425142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":117,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426387+0000","last_change":"2024-04-19T03:39:19.423799+0000","last_active":"2024-04-19T03:39:43.426387+0000","last_peered":"2024-04-19T03:39:43.426387+0000","last_clean":"2024-04-19T03:39:43.426387+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:39:43.426387+0000","last_undegraded":"2024-04-19T03:39:43.426387+0000","last_fullsized":"2024-04-19T03:39:43.426387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422603+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:43.422603+0000","last_peered":"2024-04-19T03:39:43.422603+0000","last_clean":"2024-04-19T03:39:43.422603+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:43.422603+0000","last_undegraded":"2024-04-19T03:39:43.422603+0000","last_fullsized":"2024-04-19T03:39:43.422603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368611+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:50.368611+0000","last_peered":"2024-04-19T03:39:50.368611+0000","last_clean":"2024-04-19T03:39:50.368611+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:50.368611+0000","last_undegraded":"2024-04-19T03:39:50.368611+0000","last_fullsized":"2024-04-19T03:39:50.368611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":89,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422549+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:43.422549+0000","last_peered":"2024-04-19T03:39:43.422549+0000","last_clean":"2024-04-19T03:39:43.422549+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:43.422549+0000","last_undegraded":"2024-04-19T03:39:43.422549+0000","last_fullsized":"2024-04-19T03:39:43.422549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425934+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:43.425934+0000","last_peered":"2024-04-19T03:39:43.425934+0000","last_clean":"2024-04-19T03:39:43.425934+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:43.425934+0000","last_undegraded":"2024-04-19T03:39:43.425934+0000","last_fullsized":"2024-04-19T03:39:43.425934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423555+0000","last_change":"2024-04-19T03:39:19.419792+0000","last_active":"2024-04-19T03:39:43.423555+0000","last_peered":"2024-04-19T03:39:43.423555+0000","last_clean":"2024-04-19T03:39:43.423555+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:39:43.423555+0000","last_undegraded":"2024-04-19T03:39:43.423555+0000","last_fullsized":"2024-04-19T03:39:43.423555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:59.727339+0000","last_change":"2024-04-19T03:39:59.727483+0000","last_active":"2024-04-19T03:39:59.727339+0000","last_peered":"2024-04-19T03:39:59.727339+0000","last_clean":"2024-04-19T03:39:59.727339+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:59.727339+0000","last_undegraded":"2024-04-19T03:39:59.727339+0000","last_fullsized":"2024-04-19T03:39:59.727339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_clean_scrub_stamp":"2024-04-19T03:39:59.727297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:17.092087+0000","scrub_duration":0.0035426419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.434378+0000","last_change":"2024-04-19T03:39:43.430440+0000","last_active":"2024-04-19T03:39:43.434378+0000","last_peered":"2024-04-19T03:39:43.434378+0000","last_clean":"2024-04-19T03:39:43.434378+0000","last_became_active":"2024-04-19T03:39:43.429210+0000","last_became_peered":"2024-04-19T03:39:43.429210+0000","last_unstale":"2024-04-19T03:39:43.434378+0000","last_undegraded":"2024-04-19T03:39:43.434378+0000","last_fullsized":"2024-04-19T03:39:43.434378+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6068,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422521+0000","last_change":"2024-04-19T03:39:22.423634+0000","last_active":"2024-04-19T03:39:43.422521+0000","last_peered":"2024-04-19T03:39:43.422521+0000","last_clean":"2024-04-19T03:39:43.422521+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:39:43.422521+0000","last_undegraded":"2024-04-19T03:39:43.422521+0000","last_fullsized":"2024-04-19T03:39:43.422521+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426456+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:43.426456+0000","last_peered":"2024-04-19T03:39:43.426456+0000","last_clean":"2024-04-19T03:39:43.426456+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:43.426456+0000","last_undegraded":"2024-04-19T03:39:43.426456+0000","last_fullsized":"2024-04-19T03:39:43.426456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422778+0000","last_change":"2024-04-19T03:35:59.882816+0000","last_active":"2024-04-19T03:39:43.422778+0000","last_peered":"2024-04-19T03:39:43.422778+0000","last_clean":"2024-04-19T03:39:43.422778+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:39:43.422778+0000","last_undegraded":"2024-04-19T03:39:43.422778+0000","last_fullsized":"2024-04-19T03:39:43.422778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438422+0000","last_change":"2024-04-19T03:39:43.437653+0000","last_active":"2024-04-19T03:39:43.438422+0000","last_peered":"2024-04-19T03:39:43.438422+0000","last_clean":"2024-04-19T03:39:43.438422+0000","last_became_active":"2024-04-19T03:39:43.437298+0000","last_became_peered":"2024-04-19T03:39:43.437298+0000","last_unstale":"2024-04-19T03:39:43.438422+0000","last_undegraded":"2024-04-19T03:39:43.438422+0000","last_fullsized":"2024-04-19T03:39:43.438422+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437865+0000","last_change":"2024-04-19T03:39:43.437031+0000","last_active":"2024-04-19T03:39:43.437865+0000","last_peered":"2024-04-19T03:39:43.437865+0000","last_clean":"2024-04-19T03:39:43.437865+0000","last_became_active":"2024-04-19T03:39:43.434605+0000","last_became_peered":"2024-04-19T03:39:43.434605+0000","last_unstale":"2024-04-19T03:39:43.437865+0000","last_undegraded":"2024-04-19T03:39:43.437865+0000","last_fullsized":"2024-04-19T03:39:43.437865+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436484+0000","last_change":"2024-04-19T03:39:43.433646+0000","last_active":"2024-04-19T03:39:43.436484+0000","last_peered":"2024-04-19T03:39:43.436484+0000","last_clean":"2024-04-19T03:39:43.436484+0000","last_became_active":"2024-04-19T03:39:43.431842+0000","last_became_peered":"2024-04-19T03:39:43.431842+0000","last_unstale":"2024-04-19T03:39:43.436484+0000","last_undegraded":"2024-04-19T03:39:43.436484+0000","last_fullsized":"2024-04-19T03:39:43.436484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2075,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.285554+0000","last_change":"2024-04-19T03:40:08.285715+0000","last_active":"2024-04-19T03:40:08.285554+0000","last_peered":"2024-04-19T03:40:08.285554+0000","last_clean":"2024-04-19T03:40:08.285554+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:40:08.285554+0000","last_undegraded":"2024-04-19T03:40:08.285554+0000","last_fullsized":"2024-04-19T03:40:08.285554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1975","last_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_deep_scrub":"70'1975","last_deep_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.285526+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:52.411692+0000","scrub_duration":0.0032122520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422730+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:43.422730+0000","last_peered":"2024-04-19T03:39:43.422730+0000","last_clean":"2024-04-19T03:39:43.422730+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:43.422730+0000","last_undegraded":"2024-04-19T03:39:43.422730+0000","last_fullsized":"2024-04-19T03:39:43.422730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426572+0000","last_change":"2024-04-19T03:35:59.880529+0000","last_active":"2024-04-19T03:39:43.426572+0000","last_peered":"2024-04-19T03:39:43.426572+0000","last_clean":"2024-04-19T03:39:43.426572+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:39:43.426572+0000","last_undegraded":"2024-04-19T03:39:43.426572+0000","last_fullsized":"2024-04-19T03:39:43.426572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425327+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:43.425327+0000","last_peered":"2024-04-19T03:39:43.425327+0000","last_clean":"2024-04-19T03:39:43.425327+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:43.425327+0000","last_undegraded":"2024-04-19T03:39:43.425327+0000","last_fullsized":"2024-04-19T03:39:43.425327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":111,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423716+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:43.423716+0000","last_peered":"2024-04-19T03:39:43.423716+0000","last_clean":"2024-04-19T03:39:43.423716+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:43.423716+0000","last_undegraded":"2024-04-19T03:39:43.423716+0000","last_fullsized":"2024-04-19T03:39:43.423716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439392+0000","last_change":"2024-04-19T03:39:43.439038+0000","last_active":"2024-04-19T03:39:43.439392+0000","last_peered":"2024-04-19T03:39:43.439392+0000","last_clean":"2024-04-19T03:39:43.439392+0000","last_became_active":"2024-04-19T03:39:43.436291+0000","last_became_peered":"2024-04-19T03:39:43.436291+0000","last_unstale":"2024-04-19T03:39:43.439392+0000","last_undegraded":"2024-04-19T03:39:43.439392+0000","last_fullsized":"2024-04-19T03:39:43.439392+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2207,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423652+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:43.423652+0000","last_peered":"2024-04-19T03:39:43.423652+0000","last_clean":"2024-04-19T03:39:43.423652+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:43.423652+0000","last_undegraded":"2024-04-19T03:39:43.423652+0000","last_fullsized":"2024-04-19T03:39:43.423652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.435166+0000","last_change":"2024-04-19T03:39:43.432218+0000","last_active":"2024-04-19T03:39:43.435166+0000","last_peered":"2024-04-19T03:39:43.435166+0000","last_clean":"2024-04-19T03:39:43.435166+0000","last_became_active":"2024-04-19T03:39:43.431751+0000","last_became_peered":"2024-04-19T03:39:43.431751+0000","last_unstale":"2024-04-19T03:39:43.435166+0000","last_undegraded":"2024-04-19T03:39:43.435166+0000","last_fullsized":"2024-04-19T03:39:43.435166+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:02.298462+0000","last_change":"2024-04-19T03:40:02.298573+0000","last_active":"2024-04-19T03:40:02.298462+0000","last_peered":"2024-04-19T03:40:02.298462+0000","last_clean":"2024-04-19T03:40:02.298462+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:40:02.298462+0000","last_undegraded":"2024-04-19T03:40:02.298462+0000","last_fullsized":"2024-04-19T03:40:02.298462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2054","last_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_deep_scrub":"70'2054","last_deep_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_clean_scrub_stamp":"2024-04-19T03:40:02.298435+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:12.759109+0000","scrub_duration":0.0023525339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425652+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:43.425652+0000","last_peered":"2024-04-19T03:39:43.425652+0000","last_clean":"2024-04-19T03:39:43.425652+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:43.425652+0000","last_undegraded":"2024-04-19T03:39:43.425652+0000","last_fullsized":"2024-04-19T03:39:43.425652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":91,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425455+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:43.425455+0000","last_peered":"2024-04-19T03:39:43.425455+0000","last_clean":"2024-04-19T03:39:43.425455+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:43.425455+0000","last_undegraded":"2024-04-19T03:39:43.425455+0000","last_fullsized":"2024-04-19T03:39:43.425455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438708+0000","last_change":"2024-04-19T03:39:43.438008+0000","last_active":"2024-04-19T03:39:43.438708+0000","last_peered":"2024-04-19T03:39:43.438708+0000","last_clean":"2024-04-19T03:39:43.438708+0000","last_became_active":"2024-04-19T03:39:43.436323+0000","last_became_peered":"2024-04-19T03:39:43.436323+0000","last_unstale":"2024-04-19T03:39:43.438708+0000","last_undegraded":"2024-04-19T03:39:43.438708+0000","last_fullsized":"2024-04-19T03:39:43.438708+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.490686+0000","last_change":"2024-04-19T03:39:51.490790+0000","last_active":"2024-04-19T03:39:51.490686+0000","last_peered":"2024-04-19T03:39:51.490686+0000","last_clean":"2024-04-19T03:39:51.490686+0000","last_became_active":"2024-04-19T03:39:43.434807+0000","last_became_peered":"2024-04-19T03:39:43.434807+0000","last_unstale":"2024-04-19T03:39:51.490686+0000","last_undegraded":"2024-04-19T03:39:51.490686+0000","last_fullsized":"2024-04-19T03:39:51.490686+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1981","last_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_deep_scrub":"70'1981","last_deep_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.490660+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.438851+0000","scrub_duration":0.002801207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.535662+0000","last_change":"2024-04-19T03:40:00.535767+0000","last_active":"2024-04-19T03:40:00.535662+0000","last_peered":"2024-04-19T03:40:00.535662+0000","last_clean":"2024-04-19T03:40:00.535662+0000","last_became_active":"2024-04-19T03:39:43.432885+0000","last_became_peered":"2024-04-19T03:39:43.432885+0000","last_unstale":"2024-04-19T03:40:00.535662+0000","last_undegraded":"2024-04-19T03:40:00.535662+0000","last_fullsized":"2024-04-19T03:40:00.535662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.535639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:09.252735+0000","scrub_duration":0.0018715909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.617349+0000","last_change":"2024-04-19T03:39:50.617468+0000","last_active":"2024-04-19T03:39:50.617349+0000","last_peered":"2024-04-19T03:39:50.617349+0000","last_clean":"2024-04-19T03:39:50.617349+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:50.617349+0000","last_undegraded":"2024-04-19T03:39:50.617349+0000","last_fullsized":"2024-04-19T03:39:50.617349+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_clean_scrub_stamp":"2024-04-19T03:39:50.617321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:52.005449+0000","scrub_duration":0.0027065029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422981+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:43.422981+0000","last_peered":"2024-04-19T03:39:43.422981+0000","last_clean":"2024-04-19T03:39:43.422981+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:43.422981+0000","last_undegraded":"2024-04-19T03:39:43.422981+0000","last_fullsized":"2024-04-19T03:39:43.422981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2096,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437778+0000","last_change":"2024-04-19T03:39:43.435754+0000","last_active":"2024-04-19T03:39:43.437778+0000","last_peered":"2024-04-19T03:39:43.437778+0000","last_clean":"2024-04-19T03:39:43.437778+0000","last_became_active":"2024-04-19T03:39:43.433630+0000","last_became_peered":"2024-04-19T03:39:43.433630+0000","last_unstale":"2024-04-19T03:39:43.437778+0000","last_undegraded":"2024-04-19T03:39:43.437778+0000","last_fullsized":"2024-04-19T03:39:43.437778+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437545+0000","last_change":"2024-04-19T03:39:43.434600+0000","last_active":"2024-04-19T03:39:43.437545+0000","last_peered":"2024-04-19T03:39:43.437545+0000","last_clean":"2024-04-19T03:39:43.437545+0000","last_became_active":"2024-04-19T03:39:43.430616+0000","last_became_peered":"2024-04-19T03:39:43.430616+0000","last_unstale":"2024-04-19T03:39:43.437545+0000","last_undegraded":"2024-04-19T03:39:43.437545+0000","last_fullsized":"2024-04-19T03:39:43.437545+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438567+0000","last_change":"2024-04-19T03:39:43.437657+0000","last_active":"2024-04-19T03:39:43.438567+0000","last_peered":"2024-04-19T03:39:43.438567+0000","last_clean":"2024-04-19T03:39:43.438567+0000","last_became_active":"2024-04-19T03:39:43.434699+0000","last_became_peered":"2024-04-19T03:39:43.434699+0000","last_unstale":"2024-04-19T03:39:43.438567+0000","last_undegraded":"2024-04-19T03:39:43.438567+0000","last_fullsized":"2024-04-19T03:39:43.438567+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.424935+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:43.424935+0000","last_peered":"2024-04-19T03:39:43.424935+0000","last_clean":"2024-04-19T03:39:43.424935+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:43.424935+0000","last_undegraded":"2024-04-19T03:39:43.424935+0000","last_fullsized":"2024-04-19T03:39:43.424935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.435700+0000","last_change":"2024-04-19T03:39:43.433730+0000","last_active":"2024-04-19T03:39:43.435700+0000","last_peered":"2024-04-19T03:39:43.435700+0000","last_clean":"2024-04-19T03:39:43.435700+0000","last_became_active":"2024-04-19T03:39:43.431921+0000","last_became_peered":"2024-04-19T03:39:43.431921+0000","last_unstale":"2024-04-19T03:39:43.435700+0000","last_undegraded":"2024-04-19T03:39:43.435700+0000","last_fullsized":"2024-04-19T03:39:43.435700+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":90,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.424927+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:43.424927+0000","last_peered":"2024-04-19T03:39:43.424927+0000","last_clean":"2024-04-19T03:39:43.424927+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:43.424927+0000","last_undegraded":"2024-04-19T03:39:43.424927+0000","last_fullsized":"2024-04-19T03:39:43.424927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423446+0000","last_change":"2024-04-19T03:35:59.885450+0000","last_active":"2024-04-19T03:39:43.423446+0000","last_peered":"2024-04-19T03:39:43.423446+0000","last_clean":"2024-04-19T03:39:43.423446+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:39:43.423446+0000","last_undegraded":"2024-04-19T03:39:43.423446+0000","last_fullsized":"2024-04-19T03:39:43.423446+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":92,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423431+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:43.423431+0000","last_peered":"2024-04-19T03:39:43.423431+0000","last_clean":"2024-04-19T03:39:43.423431+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:43.423431+0000","last_undegraded":"2024-04-19T03:39:43.423431+0000","last_fullsized":"2024-04-19T03:39:43.423431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":95,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809426+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:49.809426+0000","last_peered":"2024-04-19T03:39:49.809426+0000","last_clean":"2024-04-19T03:39:49.809426+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:49.809426+0000","last_undegraded":"2024-04-19T03:39:49.809426+0000","last_fullsized":"2024-04-19T03:39:49.809426+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":110,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368371+0000","last_change":"2024-04-19T03:39:19.427411+0000","last_active":"2024-04-19T03:39:50.368371+0000","last_peered":"2024-04-19T03:39:50.368371+0000","last_clean":"2024-04-19T03:39:50.368371+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:39:50.368371+0000","last_undegraded":"2024-04-19T03:39:50.368371+0000","last_fullsized":"2024-04-19T03:39:50.368371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809406+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:49.809406+0000","last_peered":"2024-04-19T03:39:49.809406+0000","last_clean":"2024-04-19T03:39:49.809406+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:49.809406+0000","last_undegraded":"2024-04-19T03:39:49.809406+0000","last_fullsized":"2024-04-19T03:39:49.809406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423604+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:43.423604+0000","last_peered":"2024-04-19T03:39:43.423604+0000","last_clean":"2024-04-19T03:39:43.423604+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:43.423604+0000","last_undegraded":"2024-04-19T03:39:43.423604+0000","last_fullsized":"2024-04-19T03:39:43.423604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425373+0000","last_change":"2024-04-19T03:39:19.425502+0000","last_active":"2024-04-19T03:39:43.425373+0000","last_peered":"2024-04-19T03:39:43.425373+0000","last_clean":"2024-04-19T03:39:43.425373+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:39:43.425373+0000","last_undegraded":"2024-04-19T03:39:43.425373+0000","last_fullsized":"2024-04-19T03:39:43.425373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368246+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:50.368246+0000","last_peered":"2024-04-19T03:39:50.368246+0000","last_clean":"2024-04-19T03:39:50.368246+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:50.368246+0000","last_undegraded":"2024-04-19T03:39:50.368246+0000","last_fullsized":"2024-04-19T03:39:50.368246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":231,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439544+0000","last_change":"2024-04-19T03:39:43.439200+0000","last_active":"2024-04-19T03:39:43.439544+0000","last_peered":"2024-04-19T03:39:43.439544+0000","last_clean":"2024-04-19T03:39:43.439544+0000","last_became_active":"2024-04-19T03:39:43.438741+0000","last_became_peered":"2024-04-19T03:39:43.438741+0000","last_unstale":"2024-04-19T03:39:43.439544+0000","last_undegraded":"2024-04-19T03:39:43.439544+0000","last_fullsized":"2024-04-19T03:39:43.439544+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":113,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422295+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:43.422295+0000","last_peered":"2024-04-19T03:39:43.422295+0000","last_clean":"2024-04-19T03:39:43.422295+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:43.422295+0000","last_undegraded":"2024-04-19T03:39:43.422295+0000","last_fullsized":"2024-04-19T03:39:43.422295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8090,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426478+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:43.426478+0000","last_peered":"2024-04-19T03:39:43.426478+0000","last_clean":"2024-04-19T03:39:43.426478+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:43.426478+0000","last_undegraded":"2024-04-19T03:39:43.426478+0000","last_fullsized":"2024-04-19T03:39:43.426478+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436342+0000","last_change":"2024-04-19T03:39:43.433683+0000","last_active":"2024-04-19T03:39:43.436342+0000","last_peered":"2024-04-19T03:39:43.436342+0000","last_clean":"2024-04-19T03:39:43.436342+0000","last_became_active":"2024-04-19T03:39:43.430609+0000","last_became_peered":"2024-04-19T03:39:43.430609+0000","last_unstale":"2024-04-19T03:39:43.436342+0000","last_undegraded":"2024-04-19T03:39:43.436342+0000","last_fullsized":"2024-04-19T03:39:43.436342+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809495+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:49.809495+0000","last_peered":"2024-04-19T03:39:49.809495+0000","last_clean":"2024-04-19T03:39:49.809495+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:49.809495+0000","last_undegraded":"2024-04-19T03:39:49.809495+0000","last_fullsized":"2024-04-19T03:39:49.809495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:54.705442+0000","last_change":"2024-04-19T03:39:54.705566+0000","last_active":"2024-04-19T03:39:54.705442+0000","last_peered":"2024-04-19T03:39:54.705442+0000","last_clean":"2024-04-19T03:39:54.705442+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:54.705442+0000","last_undegraded":"2024-04-19T03:39:54.705442+0000","last_fullsized":"2024-04-19T03:39:54.705442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_clean_scrub_stamp":"2024-04-19T03:39:54.705417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:50:16.417137+0000","scrub_duration":0.0033800929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439292+0000","last_change":"2024-04-19T03:39:43.438709+0000","last_active":"2024-04-19T03:39:43.439292+0000","last_peered":"2024-04-19T03:39:43.439292+0000","last_clean":"2024-04-19T03:39:43.439292+0000","last_became_active":"2024-04-19T03:39:43.435880+0000","last_became_peered":"2024-04-19T03:39:43.435880+0000","last_unstale":"2024-04-19T03:39:43.439292+0000","last_undegraded":"2024-04-19T03:39:43.439292+0000","last_fullsized":"2024-04-19T03:39:43.439292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":89,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422706+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:43.422706+0000","last_peered":"2024-04-19T03:39:43.422706+0000","last_clean":"2024-04-19T03:39:43.422706+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:43.422706+0000","last_undegraded":"2024-04-19T03:39:43.422706+0000","last_fullsized":"2024-04-19T03:39:43.422706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438683+0000","last_change":"2024-04-19T03:39:43.437845+0000","last_active":"2024-04-19T03:39:43.438683+0000","last_peered":"2024-04-19T03:39:43.438683+0000","last_clean":"2024-04-19T03:39:43.438683+0000","last_became_active":"2024-04-19T03:39:43.436182+0000","last_became_peered":"2024-04-19T03:39:43.436182+0000","last_unstale":"2024-04-19T03:39:43.438683+0000","last_undegraded":"2024-04-19T03:39:43.438683+0000","last_fullsized":"2024-04-19T03:39:43.438683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":95,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809405+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:49.809405+0000","last_peered":"2024-04-19T03:39:49.809405+0000","last_clean":"2024-04-19T03:39:49.809405+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:49.809405+0000","last_undegraded":"2024-04-19T03:39:49.809405+0000","last_fullsized":"2024-04-19T03:39:49.809405+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.433753+0000","last_change":"2024-04-19T03:39:43.431395+0000","last_active":"2024-04-19T03:39:43.433753+0000","last_peered":"2024-04-19T03:39:43.433753+0000","last_clean":"2024-04-19T03:39:43.433753+0000","last_became_active":"2024-04-19T03:39:43.430100+0000","last_became_peered":"2024-04-19T03:39:43.430100+0000","last_unstale":"2024-04-19T03:39:43.433753+0000","last_undegraded":"2024-04-19T03:39:43.433753+0000","last_fullsized":"2024-04-19T03:39:43.433753+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.644060+0000","last_change":"2024-04-19T03:39:51.644185+0000","last_active":"2024-04-19T03:39:51.644060+0000","last_peered":"2024-04-19T03:39:51.644060+0000","last_clean":"2024-04-19T03:39:51.644060+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:51.644060+0000","last_undegraded":"2024-04-19T03:39:51.644060+0000","last_fullsized":"2024-04-19T03:39:51.644060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.644015+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:34.517088+0000","scrub_duration":0.0031723060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426092+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:43.426092+0000","last_peered":"2024-04-19T03:39:43.426092+0000","last_clean":"2024-04-19T03:39:43.426092+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:43.426092+0000","last_undegraded":"2024-04-19T03:39:43.426092+0000","last_fullsized":"2024-04-19T03:39:43.426092+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":89,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423377+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:43.423377+0000","last_peered":"2024-04-19T03:39:43.423377+0000","last_clean":"2024-04-19T03:39:43.423377+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:43.423377+0000","last_undegraded":"2024-04-19T03:39:43.423377+0000","last_fullsized":"2024-04-19T03:39:43.423377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2067,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425646+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:43.425646+0000","last_peered":"2024-04-19T03:39:43.425646+0000","last_clean":"2024-04-19T03:39:43.425646+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:43.425646+0000","last_undegraded":"2024-04-19T03:39:43.425646+0000","last_fullsized":"2024-04-19T03:39:43.425646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:06.458430+0000","last_change":"2024-04-19T03:40:06.458556+0000","last_active":"2024-04-19T03:40:06.458430+0000","last_peered":"2024-04-19T03:40:06.458430+0000","last_clean":"2024-04-19T03:40:06.458430+0000","last_became_active":"2024-04-19T03:39:43.434441+0000","last_became_peered":"2024-04-19T03:39:43.434441+0000","last_unstale":"2024-04-19T03:40:06.458430+0000","last_undegraded":"2024-04-19T03:40:06.458430+0000","last_fullsized":"2024-04-19T03:40:06.458430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_clean_scrub_stamp":"2024-04-19T03:40:06.458408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:59.975433+0000","scrub_duration":0.0018363920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437519+0000","last_change":"2024-04-19T03:39:43.433776+0000","last_active":"2024-04-19T03:39:43.437519+0000","last_peered":"2024-04-19T03:39:43.437519+0000","last_clean":"2024-04-19T03:39:43.437519+0000","last_became_active":"2024-04-19T03:39:43.431591+0000","last_became_peered":"2024-04-19T03:39:43.431591+0000","last_unstale":"2024-04-19T03:39:43.437519+0000","last_undegraded":"2024-04-19T03:39:43.437519+0000","last_fullsized":"2024-04-19T03:39:43.437519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.325303+0000","last_change":"2024-04-19T03:40:00.325430+0000","last_active":"2024-04-19T03:40:00.325303+0000","last_peered":"2024-04-19T03:40:00.325303+0000","last_clean":"2024-04-19T03:40:00.325303+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:40:00.325303+0000","last_undegraded":"2024-04-19T03:40:00.325303+0000","last_fullsized":"2024-04-19T03:40:00.325303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.325262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:24.128839+0000","scrub_duration":0.0024403659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425387+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:43.425387+0000","last_peered":"2024-04-19T03:39:43.425387+0000","last_clean":"2024-04-19T03:39:43.425387+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:43.425387+0000","last_undegraded":"2024-04-19T03:39:43.425387+0000","last_fullsized":"2024-04-19T03:39:43.425387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426115+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:43.426115+0000","last_peered":"2024-04-19T03:39:43.426115+0000","last_clean":"2024-04-19T03:39:43.426115+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:43.426115+0000","last_undegraded":"2024-04-19T03:39:43.426115+0000","last_fullsized":"2024-04-19T03:39:43.426115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437019+0000","last_change":"2024-04-19T03:39:43.431391+0000","last_active":"2024-04-19T03:39:43.437019+0000","last_peered":"2024-04-19T03:39:43.437019+0000","last_clean":"2024-04-19T03:39:43.437019+0000","last_became_active":"2024-04-19T03:39:43.430259+0000","last_became_peered":"2024-04-19T03:39:43.430259+0000","last_unstale":"2024-04-19T03:39:43.437019+0000","last_undegraded":"2024-04-19T03:39:43.437019+0000","last_fullsized":"2024-04-19T03:39:43.437019+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2099,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:55.535916+0000","last_change":"2024-04-19T03:39:55.536049+0000","last_active":"2024-04-19T03:39:55.535916+0000","last_peered":"2024-04-19T03:39:55.535916+0000","last_clean":"2024-04-19T03:39:55.535916+0000","last_became_active":"2024-04-19T03:39:43.430703+0000","last_became_peered":"2024-04-19T03:39:43.430703+0000","last_unstale":"2024-04-19T03:39:55.535916+0000","last_undegraded":"2024-04-19T03:39:55.535916+0000","last_fullsized":"2024-04-19T03:39:55.535916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2000","last_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_deep_scrub":"70'2000","last_deep_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_clean_scrub_stamp":"2024-04-19T03:39:55.535891+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:22.625053+0000","scrub_duration":0.002398659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426496+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:43.426496+0000","last_peered":"2024-04-19T03:39:43.426496+0000","last_clean":"2024-04-19T03:39:43.426496+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:43.426496+0000","last_undegraded":"2024-04-19T03:39:43.426496+0000","last_fullsized":"2024-04-19T03:39:43.426496+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437558+0000","last_change":"2024-04-19T03:39:43.434935+0000","last_active":"2024-04-19T03:39:43.437558+0000","last_peered":"2024-04-19T03:39:43.437558+0000","last_clean":"2024-04-19T03:39:43.437558+0000","last_became_active":"2024-04-19T03:39:43.433233+0000","last_became_peered":"2024-04-19T03:39:43.433233+0000","last_unstale":"2024-04-19T03:39:43.437558+0000","last_undegraded":"2024-04-19T03:39:43.437558+0000","last_fullsized":"2024-04-19T03:39:43.437558+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":91,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368345+0000","last_change":"2024-04-19T03:35:59.433254+0000","last_active":"2024-04-19T03:39:50.368345+0000","last_peered":"2024-04-19T03:39:50.368345+0000","last_clean":"2024-04-19T03:39:50.368345+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:39:50.368345+0000","last_undegraded":"2024-04-19T03:39:50.368345+0000","last_fullsized":"2024-04-19T03:39:50.368345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425496+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:43.425496+0000","last_peered":"2024-04-19T03:39:43.425496+0000","last_clean":"2024-04-19T03:39:43.425496+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:43.425496+0000","last_undegraded":"2024-04-19T03:39:43.425496+0000","last_fullsized":"2024-04-19T03:39:43.425496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423493+0000","last_change":"2024-04-19T03:39:19.424034+0000","last_active":"2024-04-19T03:39:43.423493+0000","last_peered":"2024-04-19T03:39:43.423493+0000","last_clean":"2024-04-19T03:39:43.423493+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:39:43.423493+0000","last_undegraded":"2024-04-19T03:39:43.423493+0000","last_fullsized":"2024-04-19T03:39:43.423493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2137,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439380+0000","last_change":"2024-04-19T03:39:43.438910+0000","last_active":"2024-04-19T03:39:43.439380+0000","last_peered":"2024-04-19T03:39:43.439380+0000","last_clean":"2024-04-19T03:39:43.439380+0000","last_became_active":"2024-04-19T03:39:43.435662+0000","last_became_peered":"2024-04-19T03:39:43.435662+0000","last_unstale":"2024-04-19T03:39:43.439380+0000","last_undegraded":"2024-04-19T03:39:43.439380+0000","last_fullsized":"2024-04-19T03:39:43.439380+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438599+0000","last_change":"2024-04-19T03:39:43.436452+0000","last_active":"2024-04-19T03:39:43.438599+0000","last_peered":"2024-04-19T03:39:43.438599+0000","last_clean":"2024-04-19T03:39:43.438599+0000","last_became_active":"2024-04-19T03:39:43.433006+0000","last_became_peered":"2024-04-19T03:39:43.433006+0000","last_unstale":"2024-04-19T03:39:43.438599+0000","last_undegraded":"2024-04-19T03:39:43.438599+0000","last_fullsized":"2024-04-19T03:39:43.438599+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":100,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422482+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:43.422482+0000","last_peered":"2024-04-19T03:39:43.422482+0000","last_clean":"2024-04-19T03:39:43.422482+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:43.422482+0000","last_undegraded":"2024-04-19T03:39:43.422482+0000","last_fullsized":"2024-04-19T03:39:43.422482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2089,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425470+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:43.425470+0000","last_peered":"2024-04-19T03:39:43.425470+0000","last_clean":"2024-04-19T03:39:43.425470+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:43.425470+0000","last_undegraded":"2024-04-19T03:39:43.425470+0000","last_fullsized":"2024-04-19T03:39:43.425470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423078+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:43.423078+0000","last_peered":"2024-04-19T03:39:43.423078+0000","last_clean":"2024-04-19T03:39:43.423078+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:43.423078+0000","last_undegraded":"2024-04-19T03:39:43.423078+0000","last_fullsized":"2024-04-19T03:39:43.423078+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2166,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426223+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:43.426223+0000","last_peered":"2024-04-19T03:39:43.426223+0000","last_clean":"2024-04-19T03:39:43.426223+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:43.426223+0000","last_undegraded":"2024-04-19T03:39:43.426223+0000","last_fullsized":"2024-04-19T03:39:43.426223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481804,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1652,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1691648,"data_stored":1258390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369840,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002000,"statfs":{"total":96636764160,"available":96258048000,"internally_reserved":0,"allocated":1679360,"data_stored":1257168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.40999999999999998,"15min":0.42799999999999999},"min":{"1min":0.40400000000000003,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.65000000000000002,"5min":1.087,"15min":1.087},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.40699999999999997,"15min":0.42699999999999999},"min":{"1min":0.40699999999999997,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.61899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":790528,"data_stored":382380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48799999999999999,"15min":0.44900000000000001},"min":{"1min":0.40400000000000003,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.622,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.42399999999999999},"min":{"1min":0.36499999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:40:11.751 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.752 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.752 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.752 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.752 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.752 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.752 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.753 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.753 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.753 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.753 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.753 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.753 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.753 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.753 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.754 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.754 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.754 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.754 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.754 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.754 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.754 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.755 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.755 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.755 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.755 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.755 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.755 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.755 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.755 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.756 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.756 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.756 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.756 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.756 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.756 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.756 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.756 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.757 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.757 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.757 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.757 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.757 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.757 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.757 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.757 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.757 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.758 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.758 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.758 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.758 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.758 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.758 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.758 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.758 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.758 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.759 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.759 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.759 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.759 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.759 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.759 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T03:35:54.393544+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=54, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.759 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.759 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.759 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.760 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.760 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.760 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.760 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.760 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.760 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.760 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.760 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.760 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.761 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.761 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.761 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.761 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.761 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.761 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.761 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.762 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.762 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.762 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.762 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.762 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.762 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.762 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.762 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:11.762 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:40:31.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:40:32.163 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:40:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:40:32.177 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-04-19T03:40:30.347154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115806,"ondisk_log_size":115806,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795896,"kb_used_data":4064,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319624,"statfs":{"total":289910292480,"available":289095294976,"internally_reserved":0,"allocated":4161536,"data_stored":2897938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003222"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2069,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810082+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:49.810082+0000","last_peered":"2024-04-19T03:39:49.810082+0000","last_clean":"2024-04-19T03:39:49.810082+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:49.810082+0000","last_undegraded":"2024-04-19T03:39:49.810082+0000","last_fullsized":"2024-04-19T03:39:49.810082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":94,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810084+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:49.810084+0000","last_peered":"2024-04-19T03:39:49.810084+0000","last_clean":"2024-04-19T03:39:49.810084+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:49.810084+0000","last_undegraded":"2024-04-19T03:39:49.810084+0000","last_fullsized":"2024-04-19T03:39:49.810084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439186+0000","last_change":"2024-04-19T03:39:43.438617+0000","last_active":"2024-04-19T03:39:43.439186+0000","last_peered":"2024-04-19T03:39:43.439186+0000","last_clean":"2024-04-19T03:39:43.439186+0000","last_became_active":"2024-04-19T03:39:43.437251+0000","last_became_peered":"2024-04-19T03:39:43.437251+0000","last_unstale":"2024-04-19T03:39:43.439186+0000","last_undegraded":"2024-04-19T03:39:43.439186+0000","last_fullsized":"2024-04-19T03:39:43.439186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.425776+0000","last_change":"2024-04-19T03:40:04.425893+0000","last_active":"2024-04-19T03:40:04.425776+0000","last_peered":"2024-04-19T03:40:04.425776+0000","last_clean":"2024-04-19T03:40:04.425776+0000","last_became_active":"2024-04-19T03:39:43.434583+0000","last_became_peered":"2024-04-19T03:39:43.434583+0000","last_unstale":"2024-04-19T03:40:04.425776+0000","last_undegraded":"2024-04-19T03:40:04.425776+0000","last_fullsized":"2024-04-19T03:40:04.425776+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.425751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:07.588193+0000","scrub_duration":0.002196057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425492+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:43.425492+0000","last_peered":"2024-04-19T03:39:43.425492+0000","last_clean":"2024-04-19T03:39:43.425492+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:43.425492+0000","last_undegraded":"2024-04-19T03:39:43.425492+0000","last_fullsized":"2024-04-19T03:39:43.425492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436364+0000","last_change":"2024-04-19T03:39:43.434424+0000","last_active":"2024-04-19T03:39:43.436364+0000","last_peered":"2024-04-19T03:39:43.436364+0000","last_clean":"2024-04-19T03:39:43.436364+0000","last_became_active":"2024-04-19T03:39:43.429508+0000","last_became_peered":"2024-04-19T03:39:43.429508+0000","last_unstale":"2024-04-19T03:39:43.436364+0000","last_undegraded":"2024-04-19T03:39:43.436364+0000","last_fullsized":"2024-04-19T03:39:43.436364+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.432195+0000","last_change":"2024-04-19T03:39:43.429434+0000","last_active":"2024-04-19T03:39:43.432195+0000","last_peered":"2024-04-19T03:39:43.432195+0000","last_clean":"2024-04-19T03:39:43.432195+0000","last_became_active":"2024-04-19T03:39:43.428726+0000","last_became_peered":"2024-04-19T03:39:43.428726+0000","last_unstale":"2024-04-19T03:39:43.432195+0000","last_undegraded":"2024-04-19T03:39:43.432195+0000","last_fullsized":"2024-04-19T03:39:43.432195+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:03.416041+0000","last_change":"2024-04-19T03:40:03.416142+0000","last_active":"2024-04-19T03:40:03.416041+0000","last_peered":"2024-04-19T03:40:03.416041+0000","last_clean":"2024-04-19T03:40:03.416041+0000","last_became_active":"2024-04-19T03:39:43.433063+0000","last_became_peered":"2024-04-19T03:39:43.433063+0000","last_unstale":"2024-04-19T03:40:03.416041+0000","last_undegraded":"2024-04-19T03:40:03.416041+0000","last_fullsized":"2024-04-19T03:40:03.416041+0000","mapping_epoch":92,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8029","last_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_deep_scrub":"70'8029","last_deep_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_clean_scrub_stamp":"2024-04-19T03:40:03.416008+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:39.795688+0000","scrub_duration":0.002564808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423305+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:43.423305+0000","last_peered":"2024-04-19T03:39:43.423305+0000","last_clean":"2024-04-19T03:39:43.423305+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:43.423305+0000","last_undegraded":"2024-04-19T03:39:43.423305+0000","last_fullsized":"2024-04-19T03:39:43.423305+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426346+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:43.426346+0000","last_peered":"2024-04-19T03:39:43.426346+0000","last_clean":"2024-04-19T03:39:43.426346+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:43.426346+0000","last_undegraded":"2024-04-19T03:39:43.426346+0000","last_fullsized":"2024-04-19T03:39:43.426346+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4038,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:21.433541+0000","last_change":"2024-04-19T03:40:21.433640+0000","last_active":"2024-04-19T03:40:21.433541+0000","last_peered":"2024-04-19T03:40:21.433541+0000","last_clean":"2024-04-19T03:40:21.433541+0000","last_became_active":"2024-04-19T03:39:43.431742+0000","last_became_peered":"2024-04-19T03:39:43.431742+0000","last_unstale":"2024-04-19T03:40:21.433541+0000","last_undegraded":"2024-04-19T03:40:21.433541+0000","last_fullsized":"2024-04-19T03:40:21.433541+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3939","last_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_deep_scrub":"70'3939","last_deep_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_clean_scrub_stamp":"2024-04-19T03:40:21.433514+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:57.721359+0000","scrub_duration":0.0025512870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2180,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426148+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:43.426148+0000","last_peered":"2024-04-19T03:39:43.426148+0000","last_clean":"2024-04-19T03:39:43.426148+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:43.426148+0000","last_undegraded":"2024-04-19T03:39:43.426148+0000","last_fullsized":"2024-04-19T03:39:43.426148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425360+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:43.425360+0000","last_peered":"2024-04-19T03:39:43.425360+0000","last_clean":"2024-04-19T03:39:43.425360+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:43.425360+0000","last_undegraded":"2024-04-19T03:39:43.425360+0000","last_fullsized":"2024-04-19T03:39:43.425360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:14.424937+0000","last_change":"2024-04-19T03:40:14.425058+0000","last_active":"2024-04-19T03:40:14.424937+0000","last_peered":"2024-04-19T03:40:14.424937+0000","last_clean":"2024-04-19T03:40:14.424937+0000","last_became_active":"2024-04-19T03:39:43.435748+0000","last_became_peered":"2024-04-19T03:39:43.435748+0000","last_unstale":"2024-04-19T03:40:14.424937+0000","last_undegraded":"2024-04-19T03:40:14.424937+0000","last_fullsized":"2024-04-19T03:40:14.424937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2072","last_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_deep_scrub":"70'2072","last_deep_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_clean_scrub_stamp":"2024-04-19T03:40:14.424896+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:23.898309+0000","scrub_duration":0.0031291729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2113,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.434332+0000","last_change":"2024-04-19T03:39:43.431885+0000","last_active":"2024-04-19T03:39:43.434332+0000","last_peered":"2024-04-19T03:39:43.434332+0000","last_clean":"2024-04-19T03:39:43.434332+0000","last_became_active":"2024-04-19T03:39:43.430447+0000","last_became_peered":"2024-04-19T03:39:43.430447+0000","last_unstale":"2024-04-19T03:39:43.434332+0000","last_undegraded":"2024-04-19T03:39:43.434332+0000","last_fullsized":"2024-04-19T03:39:43.434332+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2090,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439268+0000","last_change":"2024-04-19T03:39:43.438507+0000","last_active":"2024-04-19T03:39:43.439268+0000","last_peered":"2024-04-19T03:39:43.439268+0000","last_clean":"2024-04-19T03:39:43.439268+0000","last_became_active":"2024-04-19T03:39:43.433748+0000","last_became_peered":"2024-04-19T03:39:43.433748+0000","last_unstale":"2024-04-19T03:39:43.439268+0000","last_undegraded":"2024-04-19T03:39:43.439268+0000","last_fullsized":"2024-04-19T03:39:43.439268+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2068,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423337+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:43.423337+0000","last_peered":"2024-04-19T03:39:43.423337+0000","last_clean":"2024-04-19T03:39:43.423337+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:43.423337+0000","last_undegraded":"2024-04-19T03:39:43.423337+0000","last_fullsized":"2024-04-19T03:39:43.423337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2147,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426426+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:43.426426+0000","last_peered":"2024-04-19T03:39:43.426426+0000","last_clean":"2024-04-19T03:39:43.426426+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:43.426426+0000","last_undegraded":"2024-04-19T03:39:43.426426+0000","last_fullsized":"2024-04-19T03:39:43.426426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423338+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:43.423338+0000","last_peered":"2024-04-19T03:39:43.423338+0000","last_clean":"2024-04-19T03:39:43.423338+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:43.423338+0000","last_undegraded":"2024-04-19T03:39:43.423338+0000","last_fullsized":"2024-04-19T03:39:43.423338+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437754+0000","last_change":"2024-04-19T03:39:43.435252+0000","last_active":"2024-04-19T03:39:43.437754+0000","last_peered":"2024-04-19T03:39:43.437754+0000","last_clean":"2024-04-19T03:39:43.437754+0000","last_became_active":"2024-04-19T03:39:43.431899+0000","last_became_peered":"2024-04-19T03:39:43.431899+0000","last_unstale":"2024-04-19T03:39:43.437754+0000","last_undegraded":"2024-04-19T03:39:43.437754+0000","last_fullsized":"2024-04-19T03:39:43.437754+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:07.410632+0000","last_change":"2024-04-19T03:40:07.410737+0000","last_active":"2024-04-19T03:40:07.410632+0000","last_peered":"2024-04-19T03:40:07.410632+0000","last_clean":"2024-04-19T03:40:07.410632+0000","last_became_active":"2024-04-19T03:39:43.431732+0000","last_became_peered":"2024-04-19T03:39:43.431732+0000","last_unstale":"2024-04-19T03:40:07.410632+0000","last_undegraded":"2024-04-19T03:40:07.410632+0000","last_fullsized":"2024-04-19T03:40:07.410632+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'11","last_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_deep_scrub":"70'11","last_deep_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_clean_scrub_stamp":"2024-04-19T03:40:07.410606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:58.262646+0000","scrub_duration":0.0023107370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425281+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:43.425281+0000","last_peered":"2024-04-19T03:39:43.425281+0000","last_clean":"2024-04-19T03:39:43.425281+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:43.425281+0000","last_undegraded":"2024-04-19T03:39:43.425281+0000","last_fullsized":"2024-04-19T03:39:43.425281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2156,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422653+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:43.422653+0000","last_peered":"2024-04-19T03:39:43.422653+0000","last_clean":"2024-04-19T03:39:43.422653+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:43.422653+0000","last_undegraded":"2024-04-19T03:39:43.422653+0000","last_fullsized":"2024-04-19T03:39:43.422653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4111,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809957+0000","last_change":"2024-04-19T03:35:59.881011+0000","last_active":"2024-04-19T03:39:49.809957+0000","last_peered":"2024-04-19T03:39:49.809957+0000","last_clean":"2024-04-19T03:39:49.809957+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:39:49.809957+0000","last_undegraded":"2024-04-19T03:39:49.809957+0000","last_fullsized":"2024-04-19T03:39:49.809957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.324323+0000","last_change":"2024-04-19T03:40:04.324323+0000","last_active":"2024-04-19T03:40:04.324323+0000","last_peered":"2024-04-19T03:40:04.324323+0000","last_clean":"2024-04-19T03:40:04.324323+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:40:04.324323+0000","last_undegraded":"2024-04-19T03:40:04.324323+0000","last_fullsized":"2024-04-19T03:40:04.324323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1983","last_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_deep_scrub":"70'1983","last_deep_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.324180+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:46.731044+0000","scrub_duration":0.0027598010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":117,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368642+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:50.368642+0000","last_peered":"2024-04-19T03:39:50.368642+0000","last_clean":"2024-04-19T03:39:50.368642+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:50.368642+0000","last_undegraded":"2024-04-19T03:39:50.368642+0000","last_fullsized":"2024-04-19T03:39:50.368642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2127,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:52.486220+0000","last_change":"2024-04-19T03:39:52.486333+0000","last_active":"2024-04-19T03:39:52.486220+0000","last_peered":"2024-04-19T03:39:52.486220+0000","last_clean":"2024-04-19T03:39:52.486220+0000","last_became_active":"2024-04-19T03:39:43.437065+0000","last_became_peered":"2024-04-19T03:39:43.437065+0000","last_unstale":"2024-04-19T03:39:52.486220+0000","last_undegraded":"2024-04-19T03:39:52.486220+0000","last_fullsized":"2024-04-19T03:39:52.486220+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2028","last_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_deep_scrub":"70'2028","last_deep_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_clean_scrub_stamp":"2024-04-19T03:39:52.486195+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:49.821209+0000","scrub_duration":0.0024754260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":91,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425142+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:43.425142+0000","last_peered":"2024-04-19T03:39:43.425142+0000","last_clean":"2024-04-19T03:39:43.425142+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:43.425142+0000","last_undegraded":"2024-04-19T03:39:43.425142+0000","last_fullsized":"2024-04-19T03:39:43.425142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:22.199786+0000","last_change":"2024-04-19T03:40:22.199937+0000","last_active":"2024-04-19T03:40:22.199786+0000","last_peered":"2024-04-19T03:40:22.199786+0000","last_clean":"2024-04-19T03:40:22.199786+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:40:22.199786+0000","last_undegraded":"2024-04-19T03:40:22.199786+0000","last_fullsized":"2024-04-19T03:40:22.199786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_clean_scrub_stamp":"2024-04-19T03:40:22.199728+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:08:02.693048+0000","scrub_duration":0.0026297960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422603+0000","last_change":"2024-04-19T03:39:19.424226+0000","last_active":"2024-04-19T03:39:43.422603+0000","last_peered":"2024-04-19T03:39:43.422603+0000","last_clean":"2024-04-19T03:39:43.422603+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:39:43.422603+0000","last_undegraded":"2024-04-19T03:39:43.422603+0000","last_fullsized":"2024-04-19T03:39:43.422603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368611+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:50.368611+0000","last_peered":"2024-04-19T03:39:50.368611+0000","last_clean":"2024-04-19T03:39:50.368611+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:50.368611+0000","last_undegraded":"2024-04-19T03:39:50.368611+0000","last_fullsized":"2024-04-19T03:39:50.368611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":89,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422549+0000","last_change":"2024-04-19T03:35:59.429028+0000","last_active":"2024-04-19T03:39:43.422549+0000","last_peered":"2024-04-19T03:39:43.422549+0000","last_clean":"2024-04-19T03:39:43.422549+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:39:43.422549+0000","last_undegraded":"2024-04-19T03:39:43.422549+0000","last_fullsized":"2024-04-19T03:39:43.422549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":109,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809902+0000","last_change":"2024-04-19T03:39:19.425445+0000","last_active":"2024-04-19T03:39:49.809902+0000","last_peered":"2024-04-19T03:39:49.809902+0000","last_clean":"2024-04-19T03:39:49.809902+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:39:49.809902+0000","last_undegraded":"2024-04-19T03:39:49.809902+0000","last_fullsized":"2024-04-19T03:39:49.809902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.690869+0000","last_change":"2024-04-19T03:40:27.690988+0000","last_active":"2024-04-19T03:40:27.690869+0000","last_peered":"2024-04-19T03:40:27.690869+0000","last_clean":"2024-04-19T03:40:27.690869+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:40:27.690869+0000","last_undegraded":"2024-04-19T03:40:27.690869+0000","last_fullsized":"2024-04-19T03:40:27.690869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.690844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:32.347176+0000","scrub_duration":0.001791932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:59.727339+0000","last_change":"2024-04-19T03:39:59.727483+0000","last_active":"2024-04-19T03:39:59.727339+0000","last_peered":"2024-04-19T03:39:59.727339+0000","last_clean":"2024-04-19T03:39:59.727339+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:59.727339+0000","last_undegraded":"2024-04-19T03:39:59.727339+0000","last_fullsized":"2024-04-19T03:39:59.727339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_clean_scrub_stamp":"2024-04-19T03:39:59.727297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:17.092087+0000","scrub_duration":0.0035426419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:25.393482+0000","last_change":"2024-04-19T03:40:25.393587+0000","last_active":"2024-04-19T03:40:25.393482+0000","last_peered":"2024-04-19T03:40:25.393482+0000","last_clean":"2024-04-19T03:40:25.393482+0000","last_became_active":"2024-04-19T03:39:43.429210+0000","last_became_peered":"2024-04-19T03:39:43.429210+0000","last_unstale":"2024-04-19T03:40:25.393482+0000","last_undegraded":"2024-04-19T03:40:25.393482+0000","last_fullsized":"2024-04-19T03:40:25.393482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_clean_scrub_stamp":"2024-04-19T03:40:25.393456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:41.962081+0000","scrub_duration":0.002168045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6079,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:16.669888+0000","last_change":"2024-04-19T03:40:16.670035+0000","last_active":"2024-04-19T03:40:16.669888+0000","last_peered":"2024-04-19T03:40:16.669888+0000","last_clean":"2024-04-19T03:40:16.669888+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:40:16.669888+0000","last_undegraded":"2024-04-19T03:40:16.669888+0000","last_fullsized":"2024-04-19T03:40:16.669888+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5950","last_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_deep_scrub":"70'5950","last_deep_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_clean_scrub_stamp":"2024-04-19T03:40:16.669845+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:00.796011+0000","scrub_duration":0.0029482610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426456+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:43.426456+0000","last_peered":"2024-04-19T03:39:43.426456+0000","last_clean":"2024-04-19T03:39:43.426456+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:43.426456+0000","last_undegraded":"2024-04-19T03:39:43.426456+0000","last_fullsized":"2024-04-19T03:39:43.426456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.615027+0000","last_change":"2024-04-19T03:40:20.615150+0000","last_active":"2024-04-19T03:40:20.615027+0000","last_peered":"2024-04-19T03:40:20.615027+0000","last_clean":"2024-04-19T03:40:20.615027+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:40:20.615027+0000","last_undegraded":"2024-04-19T03:40:20.615027+0000","last_fullsized":"2024-04-19T03:40:20.615027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4063","last_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_deep_scrub":"70'4063","last_deep_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.614982+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:01.364729+0000","scrub_duration":0.003172963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438422+0000","last_change":"2024-04-19T03:39:43.437653+0000","last_active":"2024-04-19T03:39:43.438422+0000","last_peered":"2024-04-19T03:39:43.438422+0000","last_clean":"2024-04-19T03:39:43.438422+0000","last_became_active":"2024-04-19T03:39:43.437298+0000","last_became_peered":"2024-04-19T03:39:43.437298+0000","last_unstale":"2024-04-19T03:39:43.438422+0000","last_undegraded":"2024-04-19T03:39:43.438422+0000","last_fullsized":"2024-04-19T03:39:43.438422+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437865+0000","last_change":"2024-04-19T03:39:43.437031+0000","last_active":"2024-04-19T03:39:43.437865+0000","last_peered":"2024-04-19T03:39:43.437865+0000","last_clean":"2024-04-19T03:39:43.437865+0000","last_became_active":"2024-04-19T03:39:43.434605+0000","last_became_peered":"2024-04-19T03:39:43.434605+0000","last_unstale":"2024-04-19T03:39:43.437865+0000","last_undegraded":"2024-04-19T03:39:43.437865+0000","last_fullsized":"2024-04-19T03:39:43.437865+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436484+0000","last_change":"2024-04-19T03:39:43.433646+0000","last_active":"2024-04-19T03:39:43.436484+0000","last_peered":"2024-04-19T03:39:43.436484+0000","last_clean":"2024-04-19T03:39:43.436484+0000","last_became_active":"2024-04-19T03:39:43.431842+0000","last_became_peered":"2024-04-19T03:39:43.431842+0000","last_unstale":"2024-04-19T03:39:43.436484+0000","last_undegraded":"2024-04-19T03:39:43.436484+0000","last_fullsized":"2024-04-19T03:39:43.436484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2075,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.285554+0000","last_change":"2024-04-19T03:40:08.285715+0000","last_active":"2024-04-19T03:40:08.285554+0000","last_peered":"2024-04-19T03:40:08.285554+0000","last_clean":"2024-04-19T03:40:08.285554+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:40:08.285554+0000","last_undegraded":"2024-04-19T03:40:08.285554+0000","last_fullsized":"2024-04-19T03:40:08.285554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1975","last_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_deep_scrub":"70'1975","last_deep_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.285526+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:52.411692+0000","scrub_duration":0.0032122520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422730+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:43.422730+0000","last_peered":"2024-04-19T03:39:43.422730+0000","last_clean":"2024-04-19T03:39:43.422730+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:43.422730+0000","last_undegraded":"2024-04-19T03:39:43.422730+0000","last_fullsized":"2024-04-19T03:39:43.422730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:11.249661+0000","last_change":"2024-04-19T03:40:11.249784+0000","last_active":"2024-04-19T03:40:11.249661+0000","last_peered":"2024-04-19T03:40:11.249661+0000","last_clean":"2024-04-19T03:40:11.249661+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:40:11.249661+0000","last_undegraded":"2024-04-19T03:40:11.249661+0000","last_fullsized":"2024-04-19T03:40:11.249661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2033","last_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_deep_scrub":"70'2033","last_deep_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_clean_scrub_stamp":"2024-04-19T03:40:11.249632+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:04.679387+0000","scrub_duration":0.0039095689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425327+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:43.425327+0000","last_peered":"2024-04-19T03:39:43.425327+0000","last_clean":"2024-04-19T03:39:43.425327+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:43.425327+0000","last_undegraded":"2024-04-19T03:39:43.425327+0000","last_fullsized":"2024-04-19T03:39:43.425327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":111,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423716+0000","last_change":"2024-04-19T03:39:19.424640+0000","last_active":"2024-04-19T03:39:43.423716+0000","last_peered":"2024-04-19T03:39:43.423716+0000","last_clean":"2024-04-19T03:39:43.423716+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:39:43.423716+0000","last_undegraded":"2024-04-19T03:39:43.423716+0000","last_fullsized":"2024-04-19T03:39:43.423716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"70'9","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439392+0000","last_change":"2024-04-19T03:39:43.439038+0000","last_active":"2024-04-19T03:39:43.439392+0000","last_peered":"2024-04-19T03:39:43.439392+0000","last_clean":"2024-04-19T03:39:43.439392+0000","last_became_active":"2024-04-19T03:39:43.436291+0000","last_became_peered":"2024-04-19T03:39:43.436291+0000","last_unstale":"2024-04-19T03:39:43.439392+0000","last_undegraded":"2024-04-19T03:39:43.439392+0000","last_fullsized":"2024-04-19T03:39:43.439392+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2207,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423652+0000","last_change":"2024-04-19T03:39:22.421803+0000","last_active":"2024-04-19T03:39:43.423652+0000","last_peered":"2024-04-19T03:39:43.423652+0000","last_clean":"2024-04-19T03:39:43.423652+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:39:43.423652+0000","last_undegraded":"2024-04-19T03:39:43.423652+0000","last_fullsized":"2024-04-19T03:39:43.423652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"93'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.429095+0000","last_change":"2024-04-19T03:40:08.429204+0000","last_active":"2024-04-19T03:40:08.429095+0000","last_peered":"2024-04-19T03:40:08.429095+0000","last_clean":"2024-04-19T03:40:08.429095+0000","last_became_active":"2024-04-19T03:39:43.431751+0000","last_became_peered":"2024-04-19T03:39:43.431751+0000","last_unstale":"2024-04-19T03:40:08.429095+0000","last_undegraded":"2024-04-19T03:40:08.429095+0000","last_fullsized":"2024-04-19T03:40:08.429095+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.429067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:52.134126+0000","scrub_duration":0.0036343399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:02.298573+0000","last_change":"2024-04-19T03:40:02.298573+0000","last_active":"2024-04-19T03:40:02.298573+0000","last_peered":"2024-04-19T03:40:02.298573+0000","last_clean":"2024-04-19T03:40:02.298573+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:40:02.298573+0000","last_undegraded":"2024-04-19T03:40:02.298573+0000","last_fullsized":"2024-04-19T03:40:02.298573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2054","last_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_deep_scrub":"70'2054","last_deep_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_clean_scrub_stamp":"2024-04-19T03:40:02.298435+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:12.759109+0000","scrub_duration":0.0023525339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425652+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:43.425652+0000","last_peered":"2024-04-19T03:39:43.425652+0000","last_clean":"2024-04-19T03:39:43.425652+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:43.425652+0000","last_undegraded":"2024-04-19T03:39:43.425652+0000","last_fullsized":"2024-04-19T03:39:43.425652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":92,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809775+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:49.809775+0000","last_peered":"2024-04-19T03:39:49.809775+0000","last_clean":"2024-04-19T03:39:49.809775+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:49.809775+0000","last_undegraded":"2024-04-19T03:39:49.809775+0000","last_fullsized":"2024-04-19T03:39:49.809775+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438708+0000","last_change":"2024-04-19T03:39:43.438008+0000","last_active":"2024-04-19T03:39:43.438708+0000","last_peered":"2024-04-19T03:39:43.438708+0000","last_clean":"2024-04-19T03:39:43.438708+0000","last_became_active":"2024-04-19T03:39:43.436323+0000","last_became_peered":"2024-04-19T03:39:43.436323+0000","last_unstale":"2024-04-19T03:39:43.438708+0000","last_undegraded":"2024-04-19T03:39:43.438708+0000","last_fullsized":"2024-04-19T03:39:43.438708+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.490686+0000","last_change":"2024-04-19T03:39:51.490790+0000","last_active":"2024-04-19T03:39:51.490686+0000","last_peered":"2024-04-19T03:39:51.490686+0000","last_clean":"2024-04-19T03:39:51.490686+0000","last_became_active":"2024-04-19T03:39:43.434807+0000","last_became_peered":"2024-04-19T03:39:43.434807+0000","last_unstale":"2024-04-19T03:39:51.490686+0000","last_undegraded":"2024-04-19T03:39:51.490686+0000","last_fullsized":"2024-04-19T03:39:51.490686+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1981","last_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_deep_scrub":"70'1981","last_deep_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.490660+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.438851+0000","scrub_duration":0.002801207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.535662+0000","last_change":"2024-04-19T03:40:00.535767+0000","last_active":"2024-04-19T03:40:00.535662+0000","last_peered":"2024-04-19T03:40:00.535662+0000","last_clean":"2024-04-19T03:40:00.535662+0000","last_became_active":"2024-04-19T03:39:43.432885+0000","last_became_peered":"2024-04-19T03:39:43.432885+0000","last_unstale":"2024-04-19T03:40:00.535662+0000","last_undegraded":"2024-04-19T03:40:00.535662+0000","last_fullsized":"2024-04-19T03:40:00.535662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.535639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:09.252735+0000","scrub_duration":0.0018715909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.617349+0000","last_change":"2024-04-19T03:39:50.617468+0000","last_active":"2024-04-19T03:39:50.617349+0000","last_peered":"2024-04-19T03:39:50.617349+0000","last_clean":"2024-04-19T03:39:50.617349+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:50.617349+0000","last_undegraded":"2024-04-19T03:39:50.617349+0000","last_fullsized":"2024-04-19T03:39:50.617349+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_clean_scrub_stamp":"2024-04-19T03:39:50.617321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:52.005449+0000","scrub_duration":0.0027065029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.422981+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:43.422981+0000","last_peered":"2024-04-19T03:39:43.422981+0000","last_clean":"2024-04-19T03:39:43.422981+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:43.422981+0000","last_undegraded":"2024-04-19T03:39:43.422981+0000","last_fullsized":"2024-04-19T03:39:43.422981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.395768+0000","last_change":"2024-04-19T03:40:23.395889+0000","last_active":"2024-04-19T03:40:23.395768+0000","last_peered":"2024-04-19T03:40:23.395768+0000","last_clean":"2024-04-19T03:40:23.395768+0000","last_became_active":"2024-04-19T03:39:43.433630+0000","last_became_peered":"2024-04-19T03:39:43.433630+0000","last_unstale":"2024-04-19T03:40:23.395768+0000","last_undegraded":"2024-04-19T03:40:23.395768+0000","last_fullsized":"2024-04-19T03:40:23.395768+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2008","last_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_deep_scrub":"70'2008","last_deep_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:23.395745+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:56:22.631622+0000","scrub_duration":0.002746283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437545+0000","last_change":"2024-04-19T03:39:43.434600+0000","last_active":"2024-04-19T03:39:43.437545+0000","last_peered":"2024-04-19T03:39:43.437545+0000","last_clean":"2024-04-19T03:39:43.437545+0000","last_became_active":"2024-04-19T03:39:43.430616+0000","last_became_peered":"2024-04-19T03:39:43.430616+0000","last_unstale":"2024-04-19T03:39:43.437545+0000","last_undegraded":"2024-04-19T03:39:43.437545+0000","last_fullsized":"2024-04-19T03:39:43.437545+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.448534+0000","last_change":"2024-04-19T03:40:12.448673+0000","last_active":"2024-04-19T03:40:12.448534+0000","last_peered":"2024-04-19T03:40:12.448534+0000","last_clean":"2024-04-19T03:40:12.448534+0000","last_became_active":"2024-04-19T03:39:43.434699+0000","last_became_peered":"2024-04-19T03:39:43.434699+0000","last_unstale":"2024-04-19T03:40:12.448534+0000","last_undegraded":"2024-04-19T03:40:12.448534+0000","last_fullsized":"2024-04-19T03:40:12.448534+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2035","last_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_deep_scrub":"70'2035","last_deep_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.448493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:23.179035+0000","scrub_duration":0.002191452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809466+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:49.809466+0000","last_peered":"2024-04-19T03:39:49.809466+0000","last_clean":"2024-04-19T03:39:49.809466+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:49.809466+0000","last_undegraded":"2024-04-19T03:39:49.809466+0000","last_fullsized":"2024-04-19T03:39:49.809466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2144,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.427101+0000","last_change":"2024-04-19T03:40:18.427193+0000","last_active":"2024-04-19T03:40:18.427101+0000","last_peered":"2024-04-19T03:40:18.427101+0000","last_clean":"2024-04-19T03:40:18.427101+0000","last_became_active":"2024-04-19T03:39:43.431921+0000","last_became_peered":"2024-04-19T03:39:43.431921+0000","last_unstale":"2024-04-19T03:40:18.427101+0000","last_undegraded":"2024-04-19T03:40:18.427101+0000","last_fullsized":"2024-04-19T03:40:18.427101+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2045","last_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_deep_scrub":"70'2045","last_deep_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.427077+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:13.005299+0000","scrub_duration":0.0023622740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809433+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:49.809433+0000","last_peered":"2024-04-19T03:39:49.809433+0000","last_clean":"2024-04-19T03:39:49.809433+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:49.809433+0000","last_undegraded":"2024-04-19T03:39:49.809433+0000","last_fullsized":"2024-04-19T03:39:49.809433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6130,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:10.753095+0000","last_change":"2024-04-19T03:40:10.753203+0000","last_active":"2024-04-19T03:40:10.753095+0000","last_peered":"2024-04-19T03:40:10.753095+0000","last_clean":"2024-04-19T03:40:10.753095+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:40:10.753095+0000","last_undegraded":"2024-04-19T03:40:10.753095+0000","last_fullsized":"2024-04-19T03:40:10.753095+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6031","last_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_deep_scrub":"70'6031","last_deep_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_clean_scrub_stamp":"2024-04-19T03:40:10.753070+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:21.213744+0000","scrub_duration":0.003270387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":93,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368262+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:50.368262+0000","last_peered":"2024-04-19T03:39:50.368262+0000","last_clean":"2024-04-19T03:39:50.368262+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:50.368262+0000","last_undegraded":"2024-04-19T03:39:50.368262+0000","last_fullsized":"2024-04-19T03:39:50.368262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":95,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809426+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:49.809426+0000","last_peered":"2024-04-19T03:39:49.809426+0000","last_clean":"2024-04-19T03:39:49.809426+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:49.809426+0000","last_undegraded":"2024-04-19T03:39:49.809426+0000","last_fullsized":"2024-04-19T03:39:49.809426+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.752557+0000","last_change":"2024-04-19T03:40:08.752671+0000","last_active":"2024-04-19T03:40:08.752557+0000","last_peered":"2024-04-19T03:40:08.752557+0000","last_clean":"2024-04-19T03:40:08.752557+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:40:08.752557+0000","last_undegraded":"2024-04-19T03:40:08.752557+0000","last_fullsized":"2024-04-19T03:40:08.752557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.752529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.556106+0000","scrub_duration":0.002237869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809406+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:49.809406+0000","last_peered":"2024-04-19T03:39:49.809406+0000","last_clean":"2024-04-19T03:39:49.809406+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:49.809406+0000","last_undegraded":"2024-04-19T03:39:49.809406+0000","last_fullsized":"2024-04-19T03:39:49.809406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368318+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:50.368318+0000","last_peered":"2024-04-19T03:39:50.368318+0000","last_clean":"2024-04-19T03:39:50.368318+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:50.368318+0000","last_undegraded":"2024-04-19T03:39:50.368318+0000","last_fullsized":"2024-04-19T03:39:50.368318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.234200+0000","last_change":"2024-04-19T03:40:12.234200+0000","last_active":"2024-04-19T03:40:12.234200+0000","last_peered":"2024-04-19T03:40:12.234200+0000","last_clean":"2024-04-19T03:40:12.234200+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:40:12.234200+0000","last_undegraded":"2024-04-19T03:40:12.234200+0000","last_fullsized":"2024-04-19T03:40:12.234200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.234048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:52.983795+0000","scrub_duration":0.0021178159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368246+0000","last_change":"2024-04-19T03:39:19.425983+0000","last_active":"2024-04-19T03:39:50.368246+0000","last_peered":"2024-04-19T03:39:50.368246+0000","last_clean":"2024-04-19T03:39:50.368246+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:39:50.368246+0000","last_undegraded":"2024-04-19T03:39:50.368246+0000","last_fullsized":"2024-04-19T03:39:50.368246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":231,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439544+0000","last_change":"2024-04-19T03:39:43.439200+0000","last_active":"2024-04-19T03:39:43.439544+0000","last_peered":"2024-04-19T03:39:43.439544+0000","last_clean":"2024-04-19T03:39:43.439544+0000","last_became_active":"2024-04-19T03:39:43.438741+0000","last_became_peered":"2024-04-19T03:39:43.438741+0000","last_unstale":"2024-04-19T03:39:43.439544+0000","last_undegraded":"2024-04-19T03:39:43.439544+0000","last_fullsized":"2024-04-19T03:39:43.439544+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"70'4","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368325+0000","last_change":"2024-04-19T03:39:19.428314+0000","last_active":"2024-04-19T03:39:50.368325+0000","last_peered":"2024-04-19T03:39:50.368325+0000","last_clean":"2024-04-19T03:39:50.368325+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:39:50.368325+0000","last_undegraded":"2024-04-19T03:39:50.368325+0000","last_fullsized":"2024-04-19T03:39:50.368325+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8091,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809689+0000","last_change":"2024-04-19T03:35:59.882289+0000","last_active":"2024-04-19T03:39:49.809689+0000","last_peered":"2024-04-19T03:39:49.809689+0000","last_clean":"2024-04-19T03:39:49.809689+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:39:49.809689+0000","last_undegraded":"2024-04-19T03:39:49.809689+0000","last_fullsized":"2024-04-19T03:39:49.809689+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436342+0000","last_change":"2024-04-19T03:39:43.433683+0000","last_active":"2024-04-19T03:39:43.436342+0000","last_peered":"2024-04-19T03:39:43.436342+0000","last_clean":"2024-04-19T03:39:43.436342+0000","last_became_active":"2024-04-19T03:39:43.430609+0000","last_became_peered":"2024-04-19T03:39:43.430609+0000","last_unstale":"2024-04-19T03:39:43.436342+0000","last_undegraded":"2024-04-19T03:39:43.436342+0000","last_fullsized":"2024-04-19T03:39:43.436342+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809495+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:49.809495+0000","last_peered":"2024-04-19T03:39:49.809495+0000","last_clean":"2024-04-19T03:39:49.809495+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:49.809495+0000","last_undegraded":"2024-04-19T03:39:49.809495+0000","last_fullsized":"2024-04-19T03:39:49.809495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:54.705566+0000","last_change":"2024-04-19T03:39:54.705566+0000","last_active":"2024-04-19T03:39:54.705566+0000","last_peered":"2024-04-19T03:39:54.705566+0000","last_clean":"2024-04-19T03:39:54.705566+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:54.705566+0000","last_undegraded":"2024-04-19T03:39:54.705566+0000","last_fullsized":"2024-04-19T03:39:54.705566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_clean_scrub_stamp":"2024-04-19T03:39:54.705417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:50:16.417137+0000","scrub_duration":0.0033800929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.451961+0000","last_change":"2024-04-19T03:40:20.452070+0000","last_active":"2024-04-19T03:40:20.451961+0000","last_peered":"2024-04-19T03:40:20.451961+0000","last_clean":"2024-04-19T03:40:20.451961+0000","last_became_active":"2024-04-19T03:39:43.435880+0000","last_became_peered":"2024-04-19T03:39:43.435880+0000","last_unstale":"2024-04-19T03:40:20.451961+0000","last_undegraded":"2024-04-19T03:40:20.451961+0000","last_fullsized":"2024-04-19T03:40:20.451961+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.451936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:29.525420+0000","scrub_duration":0.0019933870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":90,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368194+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:50.368194+0000","last_peered":"2024-04-19T03:39:50.368194+0000","last_clean":"2024-04-19T03:39:50.368194+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:50.368194+0000","last_undegraded":"2024-04-19T03:39:50.368194+0000","last_fullsized":"2024-04-19T03:39:50.368194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438683+0000","last_change":"2024-04-19T03:39:43.437845+0000","last_active":"2024-04-19T03:39:43.438683+0000","last_peered":"2024-04-19T03:39:43.438683+0000","last_clean":"2024-04-19T03:39:43.438683+0000","last_became_active":"2024-04-19T03:39:43.436182+0000","last_became_peered":"2024-04-19T03:39:43.436182+0000","last_unstale":"2024-04-19T03:39:43.438683+0000","last_undegraded":"2024-04-19T03:39:43.438683+0000","last_fullsized":"2024-04-19T03:39:43.438683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":95,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809405+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:49.809405+0000","last_peered":"2024-04-19T03:39:49.809405+0000","last_clean":"2024-04-19T03:39:49.809405+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:49.809405+0000","last_undegraded":"2024-04-19T03:39:49.809405+0000","last_fullsized":"2024-04-19T03:39:49.809405+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:17.412191+0000","last_change":"2024-04-19T03:40:17.412289+0000","last_active":"2024-04-19T03:40:17.412191+0000","last_peered":"2024-04-19T03:40:17.412191+0000","last_clean":"2024-04-19T03:40:17.412191+0000","last_became_active":"2024-04-19T03:39:43.430100+0000","last_became_peered":"2024-04-19T03:39:43.430100+0000","last_unstale":"2024-04-19T03:40:17.412191+0000","last_undegraded":"2024-04-19T03:40:17.412191+0000","last_fullsized":"2024-04-19T03:40:17.412191+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_clean_scrub_stamp":"2024-04-19T03:40:17.412165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:23.547748+0000","scrub_duration":0.001842256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":109,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.644185+0000","last_change":"2024-04-19T03:39:51.644185+0000","last_active":"2024-04-19T03:39:51.644185+0000","last_peered":"2024-04-19T03:39:51.644185+0000","last_clean":"2024-04-19T03:39:51.644185+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:51.644185+0000","last_undegraded":"2024-04-19T03:39:51.644185+0000","last_fullsized":"2024-04-19T03:39:51.644185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.644015+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:34.517088+0000","scrub_duration":0.0031723060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809427+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:49.809427+0000","last_peered":"2024-04-19T03:39:49.809427+0000","last_clean":"2024-04-19T03:39:49.809427+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:49.809427+0000","last_undegraded":"2024-04-19T03:39:49.809427+0000","last_fullsized":"2024-04-19T03:39:49.809427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":90,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368231+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:50.368231+0000","last_peered":"2024-04-19T03:39:50.368231+0000","last_clean":"2024-04-19T03:39:50.368231+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:50.368231+0000","last_undegraded":"2024-04-19T03:39:50.368231+0000","last_fullsized":"2024-04-19T03:39:50.368231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2068,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809637+0000","last_change":"2024-04-19T03:39:22.424756+0000","last_active":"2024-04-19T03:39:49.809637+0000","last_peered":"2024-04-19T03:39:49.809637+0000","last_clean":"2024-04-19T03:39:49.809637+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:39:49.809637+0000","last_undegraded":"2024-04-19T03:39:49.809637+0000","last_fullsized":"2024-04-19T03:39:49.809637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:06.458430+0000","last_change":"2024-04-19T03:40:06.458556+0000","last_active":"2024-04-19T03:40:06.458430+0000","last_peered":"2024-04-19T03:40:06.458430+0000","last_clean":"2024-04-19T03:40:06.458430+0000","last_became_active":"2024-04-19T03:39:43.434441+0000","last_became_peered":"2024-04-19T03:39:43.434441+0000","last_unstale":"2024-04-19T03:40:06.458430+0000","last_undegraded":"2024-04-19T03:40:06.458430+0000","last_fullsized":"2024-04-19T03:40:06.458430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_clean_scrub_stamp":"2024-04-19T03:40:06.458408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:59.975433+0000","scrub_duration":0.0018363920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437519+0000","last_change":"2024-04-19T03:39:43.433776+0000","last_active":"2024-04-19T03:39:43.437519+0000","last_peered":"2024-04-19T03:39:43.437519+0000","last_clean":"2024-04-19T03:39:43.437519+0000","last_became_active":"2024-04-19T03:39:43.431591+0000","last_became_peered":"2024-04-19T03:39:43.431591+0000","last_unstale":"2024-04-19T03:39:43.437519+0000","last_undegraded":"2024-04-19T03:39:43.437519+0000","last_fullsized":"2024-04-19T03:39:43.437519+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.325430+0000","last_change":"2024-04-19T03:40:00.325430+0000","last_active":"2024-04-19T03:40:00.325430+0000","last_peered":"2024-04-19T03:40:00.325430+0000","last_clean":"2024-04-19T03:40:00.325430+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:40:00.325430+0000","last_undegraded":"2024-04-19T03:40:00.325430+0000","last_fullsized":"2024-04-19T03:40:00.325430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.325262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:24.128839+0000","scrub_duration":0.0024403659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425387+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:43.425387+0000","last_peered":"2024-04-19T03:39:43.425387+0000","last_clean":"2024-04-19T03:39:43.425387+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:43.425387+0000","last_undegraded":"2024-04-19T03:39:43.425387+0000","last_fullsized":"2024-04-19T03:39:43.425387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426115+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:43.426115+0000","last_peered":"2024-04-19T03:39:43.426115+0000","last_clean":"2024-04-19T03:39:43.426115+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:43.426115+0000","last_undegraded":"2024-04-19T03:39:43.426115+0000","last_fullsized":"2024-04-19T03:39:43.426115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437019+0000","last_change":"2024-04-19T03:39:43.431391+0000","last_active":"2024-04-19T03:39:43.437019+0000","last_peered":"2024-04-19T03:39:43.437019+0000","last_clean":"2024-04-19T03:39:43.437019+0000","last_became_active":"2024-04-19T03:39:43.430259+0000","last_became_peered":"2024-04-19T03:39:43.430259+0000","last_unstale":"2024-04-19T03:39:43.437019+0000","last_undegraded":"2024-04-19T03:39:43.437019+0000","last_fullsized":"2024-04-19T03:39:43.437019+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2099,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:55.535916+0000","last_change":"2024-04-19T03:39:55.536049+0000","last_active":"2024-04-19T03:39:55.535916+0000","last_peered":"2024-04-19T03:39:55.535916+0000","last_clean":"2024-04-19T03:39:55.535916+0000","last_became_active":"2024-04-19T03:39:43.430703+0000","last_became_peered":"2024-04-19T03:39:43.430703+0000","last_unstale":"2024-04-19T03:39:55.535916+0000","last_undegraded":"2024-04-19T03:39:55.535916+0000","last_fullsized":"2024-04-19T03:39:55.535916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2000","last_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_deep_scrub":"70'2000","last_deep_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_clean_scrub_stamp":"2024-04-19T03:39:55.535891+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:22.625053+0000","scrub_duration":0.002398659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"69'3","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426496+0000","last_change":"2024-04-19T03:39:19.425704+0000","last_active":"2024-04-19T03:39:43.426496+0000","last_peered":"2024-04-19T03:39:43.426496+0000","last_clean":"2024-04-19T03:39:43.426496+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:39:43.426496+0000","last_undegraded":"2024-04-19T03:39:43.426496+0000","last_fullsized":"2024-04-19T03:39:43.426496+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:26.383401+0000","last_change":"2024-04-19T03:40:26.383543+0000","last_active":"2024-04-19T03:40:26.383401+0000","last_peered":"2024-04-19T03:40:26.383401+0000","last_clean":"2024-04-19T03:40:26.383401+0000","last_became_active":"2024-04-19T03:39:43.433233+0000","last_became_peered":"2024-04-19T03:39:43.433233+0000","last_unstale":"2024-04-19T03:40:26.383401+0000","last_undegraded":"2024-04-19T03:40:26.383401+0000","last_fullsized":"2024-04-19T03:40:26.383401+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'7","last_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_deep_scrub":"70'7","last_deep_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_clean_scrub_stamp":"2024-04-19T03:40:26.383375+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:52.425413+0000","scrub_duration":0.0024732740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.608048+0000","last_change":"2024-04-19T03:40:18.608178+0000","last_active":"2024-04-19T03:40:18.608048+0000","last_peered":"2024-04-19T03:40:18.608048+0000","last_clean":"2024-04-19T03:40:18.608048+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:40:18.608048+0000","last_undegraded":"2024-04-19T03:40:18.608048+0000","last_fullsized":"2024-04-19T03:40:18.608048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.608004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:12.037760+0000","scrub_duration":0.0019643289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425496+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:43.425496+0000","last_peered":"2024-04-19T03:39:43.425496+0000","last_clean":"2024-04-19T03:39:43.425496+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:43.425496+0000","last_undegraded":"2024-04-19T03:39:43.425496+0000","last_fullsized":"2024-04-19T03:39:43.425496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.706465+0000","last_change":"2024-04-19T03:40:12.706465+0000","last_active":"2024-04-19T03:40:12.706465+0000","last_peered":"2024-04-19T03:40:12.706465+0000","last_clean":"2024-04-19T03:40:12.706465+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:40:12.706465+0000","last_undegraded":"2024-04-19T03:40:12.706465+0000","last_fullsized":"2024-04-19T03:40:12.706465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'6","last_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_deep_scrub":"93'6","last_deep_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.706336+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:55.113200+0000","scrub_duration":0.0042115119999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2137,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439380+0000","last_change":"2024-04-19T03:39:43.438910+0000","last_active":"2024-04-19T03:39:43.439380+0000","last_peered":"2024-04-19T03:39:43.439380+0000","last_clean":"2024-04-19T03:39:43.439380+0000","last_became_active":"2024-04-19T03:39:43.435662+0000","last_became_peered":"2024-04-19T03:39:43.435662+0000","last_unstale":"2024-04-19T03:39:43.439380+0000","last_undegraded":"2024-04-19T03:39:43.439380+0000","last_fullsized":"2024-04-19T03:39:43.439380+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.337417+0000","last_change":"2024-04-19T03:40:27.337549+0000","last_active":"2024-04-19T03:40:27.337417+0000","last_peered":"2024-04-19T03:40:27.337417+0000","last_clean":"2024-04-19T03:40:27.337417+0000","last_became_active":"2024-04-19T03:39:43.433006+0000","last_became_peered":"2024-04-19T03:39:43.433006+0000","last_unstale":"2024-04-19T03:40:27.337417+0000","last_undegraded":"2024-04-19T03:40:27.337417+0000","last_fullsized":"2024-04-19T03:40:27.337417+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.337390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:10.033965+0000","scrub_duration":0.0023860370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368576+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:50.368576+0000","last_peered":"2024-04-19T03:39:50.368576+0000","last_clean":"2024-04-19T03:39:50.368576+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:50.368576+0000","last_undegraded":"2024-04-19T03:39:50.368576+0000","last_fullsized":"2024-04-19T03:39:50.368576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2090,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809882+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:49.809882+0000","last_peered":"2024-04-19T03:39:49.809882+0000","last_clean":"2024-04-19T03:39:49.809882+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:49.809882+0000","last_undegraded":"2024-04-19T03:39:49.809882+0000","last_fullsized":"2024-04-19T03:39:49.809882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368581+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:50.368581+0000","last_peered":"2024-04-19T03:39:50.368581+0000","last_clean":"2024-04-19T03:39:50.368581+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:50.368581+0000","last_undegraded":"2024-04-19T03:39:50.368581+0000","last_fullsized":"2024-04-19T03:39:50.368581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809922+0000","last_change":"2024-04-19T03:39:22.425777+0000","last_active":"2024-04-19T03:39:49.809922+0000","last_peered":"2024-04-19T03:39:49.809922+0000","last_clean":"2024-04-19T03:39:49.809922+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:39:49.809922+0000","last_undegraded":"2024-04-19T03:39:49.809922+0000","last_fullsized":"2024-04-19T03:39:49.809922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481808,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1652,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1691648,"data_stored":1258390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":1.0029999999999999}]},{"osd":1,"last update":"Fri Apr 19 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.88200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369840,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002000,"statfs":{"total":96636764160,"available":96258048000,"internally_reserved":0,"allocated":1679360,"data_stored":1257168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.40999999999999998,"15min":0.42799999999999999},"min":{"1min":0.40400000000000003,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.65000000000000002,"5min":1.087,"15min":1.087},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.40699999999999997,"15min":0.42699999999999999},"min":{"1min":0.40699999999999997,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.61899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Apr 19 03:40:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.45900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738426,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":790528,"data_stored":382380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48799999999999999,"15min":0.44900000000000001},"min":{"1min":0.40400000000000003,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.622,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.42399999999999999},"min":{"1min":0.36499999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Apr 19 03:40:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:40:32.182 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.182 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.182 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.182 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.182 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.183 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.183 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.183 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.183 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.183 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.183 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.183 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.184 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.185 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.185 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.185 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.185 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.185 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.185 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.185 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.185 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.186 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.186 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.186 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.186 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.186 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.186 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.186 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.187 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.187 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.187 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.187 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.187 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.187 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.187 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.188 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.188 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.188 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.188 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.188 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.188 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.188 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.189 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.189 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.189 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.189 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.189 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T03:35:54.393544+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=54, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.189 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.189 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.189 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.190 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.190 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.190 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.190 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.190 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.191 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.191 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.191 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.191 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.191 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.191 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.192 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.192 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.192 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.192 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.192 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.192 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.192 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:32.193 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:40:52.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:40:52.581 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:40:52.583 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:40:52.595 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-04-19T03:40:52.352776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115814,"ondisk_log_size":115814,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795896,"kb_used_data":4064,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319624,"statfs":{"total":289910292480,"available":289095294976,"internally_reserved":0,"allocated":4161536,"data_stored":2897938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002937"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2069,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810082+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:49.810082+0000","last_peered":"2024-04-19T03:39:49.810082+0000","last_clean":"2024-04-19T03:39:49.810082+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:49.810082+0000","last_undegraded":"2024-04-19T03:39:49.810082+0000","last_fullsized":"2024-04-19T03:39:49.810082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":94,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810084+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:49.810084+0000","last_peered":"2024-04-19T03:39:49.810084+0000","last_clean":"2024-04-19T03:39:49.810084+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:49.810084+0000","last_undegraded":"2024-04-19T03:39:49.810084+0000","last_fullsized":"2024-04-19T03:39:49.810084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4092,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:28.290926+0000","last_change":"2024-04-19T03:40:28.291061+0000","last_active":"2024-04-19T03:40:28.290926+0000","last_peered":"2024-04-19T03:40:28.290926+0000","last_clean":"2024-04-19T03:40:28.290926+0000","last_became_active":"2024-04-19T03:39:43.437251+0000","last_became_peered":"2024-04-19T03:39:43.437251+0000","last_unstale":"2024-04-19T03:40:28.290926+0000","last_undegraded":"2024-04-19T03:40:28.290926+0000","last_fullsized":"2024-04-19T03:40:28.290926+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3993","last_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_deep_scrub":"70'3993","last_deep_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_clean_scrub_stamp":"2024-04-19T03:40:28.290885+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:17.123063+0000","scrub_duration":0.0023123509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.425776+0000","last_change":"2024-04-19T03:40:04.425893+0000","last_active":"2024-04-19T03:40:04.425776+0000","last_peered":"2024-04-19T03:40:04.425776+0000","last_clean":"2024-04-19T03:40:04.425776+0000","last_became_active":"2024-04-19T03:39:43.434583+0000","last_became_peered":"2024-04-19T03:39:43.434583+0000","last_unstale":"2024-04-19T03:40:04.425776+0000","last_undegraded":"2024-04-19T03:40:04.425776+0000","last_fullsized":"2024-04-19T03:40:04.425776+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.425751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:07.588193+0000","scrub_duration":0.002196057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425492+0000","last_change":"2024-04-19T03:35:59.880377+0000","last_active":"2024-04-19T03:39:43.425492+0000","last_peered":"2024-04-19T03:39:43.425492+0000","last_clean":"2024-04-19T03:39:43.425492+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:39:43.425492+0000","last_undegraded":"2024-04-19T03:39:43.425492+0000","last_fullsized":"2024-04-19T03:39:43.425492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:47.306345+0000","last_change":"2024-04-19T03:40:47.306484+0000","last_active":"2024-04-19T03:40:47.306345+0000","last_peered":"2024-04-19T03:40:47.306345+0000","last_clean":"2024-04-19T03:40:47.306345+0000","last_became_active":"2024-04-19T03:39:43.429508+0000","last_became_peered":"2024-04-19T03:39:43.429508+0000","last_unstale":"2024-04-19T03:40:47.306345+0000","last_undegraded":"2024-04-19T03:40:47.306345+0000","last_fullsized":"2024-04-19T03:40:47.306345+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_clean_scrub_stamp":"2024-04-19T03:40:47.306304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:24.288058+0000","scrub_duration":0.0027027560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.363796+0000","last_change":"2024-04-19T03:40:32.363907+0000","last_active":"2024-04-19T03:40:32.363796+0000","last_peered":"2024-04-19T03:40:32.363796+0000","last_clean":"2024-04-19T03:40:32.363796+0000","last_became_active":"2024-04-19T03:39:43.428726+0000","last_became_peered":"2024-04-19T03:39:43.428726+0000","last_unstale":"2024-04-19T03:40:32.363796+0000","last_undegraded":"2024-04-19T03:40:32.363796+0000","last_fullsized":"2024-04-19T03:40:32.363796+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.363768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:55:49.483155+0000","scrub_duration":0.0027930099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:03.416041+0000","last_change":"2024-04-19T03:40:03.416142+0000","last_active":"2024-04-19T03:40:03.416041+0000","last_peered":"2024-04-19T03:40:03.416041+0000","last_clean":"2024-04-19T03:40:03.416041+0000","last_became_active":"2024-04-19T03:39:43.433063+0000","last_became_peered":"2024-04-19T03:39:43.433063+0000","last_unstale":"2024-04-19T03:40:03.416041+0000","last_undegraded":"2024-04-19T03:40:03.416041+0000","last_fullsized":"2024-04-19T03:40:03.416041+0000","mapping_epoch":92,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8029","last_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_deep_scrub":"70'8029","last_deep_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_clean_scrub_stamp":"2024-04-19T03:40:03.416008+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:39.795688+0000","scrub_duration":0.002564808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.423305+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:43.423305+0000","last_peered":"2024-04-19T03:39:43.423305+0000","last_clean":"2024-04-19T03:39:43.423305+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:43.423305+0000","last_undegraded":"2024-04-19T03:39:43.423305+0000","last_fullsized":"2024-04-19T03:39:43.423305+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6175,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426346+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:43.426346+0000","last_peered":"2024-04-19T03:39:43.426346+0000","last_clean":"2024-04-19T03:39:43.426346+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:43.426346+0000","last_undegraded":"2024-04-19T03:39:43.426346+0000","last_fullsized":"2024-04-19T03:39:43.426346+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4038,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:21.433541+0000","last_change":"2024-04-19T03:40:21.433640+0000","last_active":"2024-04-19T03:40:21.433541+0000","last_peered":"2024-04-19T03:40:21.433541+0000","last_clean":"2024-04-19T03:40:21.433541+0000","last_became_active":"2024-04-19T03:39:43.431742+0000","last_became_peered":"2024-04-19T03:39:43.431742+0000","last_unstale":"2024-04-19T03:40:21.433541+0000","last_undegraded":"2024-04-19T03:40:21.433541+0000","last_fullsized":"2024-04-19T03:40:21.433541+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3939","last_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_deep_scrub":"70'3939","last_deep_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_clean_scrub_stamp":"2024-04-19T03:40:21.433514+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:57.721359+0000","scrub_duration":0.0025512870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2180,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426148+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:43.426148+0000","last_peered":"2024-04-19T03:39:43.426148+0000","last_clean":"2024-04-19T03:39:43.426148+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:43.426148+0000","last_undegraded":"2024-04-19T03:39:43.426148+0000","last_fullsized":"2024-04-19T03:39:43.426148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425360+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:43.425360+0000","last_peered":"2024-04-19T03:39:43.425360+0000","last_clean":"2024-04-19T03:39:43.425360+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:43.425360+0000","last_undegraded":"2024-04-19T03:39:43.425360+0000","last_fullsized":"2024-04-19T03:39:43.425360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:14.424937+0000","last_change":"2024-04-19T03:40:14.425058+0000","last_active":"2024-04-19T03:40:14.424937+0000","last_peered":"2024-04-19T03:40:14.424937+0000","last_clean":"2024-04-19T03:40:14.424937+0000","last_became_active":"2024-04-19T03:39:43.435748+0000","last_became_peered":"2024-04-19T03:39:43.435748+0000","last_unstale":"2024-04-19T03:40:14.424937+0000","last_undegraded":"2024-04-19T03:40:14.424937+0000","last_fullsized":"2024-04-19T03:40:14.424937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2072","last_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_deep_scrub":"70'2072","last_deep_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_clean_scrub_stamp":"2024-04-19T03:40:14.424896+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:23.898309+0000","scrub_duration":0.0031291729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2124,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:31.388443+0000","last_change":"2024-04-19T03:40:31.388574+0000","last_active":"2024-04-19T03:40:31.388443+0000","last_peered":"2024-04-19T03:40:31.388443+0000","last_clean":"2024-04-19T03:40:31.388443+0000","last_became_active":"2024-04-19T03:39:43.430447+0000","last_became_peered":"2024-04-19T03:39:43.430447+0000","last_unstale":"2024-04-19T03:40:31.388443+0000","last_undegraded":"2024-04-19T03:40:31.388443+0000","last_fullsized":"2024-04-19T03:40:31.388443+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2025","last_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_deep_scrub":"70'2025","last_deep_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_clean_scrub_stamp":"2024-04-19T03:40:31.388419+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:12.219961+0000","scrub_duration":0.0023057400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2090,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439268+0000","last_change":"2024-04-19T03:39:43.438507+0000","last_active":"2024-04-19T03:39:43.439268+0000","last_peered":"2024-04-19T03:39:43.439268+0000","last_clean":"2024-04-19T03:39:43.439268+0000","last_became_active":"2024-04-19T03:39:43.433748+0000","last_became_peered":"2024-04-19T03:39:43.433748+0000","last_unstale":"2024-04-19T03:39:43.439268+0000","last_undegraded":"2024-04-19T03:39:43.439268+0000","last_fullsized":"2024-04-19T03:39:43.439268+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2069,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368633+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:50.368633+0000","last_peered":"2024-04-19T03:39:50.368633+0000","last_clean":"2024-04-19T03:39:50.368633+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:50.368633+0000","last_undegraded":"2024-04-19T03:39:50.368633+0000","last_fullsized":"2024-04-19T03:39:50.368633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809995+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:49.809995+0000","last_peered":"2024-04-19T03:39:49.809995+0000","last_clean":"2024-04-19T03:39:49.809995+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:49.809995+0000","last_undegraded":"2024-04-19T03:39:49.809995+0000","last_fullsized":"2024-04-19T03:39:49.809995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4141,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368638+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:50.368638+0000","last_peered":"2024-04-19T03:39:50.368638+0000","last_clean":"2024-04-19T03:39:50.368638+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:50.368638+0000","last_undegraded":"2024-04-19T03:39:50.368638+0000","last_fullsized":"2024-04-19T03:39:50.368638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4185,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.399718+0000","last_change":"2024-04-19T03:40:35.399826+0000","last_active":"2024-04-19T03:40:35.399718+0000","last_peered":"2024-04-19T03:40:35.399718+0000","last_clean":"2024-04-19T03:40:35.399718+0000","last_became_active":"2024-04-19T03:39:43.431899+0000","last_became_peered":"2024-04-19T03:39:43.431899+0000","last_unstale":"2024-04-19T03:40:35.399718+0000","last_undegraded":"2024-04-19T03:40:35.399718+0000","last_fullsized":"2024-04-19T03:40:35.399718+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4086","last_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_deep_scrub":"70'4086","last_deep_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.399694+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:10.836662+0000","scrub_duration":0.0025555930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:07.410632+0000","last_change":"2024-04-19T03:40:07.410737+0000","last_active":"2024-04-19T03:40:07.410632+0000","last_peered":"2024-04-19T03:40:07.410632+0000","last_clean":"2024-04-19T03:40:07.410632+0000","last_became_active":"2024-04-19T03:39:43.431732+0000","last_became_peered":"2024-04-19T03:39:43.431732+0000","last_unstale":"2024-04-19T03:40:07.410632+0000","last_undegraded":"2024-04-19T03:40:07.410632+0000","last_fullsized":"2024-04-19T03:40:07.410632+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'11","last_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_deep_scrub":"70'11","last_deep_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_clean_scrub_stamp":"2024-04-19T03:40:07.410606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:58.262646+0000","scrub_duration":0.0023107370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809964+0000","last_change":"2024-04-19T03:39:22.424992+0000","last_active":"2024-04-19T03:39:49.809964+0000","last_peered":"2024-04-19T03:39:49.809964+0000","last_clean":"2024-04-19T03:39:49.809964+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:39:49.809964+0000","last_undegraded":"2024-04-19T03:39:49.809964+0000","last_fullsized":"2024-04-19T03:39:49.809964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368616+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:50.368616+0000","last_peered":"2024-04-19T03:39:50.368616+0000","last_clean":"2024-04-19T03:39:50.368616+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:50.368616+0000","last_undegraded":"2024-04-19T03:39:50.368616+0000","last_fullsized":"2024-04-19T03:39:50.368616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.134428+0000","last_change":"2024-04-19T03:40:32.134573+0000","last_active":"2024-04-19T03:40:32.134428+0000","last_peered":"2024-04-19T03:40:32.134428+0000","last_clean":"2024-04-19T03:40:32.134428+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:40:32.134428+0000","last_undegraded":"2024-04-19T03:40:32.134428+0000","last_fullsized":"2024-04-19T03:40:32.134428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4021","last_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_deep_scrub":"70'4021","last_deep_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.134399+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:06.376575+0000","scrub_duration":0.0035905770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.324323+0000","last_change":"2024-04-19T03:40:04.324323+0000","last_active":"2024-04-19T03:40:04.324323+0000","last_peered":"2024-04-19T03:40:04.324323+0000","last_clean":"2024-04-19T03:40:04.324323+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:40:04.324323+0000","last_undegraded":"2024-04-19T03:40:04.324323+0000","last_fullsized":"2024-04-19T03:40:04.324323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1983","last_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_deep_scrub":"70'1983","last_deep_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.324180+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:46.731044+0000","scrub_duration":0.0027598010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":117,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368642+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:50.368642+0000","last_peered":"2024-04-19T03:39:50.368642+0000","last_clean":"2024-04-19T03:39:50.368642+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:50.368642+0000","last_undegraded":"2024-04-19T03:39:50.368642+0000","last_fullsized":"2024-04-19T03:39:50.368642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2127,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:52.486220+0000","last_change":"2024-04-19T03:39:52.486333+0000","last_active":"2024-04-19T03:39:52.486220+0000","last_peered":"2024-04-19T03:39:52.486220+0000","last_clean":"2024-04-19T03:39:52.486220+0000","last_became_active":"2024-04-19T03:39:43.437065+0000","last_became_peered":"2024-04-19T03:39:43.437065+0000","last_unstale":"2024-04-19T03:39:52.486220+0000","last_undegraded":"2024-04-19T03:39:52.486220+0000","last_fullsized":"2024-04-19T03:39:52.486220+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2028","last_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_deep_scrub":"70'2028","last_deep_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_clean_scrub_stamp":"2024-04-19T03:39:52.486195+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:49.821209+0000","scrub_duration":0.0024754260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":91,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425142+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:43.425142+0000","last_peered":"2024-04-19T03:39:43.425142+0000","last_clean":"2024-04-19T03:39:43.425142+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:43.425142+0000","last_undegraded":"2024-04-19T03:39:43.425142+0000","last_fullsized":"2024-04-19T03:39:43.425142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:22.199786+0000","last_change":"2024-04-19T03:40:22.199937+0000","last_active":"2024-04-19T03:40:22.199786+0000","last_peered":"2024-04-19T03:40:22.199786+0000","last_clean":"2024-04-19T03:40:22.199786+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:40:22.199786+0000","last_undegraded":"2024-04-19T03:40:22.199786+0000","last_fullsized":"2024-04-19T03:40:22.199786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_clean_scrub_stamp":"2024-04-19T03:40:22.199728+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:08:02.693048+0000","scrub_duration":0.0026297960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":113,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.760711+0000","last_change":"2024-04-19T03:40:32.760857+0000","last_active":"2024-04-19T03:40:32.760711+0000","last_peered":"2024-04-19T03:40:32.760711+0000","last_clean":"2024-04-19T03:40:32.760711+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:40:32.760711+0000","last_undegraded":"2024-04-19T03:40:32.760711+0000","last_fullsized":"2024-04-19T03:40:32.760711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.760689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:48.412394+0000","scrub_duration":0.001792664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368611+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:50.368611+0000","last_peered":"2024-04-19T03:39:50.368611+0000","last_clean":"2024-04-19T03:39:50.368611+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:50.368611+0000","last_undegraded":"2024-04-19T03:39:50.368611+0000","last_fullsized":"2024-04-19T03:39:50.368611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":100,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.857393+0000","last_change":"2024-04-19T03:40:39.857512+0000","last_active":"2024-04-19T03:40:39.857393+0000","last_peered":"2024-04-19T03:40:39.857393+0000","last_clean":"2024-04-19T03:40:39.857393+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:40:39.857393+0000","last_undegraded":"2024-04-19T03:40:39.857393+0000","last_fullsized":"2024-04-19T03:40:39.857393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.857367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:14.099544+0000","scrub_duration":0.0016111649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.287222+0000","last_change":"2024-04-19T03:40:39.287366+0000","last_active":"2024-04-19T03:40:39.287222+0000","last_peered":"2024-04-19T03:40:39.287222+0000","last_clean":"2024-04-19T03:40:39.287222+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:40:39.287222+0000","last_undegraded":"2024-04-19T03:40:39.287222+0000","last_fullsized":"2024-04-19T03:40:39.287222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.287191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:08.985963+0000","scrub_duration":0.0020786289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.690869+0000","last_change":"2024-04-19T03:40:27.690988+0000","last_active":"2024-04-19T03:40:27.690869+0000","last_peered":"2024-04-19T03:40:27.690869+0000","last_clean":"2024-04-19T03:40:27.690869+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:40:27.690869+0000","last_undegraded":"2024-04-19T03:40:27.690869+0000","last_fullsized":"2024-04-19T03:40:27.690869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.690844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:32.347176+0000","scrub_duration":0.001791932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:59.727483+0000","last_change":"2024-04-19T03:39:59.727483+0000","last_active":"2024-04-19T03:39:59.727483+0000","last_peered":"2024-04-19T03:39:59.727483+0000","last_clean":"2024-04-19T03:39:59.727483+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:59.727483+0000","last_undegraded":"2024-04-19T03:39:59.727483+0000","last_fullsized":"2024-04-19T03:39:59.727483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_clean_scrub_stamp":"2024-04-19T03:39:59.727297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:17.092087+0000","scrub_duration":0.0035426419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:25.393482+0000","last_change":"2024-04-19T03:40:25.393587+0000","last_active":"2024-04-19T03:40:25.393482+0000","last_peered":"2024-04-19T03:40:25.393482+0000","last_clean":"2024-04-19T03:40:25.393482+0000","last_became_active":"2024-04-19T03:39:43.429210+0000","last_became_peered":"2024-04-19T03:39:43.429210+0000","last_unstale":"2024-04-19T03:40:25.393482+0000","last_undegraded":"2024-04-19T03:40:25.393482+0000","last_fullsized":"2024-04-19T03:40:25.393482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_clean_scrub_stamp":"2024-04-19T03:40:25.393456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:41.962081+0000","scrub_duration":0.002168045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:16.670035+0000","last_change":"2024-04-19T03:40:16.670035+0000","last_active":"2024-04-19T03:40:16.670035+0000","last_peered":"2024-04-19T03:40:16.670035+0000","last_clean":"2024-04-19T03:40:16.670035+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:40:16.670035+0000","last_undegraded":"2024-04-19T03:40:16.670035+0000","last_fullsized":"2024-04-19T03:40:16.670035+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5950","last_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_deep_scrub":"70'5950","last_deep_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_clean_scrub_stamp":"2024-04-19T03:40:16.669845+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:00.796011+0000","scrub_duration":0.0029482610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426456+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:43.426456+0000","last_peered":"2024-04-19T03:39:43.426456+0000","last_clean":"2024-04-19T03:39:43.426456+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:43.426456+0000","last_undegraded":"2024-04-19T03:39:43.426456+0000","last_fullsized":"2024-04-19T03:39:43.426456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.615150+0000","last_change":"2024-04-19T03:40:20.615150+0000","last_active":"2024-04-19T03:40:20.615150+0000","last_peered":"2024-04-19T03:40:20.615150+0000","last_clean":"2024-04-19T03:40:20.615150+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:40:20.615150+0000","last_undegraded":"2024-04-19T03:40:20.615150+0000","last_fullsized":"2024-04-19T03:40:20.615150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4063","last_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_deep_scrub":"70'4063","last_deep_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.614982+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:01.364729+0000","scrub_duration":0.003172963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"70'95","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438422+0000","last_change":"2024-04-19T03:39:43.437653+0000","last_active":"2024-04-19T03:39:43.438422+0000","last_peered":"2024-04-19T03:39:43.438422+0000","last_clean":"2024-04-19T03:39:43.438422+0000","last_became_active":"2024-04-19T03:39:43.437298+0000","last_became_peered":"2024-04-19T03:39:43.437298+0000","last_unstale":"2024-04-19T03:39:43.438422+0000","last_undegraded":"2024-04-19T03:39:43.438422+0000","last_fullsized":"2024-04-19T03:39:43.438422+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4182,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:40.440866+0000","last_change":"2024-04-19T03:40:40.440980+0000","last_active":"2024-04-19T03:40:40.440866+0000","last_peered":"2024-04-19T03:40:40.440866+0000","last_clean":"2024-04-19T03:40:40.440866+0000","last_became_active":"2024-04-19T03:39:43.434605+0000","last_became_peered":"2024-04-19T03:39:43.434605+0000","last_unstale":"2024-04-19T03:40:40.440866+0000","last_undegraded":"2024-04-19T03:40:40.440866+0000","last_fullsized":"2024-04-19T03:40:40.440866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4083","last_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_deep_scrub":"70'4083","last_deep_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_clean_scrub_stamp":"2024-04-19T03:40:40.440842+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:45.344854+0000","scrub_duration":0.0025970279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"93'4","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.460389+0000","last_change":"2024-04-19T03:40:42.460494+0000","last_active":"2024-04-19T03:40:42.460389+0000","last_peered":"2024-04-19T03:40:42.460389+0000","last_clean":"2024-04-19T03:40:42.460389+0000","last_became_active":"2024-04-19T03:39:43.431842+0000","last_became_peered":"2024-04-19T03:39:43.431842+0000","last_unstale":"2024-04-19T03:40:42.460389+0000","last_undegraded":"2024-04-19T03:40:42.460389+0000","last_fullsized":"2024-04-19T03:40:42.460389+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.460363+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:49.733129+0000","scrub_duration":0.003431403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2076,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.285715+0000","last_change":"2024-04-19T03:40:08.285715+0000","last_active":"2024-04-19T03:40:08.285715+0000","last_peered":"2024-04-19T03:40:08.285715+0000","last_clean":"2024-04-19T03:40:08.285715+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:40:08.285715+0000","last_undegraded":"2024-04-19T03:40:08.285715+0000","last_fullsized":"2024-04-19T03:40:08.285715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1975","last_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_deep_scrub":"70'1975","last_deep_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.285526+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:52.411692+0000","scrub_duration":0.0032122520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368244+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:50.368244+0000","last_peered":"2024-04-19T03:39:50.368244+0000","last_clean":"2024-04-19T03:39:50.368244+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:50.368244+0000","last_undegraded":"2024-04-19T03:39:50.368244+0000","last_fullsized":"2024-04-19T03:39:50.368244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2133,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:11.249661+0000","last_change":"2024-04-19T03:40:11.249784+0000","last_active":"2024-04-19T03:40:11.249661+0000","last_peered":"2024-04-19T03:40:11.249661+0000","last_clean":"2024-04-19T03:40:11.249661+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:40:11.249661+0000","last_undegraded":"2024-04-19T03:40:11.249661+0000","last_fullsized":"2024-04-19T03:40:11.249661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2033","last_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_deep_scrub":"70'2033","last_deep_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_clean_scrub_stamp":"2024-04-19T03:40:11.249632+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:04.679387+0000","scrub_duration":0.0039095689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809600+0000","last_change":"2024-04-19T03:39:19.423727+0000","last_active":"2024-04-19T03:39:49.809600+0000","last_peered":"2024-04-19T03:39:49.809600+0000","last_clean":"2024-04-19T03:39:49.809600+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:39:49.809600+0000","last_undegraded":"2024-04-19T03:39:49.809600+0000","last_fullsized":"2024-04-19T03:39:49.809600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:30.761127+0000","last_change":"2024-04-19T03:40:30.761230+0000","last_active":"2024-04-19T03:40:30.761127+0000","last_peered":"2024-04-19T03:40:30.761127+0000","last_clean":"2024-04-19T03:40:30.761127+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:40:30.761127+0000","last_undegraded":"2024-04-19T03:40:30.761127+0000","last_fullsized":"2024-04-19T03:40:30.761127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'10","last_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_deep_scrub":"70'10","last_deep_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_clean_scrub_stamp":"2024-04-19T03:40:30.761100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:51.151497+0000","scrub_duration":0.0024608220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"93'13","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.342259+0000","last_change":"2024-04-19T03:40:33.342391+0000","last_active":"2024-04-19T03:40:33.342259+0000","last_peered":"2024-04-19T03:40:33.342259+0000","last_clean":"2024-04-19T03:40:33.342259+0000","last_became_active":"2024-04-19T03:39:43.436291+0000","last_became_peered":"2024-04-19T03:39:43.436291+0000","last_unstale":"2024-04-19T03:40:33.342259+0000","last_undegraded":"2024-04-19T03:40:33.342259+0000","last_fullsized":"2024-04-19T03:40:33.342259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'13","last_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_deep_scrub":"93'13","last_deep_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.342214+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:39:21.052990+0000","scrub_duration":0.0050089979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2218,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.743634+0000","last_change":"2024-04-19T03:40:33.743742+0000","last_active":"2024-04-19T03:40:33.743634+0000","last_peered":"2024-04-19T03:40:33.743634+0000","last_clean":"2024-04-19T03:40:33.743634+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:40:33.743634+0000","last_undegraded":"2024-04-19T03:40:33.743634+0000","last_fullsized":"2024-04-19T03:40:33.743634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2095","last_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_deep_scrub":"70'2095","last_deep_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.743609+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:30.726079+0000","scrub_duration":0.0029003269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"93'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.429095+0000","last_change":"2024-04-19T03:40:08.429204+0000","last_active":"2024-04-19T03:40:08.429095+0000","last_peered":"2024-04-19T03:40:08.429095+0000","last_clean":"2024-04-19T03:40:08.429095+0000","last_became_active":"2024-04-19T03:39:43.431751+0000","last_became_peered":"2024-04-19T03:39:43.431751+0000","last_unstale":"2024-04-19T03:40:08.429095+0000","last_undegraded":"2024-04-19T03:40:08.429095+0000","last_fullsized":"2024-04-19T03:40:08.429095+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.429067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:52.134126+0000","scrub_duration":0.0036343399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:02.298573+0000","last_change":"2024-04-19T03:40:02.298573+0000","last_active":"2024-04-19T03:40:02.298573+0000","last_peered":"2024-04-19T03:40:02.298573+0000","last_clean":"2024-04-19T03:40:02.298573+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:40:02.298573+0000","last_undegraded":"2024-04-19T03:40:02.298573+0000","last_fullsized":"2024-04-19T03:40:02.298573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2054","last_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_deep_scrub":"70'2054","last_deep_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_clean_scrub_stamp":"2024-04-19T03:40:02.298435+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:12.759109+0000","scrub_duration":0.0023525339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809468+0000","last_change":"2024-04-19T03:39:19.425887+0000","last_active":"2024-04-19T03:39:49.809468+0000","last_peered":"2024-04-19T03:39:49.809468+0000","last_clean":"2024-04-19T03:39:49.809468+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:39:49.809468+0000","last_undegraded":"2024-04-19T03:39:49.809468+0000","last_fullsized":"2024-04-19T03:39:49.809468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":92,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809775+0000","last_change":"2024-04-19T03:35:59.879615+0000","last_active":"2024-04-19T03:39:49.809775+0000","last_peered":"2024-04-19T03:39:49.809775+0000","last_clean":"2024-04-19T03:39:49.809775+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:39:49.809775+0000","last_undegraded":"2024-04-19T03:39:49.809775+0000","last_fullsized":"2024-04-19T03:39:49.809775+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438708+0000","last_change":"2024-04-19T03:39:43.438008+0000","last_active":"2024-04-19T03:39:43.438708+0000","last_peered":"2024-04-19T03:39:43.438708+0000","last_clean":"2024-04-19T03:39:43.438708+0000","last_became_active":"2024-04-19T03:39:43.436323+0000","last_became_peered":"2024-04-19T03:39:43.436323+0000","last_unstale":"2024-04-19T03:39:43.438708+0000","last_undegraded":"2024-04-19T03:39:43.438708+0000","last_fullsized":"2024-04-19T03:39:43.438708+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.490686+0000","last_change":"2024-04-19T03:39:51.490790+0000","last_active":"2024-04-19T03:39:51.490686+0000","last_peered":"2024-04-19T03:39:51.490686+0000","last_clean":"2024-04-19T03:39:51.490686+0000","last_became_active":"2024-04-19T03:39:43.434807+0000","last_became_peered":"2024-04-19T03:39:43.434807+0000","last_unstale":"2024-04-19T03:39:51.490686+0000","last_undegraded":"2024-04-19T03:39:51.490686+0000","last_fullsized":"2024-04-19T03:39:51.490686+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1981","last_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_deep_scrub":"70'1981","last_deep_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.490660+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.438851+0000","scrub_duration":0.002801207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.535662+0000","last_change":"2024-04-19T03:40:00.535767+0000","last_active":"2024-04-19T03:40:00.535662+0000","last_peered":"2024-04-19T03:40:00.535662+0000","last_clean":"2024-04-19T03:40:00.535662+0000","last_became_active":"2024-04-19T03:39:43.432885+0000","last_became_peered":"2024-04-19T03:39:43.432885+0000","last_unstale":"2024-04-19T03:40:00.535662+0000","last_undegraded":"2024-04-19T03:40:00.535662+0000","last_fullsized":"2024-04-19T03:40:00.535662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.535639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:09.252735+0000","scrub_duration":0.0018715909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.617468+0000","last_change":"2024-04-19T03:39:50.617468+0000","last_active":"2024-04-19T03:39:50.617468+0000","last_peered":"2024-04-19T03:39:50.617468+0000","last_clean":"2024-04-19T03:39:50.617468+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:50.617468+0000","last_undegraded":"2024-04-19T03:39:50.617468+0000","last_fullsized":"2024-04-19T03:39:50.617468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_clean_scrub_stamp":"2024-04-19T03:39:50.617321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:52.005449+0000","scrub_duration":0.0027065029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368233+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:50.368233+0000","last_peered":"2024-04-19T03:39:50.368233+0000","last_clean":"2024-04-19T03:39:50.368233+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:50.368233+0000","last_undegraded":"2024-04-19T03:39:50.368233+0000","last_fullsized":"2024-04-19T03:39:50.368233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.395768+0000","last_change":"2024-04-19T03:40:23.395889+0000","last_active":"2024-04-19T03:40:23.395768+0000","last_peered":"2024-04-19T03:40:23.395768+0000","last_clean":"2024-04-19T03:40:23.395768+0000","last_became_active":"2024-04-19T03:39:43.433630+0000","last_became_peered":"2024-04-19T03:39:43.433630+0000","last_unstale":"2024-04-19T03:40:23.395768+0000","last_undegraded":"2024-04-19T03:40:23.395768+0000","last_fullsized":"2024-04-19T03:40:23.395768+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2008","last_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_deep_scrub":"70'2008","last_deep_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:23.395745+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:56:22.631622+0000","scrub_duration":0.002746283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437545+0000","last_change":"2024-04-19T03:39:43.434600+0000","last_active":"2024-04-19T03:39:43.437545+0000","last_peered":"2024-04-19T03:39:43.437545+0000","last_clean":"2024-04-19T03:39:43.437545+0000","last_became_active":"2024-04-19T03:39:43.430616+0000","last_became_peered":"2024-04-19T03:39:43.430616+0000","last_unstale":"2024-04-19T03:39:43.437545+0000","last_undegraded":"2024-04-19T03:39:43.437545+0000","last_fullsized":"2024-04-19T03:39:43.437545+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.448534+0000","last_change":"2024-04-19T03:40:12.448673+0000","last_active":"2024-04-19T03:40:12.448534+0000","last_peered":"2024-04-19T03:40:12.448534+0000","last_clean":"2024-04-19T03:40:12.448534+0000","last_became_active":"2024-04-19T03:39:43.434699+0000","last_became_peered":"2024-04-19T03:39:43.434699+0000","last_unstale":"2024-04-19T03:40:12.448534+0000","last_undegraded":"2024-04-19T03:40:12.448534+0000","last_fullsized":"2024-04-19T03:40:12.448534+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2035","last_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_deep_scrub":"70'2035","last_deep_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.448493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:23.179035+0000","scrub_duration":0.002191452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809466+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:49.809466+0000","last_peered":"2024-04-19T03:39:49.809466+0000","last_clean":"2024-04-19T03:39:49.809466+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:49.809466+0000","last_undegraded":"2024-04-19T03:39:49.809466+0000","last_fullsized":"2024-04-19T03:39:49.809466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2144,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.427101+0000","last_change":"2024-04-19T03:40:18.427193+0000","last_active":"2024-04-19T03:40:18.427101+0000","last_peered":"2024-04-19T03:40:18.427101+0000","last_clean":"2024-04-19T03:40:18.427101+0000","last_became_active":"2024-04-19T03:39:43.431921+0000","last_became_peered":"2024-04-19T03:39:43.431921+0000","last_unstale":"2024-04-19T03:40:18.427101+0000","last_undegraded":"2024-04-19T03:40:18.427101+0000","last_fullsized":"2024-04-19T03:40:18.427101+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2045","last_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_deep_scrub":"70'2045","last_deep_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.427077+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:13.005299+0000","scrub_duration":0.0023622740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809433+0000","last_change":"2024-04-19T03:35:59.431356+0000","last_active":"2024-04-19T03:39:49.809433+0000","last_peered":"2024-04-19T03:39:49.809433+0000","last_clean":"2024-04-19T03:39:49.809433+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:39:49.809433+0000","last_undegraded":"2024-04-19T03:39:49.809433+0000","last_fullsized":"2024-04-19T03:39:49.809433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6131,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:10.753203+0000","last_change":"2024-04-19T03:40:10.753203+0000","last_active":"2024-04-19T03:40:10.753203+0000","last_peered":"2024-04-19T03:40:10.753203+0000","last_clean":"2024-04-19T03:40:10.753203+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:40:10.753203+0000","last_undegraded":"2024-04-19T03:40:10.753203+0000","last_fullsized":"2024-04-19T03:40:10.753203+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6031","last_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_deep_scrub":"70'6031","last_deep_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_clean_scrub_stamp":"2024-04-19T03:40:10.753070+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:21.213744+0000","scrub_duration":0.003270387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'3","reported_seq":93,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368262+0000","last_change":"2024-04-19T03:35:59.432930+0000","last_active":"2024-04-19T03:39:50.368262+0000","last_peered":"2024-04-19T03:39:50.368262+0000","last_clean":"2024-04-19T03:39:50.368262+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:39:50.368262+0000","last_undegraded":"2024-04-19T03:39:50.368262+0000","last_fullsized":"2024-04-19T03:39:50.368262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":95,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809426+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:49.809426+0000","last_peered":"2024-04-19T03:39:49.809426+0000","last_clean":"2024-04-19T03:39:49.809426+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:49.809426+0000","last_undegraded":"2024-04-19T03:39:49.809426+0000","last_fullsized":"2024-04-19T03:39:49.809426+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.752557+0000","last_change":"2024-04-19T03:40:08.752671+0000","last_active":"2024-04-19T03:40:08.752557+0000","last_peered":"2024-04-19T03:40:08.752557+0000","last_clean":"2024-04-19T03:40:08.752557+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:40:08.752557+0000","last_undegraded":"2024-04-19T03:40:08.752557+0000","last_fullsized":"2024-04-19T03:40:08.752557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.752529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.556106+0000","scrub_duration":0.002237869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809406+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:49.809406+0000","last_peered":"2024-04-19T03:39:49.809406+0000","last_clean":"2024-04-19T03:39:49.809406+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:49.809406+0000","last_undegraded":"2024-04-19T03:39:49.809406+0000","last_fullsized":"2024-04-19T03:39:49.809406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"70'8","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368318+0000","last_change":"2024-04-19T03:39:19.432343+0000","last_active":"2024-04-19T03:39:50.368318+0000","last_peered":"2024-04-19T03:39:50.368318+0000","last_clean":"2024-04-19T03:39:50.368318+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:39:50.368318+0000","last_undegraded":"2024-04-19T03:39:50.368318+0000","last_fullsized":"2024-04-19T03:39:50.368318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.234200+0000","last_change":"2024-04-19T03:40:12.234200+0000","last_active":"2024-04-19T03:40:12.234200+0000","last_peered":"2024-04-19T03:40:12.234200+0000","last_clean":"2024-04-19T03:40:12.234200+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:40:12.234200+0000","last_undegraded":"2024-04-19T03:40:12.234200+0000","last_fullsized":"2024-04-19T03:40:12.234200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.234048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:52.983795+0000","scrub_duration":0.0021178159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.913833+0000","last_change":"2024-04-19T03:40:42.913932+0000","last_active":"2024-04-19T03:40:42.913833+0000","last_peered":"2024-04-19T03:40:42.913833+0000","last_clean":"2024-04-19T03:40:42.913833+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:40:42.913833+0000","last_undegraded":"2024-04-19T03:40:42.913833+0000","last_fullsized":"2024-04-19T03:40:42.913833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.913809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:11.158157+0000","scrub_duration":0.001532853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"11'157","reported_seq":231,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439544+0000","last_change":"2024-04-19T03:39:43.439200+0000","last_active":"2024-04-19T03:39:43.439544+0000","last_peered":"2024-04-19T03:39:43.439544+0000","last_clean":"2024-04-19T03:39:43.439544+0000","last_became_active":"2024-04-19T03:39:43.438741+0000","last_became_peered":"2024-04-19T03:39:43.438741+0000","last_unstale":"2024-04-19T03:39:43.439544+0000","last_undegraded":"2024-04-19T03:39:43.439544+0000","last_fullsized":"2024-04-19T03:39:43.439544+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:54.393544+0000","last_clean_scrub_stamp":"2024-04-19T03:35:54.393544+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":126,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.897457+0000","last_change":"2024-04-19T03:40:46.897576+0000","last_active":"2024-04-19T03:40:46.897457+0000","last_peered":"2024-04-19T03:40:46.897457+0000","last_clean":"2024-04-19T03:40:46.897457+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:40:46.897457+0000","last_undegraded":"2024-04-19T03:40:46.897457+0000","last_fullsized":"2024-04-19T03:40:46.897457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'5","last_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_deep_scrub":"93'5","last_deep_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.897430+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:16.596202+0000","scrub_duration":0.0029799929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.247773+0000","last_change":"2024-04-19T03:40:42.247912+0000","last_active":"2024-04-19T03:40:42.247773+0000","last_peered":"2024-04-19T03:40:42.247773+0000","last_clean":"2024-04-19T03:40:42.247773+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:40:42.247773+0000","last_undegraded":"2024-04-19T03:40:42.247773+0000","last_fullsized":"2024-04-19T03:40:42.247773+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8001","last_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_deep_scrub":"70'8001","last_deep_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.247746+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:19.073073+0000","scrub_duration":0.0039554270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.436342+0000","last_change":"2024-04-19T03:39:43.433683+0000","last_active":"2024-04-19T03:39:43.436342+0000","last_peered":"2024-04-19T03:39:43.436342+0000","last_clean":"2024-04-19T03:39:43.436342+0000","last_became_active":"2024-04-19T03:39:43.430609+0000","last_became_peered":"2024-04-19T03:39:43.430609+0000","last_unstale":"2024-04-19T03:39:43.436342+0000","last_undegraded":"2024-04-19T03:39:43.436342+0000","last_fullsized":"2024-04-19T03:39:43.436342+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809495+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:49.809495+0000","last_peered":"2024-04-19T03:39:49.809495+0000","last_clean":"2024-04-19T03:39:49.809495+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:49.809495+0000","last_undegraded":"2024-04-19T03:39:49.809495+0000","last_fullsized":"2024-04-19T03:39:49.809495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:54.705566+0000","last_change":"2024-04-19T03:39:54.705566+0000","last_active":"2024-04-19T03:39:54.705566+0000","last_peered":"2024-04-19T03:39:54.705566+0000","last_clean":"2024-04-19T03:39:54.705566+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:54.705566+0000","last_undegraded":"2024-04-19T03:39:54.705566+0000","last_fullsized":"2024-04-19T03:39:54.705566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_clean_scrub_stamp":"2024-04-19T03:39:54.705417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:50:16.417137+0000","scrub_duration":0.0033800929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.451961+0000","last_change":"2024-04-19T03:40:20.452070+0000","last_active":"2024-04-19T03:40:20.451961+0000","last_peered":"2024-04-19T03:40:20.451961+0000","last_clean":"2024-04-19T03:40:20.451961+0000","last_became_active":"2024-04-19T03:39:43.435880+0000","last_became_peered":"2024-04-19T03:39:43.435880+0000","last_unstale":"2024-04-19T03:40:20.451961+0000","last_undegraded":"2024-04-19T03:40:20.451961+0000","last_fullsized":"2024-04-19T03:40:20.451961+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.451936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:29.525420+0000","scrub_duration":0.0019933870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":90,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368194+0000","last_change":"2024-04-19T03:35:59.430666+0000","last_active":"2024-04-19T03:39:50.368194+0000","last_peered":"2024-04-19T03:39:50.368194+0000","last_clean":"2024-04-19T03:39:50.368194+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:39:50.368194+0000","last_undegraded":"2024-04-19T03:39:50.368194+0000","last_fullsized":"2024-04-19T03:39:50.368194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.438683+0000","last_change":"2024-04-19T03:39:43.437845+0000","last_active":"2024-04-19T03:39:43.438683+0000","last_peered":"2024-04-19T03:39:43.438683+0000","last_clean":"2024-04-19T03:39:43.438683+0000","last_became_active":"2024-04-19T03:39:43.436182+0000","last_became_peered":"2024-04-19T03:39:43.436182+0000","last_unstale":"2024-04-19T03:39:43.438683+0000","last_undegraded":"2024-04-19T03:39:43.438683+0000","last_fullsized":"2024-04-19T03:39:43.438683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":95,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809405+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:49.809405+0000","last_peered":"2024-04-19T03:39:49.809405+0000","last_clean":"2024-04-19T03:39:49.809405+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:49.809405+0000","last_undegraded":"2024-04-19T03:39:49.809405+0000","last_fullsized":"2024-04-19T03:39:49.809405+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:17.412191+0000","last_change":"2024-04-19T03:40:17.412289+0000","last_active":"2024-04-19T03:40:17.412191+0000","last_peered":"2024-04-19T03:40:17.412191+0000","last_clean":"2024-04-19T03:40:17.412191+0000","last_became_active":"2024-04-19T03:39:43.430100+0000","last_became_peered":"2024-04-19T03:39:43.430100+0000","last_unstale":"2024-04-19T03:40:17.412191+0000","last_undegraded":"2024-04-19T03:40:17.412191+0000","last_fullsized":"2024-04-19T03:40:17.412191+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_clean_scrub_stamp":"2024-04-19T03:40:17.412165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:23.547748+0000","scrub_duration":0.001842256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":109,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.644185+0000","last_change":"2024-04-19T03:39:51.644185+0000","last_active":"2024-04-19T03:39:51.644185+0000","last_peered":"2024-04-19T03:39:51.644185+0000","last_clean":"2024-04-19T03:39:51.644185+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:51.644185+0000","last_undegraded":"2024-04-19T03:39:51.644185+0000","last_fullsized":"2024-04-19T03:39:51.644185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.644015+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:34.517088+0000","scrub_duration":0.0031723060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809427+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:49.809427+0000","last_peered":"2024-04-19T03:39:49.809427+0000","last_clean":"2024-04-19T03:39:49.809427+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:49.809427+0000","last_undegraded":"2024-04-19T03:39:49.809427+0000","last_fullsized":"2024-04-19T03:39:49.809427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":90,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368231+0000","last_change":"2024-04-19T03:35:59.433656+0000","last_active":"2024-04-19T03:39:50.368231+0000","last_peered":"2024-04-19T03:39:50.368231+0000","last_clean":"2024-04-19T03:39:50.368231+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:39:50.368231+0000","last_undegraded":"2024-04-19T03:39:50.368231+0000","last_fullsized":"2024-04-19T03:39:50.368231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2079,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:41.293688+0000","last_change":"2024-04-19T03:40:41.293806+0000","last_active":"2024-04-19T03:40:41.293688+0000","last_peered":"2024-04-19T03:40:41.293688+0000","last_clean":"2024-04-19T03:40:41.293688+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:40:41.293688+0000","last_undegraded":"2024-04-19T03:40:41.293688+0000","last_fullsized":"2024-04-19T03:40:41.293688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1954","last_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_deep_scrub":"70'1954","last_deep_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_clean_scrub_stamp":"2024-04-19T03:40:41.293661+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:08.055945+0000","scrub_duration":0.0022932429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:06.458430+0000","last_change":"2024-04-19T03:40:06.458556+0000","last_active":"2024-04-19T03:40:06.458430+0000","last_peered":"2024-04-19T03:40:06.458430+0000","last_clean":"2024-04-19T03:40:06.458430+0000","last_became_active":"2024-04-19T03:39:43.434441+0000","last_became_peered":"2024-04-19T03:39:43.434441+0000","last_unstale":"2024-04-19T03:40:06.458430+0000","last_undegraded":"2024-04-19T03:40:06.458430+0000","last_fullsized":"2024-04-19T03:40:06.458430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_clean_scrub_stamp":"2024-04-19T03:40:06.458408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:59.975433+0000","scrub_duration":0.0018363920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:29.305946+0000","last_change":"2024-04-19T03:40:29.306077+0000","last_active":"2024-04-19T03:40:29.305946+0000","last_peered":"2024-04-19T03:40:29.305946+0000","last_clean":"2024-04-19T03:40:29.305946+0000","last_became_active":"2024-04-19T03:39:43.431591+0000","last_became_peered":"2024-04-19T03:39:43.431591+0000","last_unstale":"2024-04-19T03:40:29.305946+0000","last_undegraded":"2024-04-19T03:40:29.305946+0000","last_fullsized":"2024-04-19T03:40:29.305946+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_clean_scrub_stamp":"2024-04-19T03:40:29.305921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:42.842536+0000","scrub_duration":0.001644497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.325430+0000","last_change":"2024-04-19T03:40:00.325430+0000","last_active":"2024-04-19T03:40:00.325430+0000","last_peered":"2024-04-19T03:40:00.325430+0000","last_clean":"2024-04-19T03:40:00.325430+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:40:00.325430+0000","last_undegraded":"2024-04-19T03:40:00.325430+0000","last_fullsized":"2024-04-19T03:40:00.325430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.325262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:24.128839+0000","scrub_duration":0.0024403659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425387+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:43.425387+0000","last_peered":"2024-04-19T03:39:43.425387+0000","last_clean":"2024-04-19T03:39:43.425387+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:43.425387+0000","last_undegraded":"2024-04-19T03:39:43.425387+0000","last_fullsized":"2024-04-19T03:39:43.425387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.426115+0000","last_change":"2024-04-19T03:35:59.880630+0000","last_active":"2024-04-19T03:39:43.426115+0000","last_peered":"2024-04-19T03:39:43.426115+0000","last_clean":"2024-04-19T03:39:43.426115+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:39:43.426115+0000","last_undegraded":"2024-04-19T03:39:43.426115+0000","last_fullsized":"2024-04-19T03:39:43.426115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.437019+0000","last_change":"2024-04-19T03:39:43.431391+0000","last_active":"2024-04-19T03:39:43.437019+0000","last_peered":"2024-04-19T03:39:43.437019+0000","last_clean":"2024-04-19T03:39:43.437019+0000","last_became_active":"2024-04-19T03:39:43.430259+0000","last_became_peered":"2024-04-19T03:39:43.430259+0000","last_unstale":"2024-04-19T03:39:43.437019+0000","last_undegraded":"2024-04-19T03:39:43.437019+0000","last_fullsized":"2024-04-19T03:39:43.437019+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2099,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:55.535916+0000","last_change":"2024-04-19T03:39:55.536049+0000","last_active":"2024-04-19T03:39:55.535916+0000","last_peered":"2024-04-19T03:39:55.535916+0000","last_clean":"2024-04-19T03:39:55.535916+0000","last_became_active":"2024-04-19T03:39:43.430703+0000","last_became_peered":"2024-04-19T03:39:43.430703+0000","last_unstale":"2024-04-19T03:39:55.535916+0000","last_undegraded":"2024-04-19T03:39:55.535916+0000","last_fullsized":"2024-04-19T03:39:55.535916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2000","last_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_deep_scrub":"70'2000","last_deep_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_clean_scrub_stamp":"2024-04-19T03:39:55.535891+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:22.625053+0000","scrub_duration":0.002398659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.300261+0000","last_change":"2024-04-19T03:40:46.300397+0000","last_active":"2024-04-19T03:40:46.300261+0000","last_peered":"2024-04-19T03:40:46.300261+0000","last_clean":"2024-04-19T03:40:46.300261+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:40:46.300261+0000","last_undegraded":"2024-04-19T03:40:46.300261+0000","last_fullsized":"2024-04-19T03:40:46.300261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.300234+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:31.841726+0000","scrub_duration":0.0033879449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:26.383401+0000","last_change":"2024-04-19T03:40:26.383543+0000","last_active":"2024-04-19T03:40:26.383401+0000","last_peered":"2024-04-19T03:40:26.383401+0000","last_clean":"2024-04-19T03:40:26.383401+0000","last_became_active":"2024-04-19T03:39:43.433233+0000","last_became_peered":"2024-04-19T03:39:43.433233+0000","last_unstale":"2024-04-19T03:40:26.383401+0000","last_undegraded":"2024-04-19T03:40:26.383401+0000","last_fullsized":"2024-04-19T03:40:26.383401+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'7","last_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_deep_scrub":"70'7","last_deep_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_clean_scrub_stamp":"2024-04-19T03:40:26.383375+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:52.425413+0000","scrub_duration":0.0024732740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.608048+0000","last_change":"2024-04-19T03:40:18.608178+0000","last_active":"2024-04-19T03:40:18.608048+0000","last_peered":"2024-04-19T03:40:18.608048+0000","last_clean":"2024-04-19T03:40:18.608048+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:40:18.608048+0000","last_undegraded":"2024-04-19T03:40:18.608048+0000","last_fullsized":"2024-04-19T03:40:18.608048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.608004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:12.037760+0000","scrub_duration":0.0019643289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4151,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.425496+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:43.425496+0000","last_peered":"2024-04-19T03:39:43.425496+0000","last_clean":"2024-04-19T03:39:43.425496+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:43.425496+0000","last_undegraded":"2024-04-19T03:39:43.425496+0000","last_fullsized":"2024-04-19T03:39:43.425496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.706465+0000","last_change":"2024-04-19T03:40:12.706465+0000","last_active":"2024-04-19T03:40:12.706465+0000","last_peered":"2024-04-19T03:40:12.706465+0000","last_clean":"2024-04-19T03:40:12.706465+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:40:12.706465+0000","last_undegraded":"2024-04-19T03:40:12.706465+0000","last_fullsized":"2024-04-19T03:40:12.706465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'6","last_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_deep_scrub":"93'6","last_deep_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.706336+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:55.113200+0000","scrub_duration":0.0042115119999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2137,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:43.439380+0000","last_change":"2024-04-19T03:39:43.438910+0000","last_active":"2024-04-19T03:39:43.439380+0000","last_peered":"2024-04-19T03:39:43.439380+0000","last_clean":"2024-04-19T03:39:43.439380+0000","last_became_active":"2024-04-19T03:39:43.435662+0000","last_became_peered":"2024-04-19T03:39:43.435662+0000","last_unstale":"2024-04-19T03:39:43.439380+0000","last_undegraded":"2024-04-19T03:39:43.439380+0000","last_fullsized":"2024-04-19T03:39:43.439380+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.337417+0000","last_change":"2024-04-19T03:40:27.337549+0000","last_active":"2024-04-19T03:40:27.337417+0000","last_peered":"2024-04-19T03:40:27.337417+0000","last_clean":"2024-04-19T03:40:27.337417+0000","last_became_active":"2024-04-19T03:39:43.433006+0000","last_became_peered":"2024-04-19T03:39:43.433006+0000","last_unstale":"2024-04-19T03:40:27.337417+0000","last_undegraded":"2024-04-19T03:40:27.337417+0000","last_fullsized":"2024-04-19T03:40:27.337417+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.337390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:10.033965+0000","scrub_duration":0.0023860370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368576+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:50.368576+0000","last_peered":"2024-04-19T03:39:50.368576+0000","last_clean":"2024-04-19T03:39:50.368576+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:50.368576+0000","last_undegraded":"2024-04-19T03:39:50.368576+0000","last_fullsized":"2024-04-19T03:39:50.368576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2090,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809882+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:49.809882+0000","last_peered":"2024-04-19T03:39:49.809882+0000","last_clean":"2024-04-19T03:39:49.809882+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:49.809882+0000","last_undegraded":"2024-04-19T03:39:49.809882+0000","last_fullsized":"2024-04-19T03:39:49.809882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368581+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:50.368581+0000","last_peered":"2024-04-19T03:39:50.368581+0000","last_clean":"2024-04-19T03:39:50.368581+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:50.368581+0000","last_undegraded":"2024-04-19T03:39:50.368581+0000","last_fullsized":"2024-04-19T03:39:50.368581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.185614+0000","last_change":"2024-04-19T03:40:35.185736+0000","last_active":"2024-04-19T03:40:35.185614+0000","last_peered":"2024-04-19T03:40:35.185614+0000","last_clean":"2024-04-19T03:40:35.185614+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:40:35.185614+0000","last_undegraded":"2024-04-19T03:40:35.185614+0000","last_fullsized":"2024-04-19T03:40:35.185614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2053","last_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_deep_scrub":"70'2053","last_deep_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.185586+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:03.429934+0000","scrub_duration":0.0023438479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481812,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1652,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1691648,"data_stored":1258390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.502}]},{"osd":1,"last update":"Fri Apr 19 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.36899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369840,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002000,"statfs":{"total":96636764160,"available":96258048000,"internally_reserved":0,"allocated":1679360,"data_stored":1257168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.40999999999999998,"15min":0.42799999999999999},"min":{"1min":0.40400000000000003,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.65000000000000002,"5min":1.087,"15min":1.087},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.40699999999999997,"15min":0.42699999999999999},"min":{"1min":0.40699999999999997,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.61899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.49099999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:40:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.44500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":790528,"data_stored":382380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48799999999999999,"15min":0.44900000000000001},"min":{"1min":0.40400000000000003,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.622,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.41299999999999998,"15min":0.42399999999999999},"min":{"1min":0.36499999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Apr 19 03:40:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.44}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:40:52.599 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.599 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.600 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.600 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.600 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.600 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.600 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.600 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.600 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.600 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.601 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.601 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.601 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.601 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.601 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.601 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.601 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.602 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.602 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.602 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.602 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.602 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.602 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.602 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.602 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.603 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.603 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.603 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.603 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.603 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.603 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.603 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T03:35:54.393544+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=54, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.603 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.603 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.604 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.604 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.604 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.604 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.604 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.604 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.604 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.604 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.605 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.605 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.605 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.605 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.605 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:40:52.605 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:41:12.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:41:12.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-19T03:41:12.357858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115825,"ondisk_log_size":115825,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795896,"kb_used_data":4064,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319624,"statfs":{"total":289910292480,"available":289095294976,"internally_reserved":0,"allocated":4161536,"data_stored":2897938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002993"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2069,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810082+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:49.810082+0000","last_peered":"2024-04-19T03:39:49.810082+0000","last_clean":"2024-04-19T03:39:49.810082+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:49.810082+0000","last_undegraded":"2024-04-19T03:39:49.810082+0000","last_fullsized":"2024-04-19T03:39:49.810082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":94,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810084+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:49.810084+0000","last_peered":"2024-04-19T03:39:49.810084+0000","last_clean":"2024-04-19T03:39:49.810084+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:49.810084+0000","last_undegraded":"2024-04-19T03:39:49.810084+0000","last_fullsized":"2024-04-19T03:39:49.810084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4092,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:28.290926+0000","last_change":"2024-04-19T03:40:28.291061+0000","last_active":"2024-04-19T03:40:28.290926+0000","last_peered":"2024-04-19T03:40:28.290926+0000","last_clean":"2024-04-19T03:40:28.290926+0000","last_became_active":"2024-04-19T03:39:43.437251+0000","last_became_peered":"2024-04-19T03:39:43.437251+0000","last_unstale":"2024-04-19T03:40:28.290926+0000","last_undegraded":"2024-04-19T03:40:28.290926+0000","last_fullsized":"2024-04-19T03:40:28.290926+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3993","last_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_deep_scrub":"70'3993","last_deep_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_clean_scrub_stamp":"2024-04-19T03:40:28.290885+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:17.123063+0000","scrub_duration":0.0023123509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.425776+0000","last_change":"2024-04-19T03:40:04.425893+0000","last_active":"2024-04-19T03:40:04.425776+0000","last_peered":"2024-04-19T03:40:04.425776+0000","last_clean":"2024-04-19T03:40:04.425776+0000","last_became_active":"2024-04-19T03:39:43.434583+0000","last_became_peered":"2024-04-19T03:39:43.434583+0000","last_unstale":"2024-04-19T03:40:04.425776+0000","last_undegraded":"2024-04-19T03:40:04.425776+0000","last_fullsized":"2024-04-19T03:40:04.425776+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.425751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:07.588193+0000","scrub_duration":0.002196057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:50.306704+0000","last_change":"2024-04-19T03:40:50.306704+0000","last_active":"2024-04-19T03:40:50.306704+0000","last_peered":"2024-04-19T03:40:50.306704+0000","last_clean":"2024-04-19T03:40:50.306704+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:40:50.306704+0000","last_undegraded":"2024-04-19T03:40:50.306704+0000","last_fullsized":"2024-04-19T03:40:50.306704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2051","last_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_deep_scrub":"70'2051","last_deep_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_clean_scrub_stamp":"2024-04-19T03:40:50.306544+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:45.676931+0000","scrub_duration":0.0035400869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:47.306345+0000","last_change":"2024-04-19T03:40:47.306484+0000","last_active":"2024-04-19T03:40:47.306345+0000","last_peered":"2024-04-19T03:40:47.306345+0000","last_clean":"2024-04-19T03:40:47.306345+0000","last_became_active":"2024-04-19T03:39:43.429508+0000","last_became_peered":"2024-04-19T03:39:43.429508+0000","last_unstale":"2024-04-19T03:40:47.306345+0000","last_undegraded":"2024-04-19T03:40:47.306345+0000","last_fullsized":"2024-04-19T03:40:47.306345+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_clean_scrub_stamp":"2024-04-19T03:40:47.306304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:24.288058+0000","scrub_duration":0.0027027560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.363796+0000","last_change":"2024-04-19T03:40:32.363907+0000","last_active":"2024-04-19T03:40:32.363796+0000","last_peered":"2024-04-19T03:40:32.363796+0000","last_clean":"2024-04-19T03:40:32.363796+0000","last_became_active":"2024-04-19T03:39:43.428726+0000","last_became_peered":"2024-04-19T03:39:43.428726+0000","last_unstale":"2024-04-19T03:40:32.363796+0000","last_undegraded":"2024-04-19T03:40:32.363796+0000","last_fullsized":"2024-04-19T03:40:32.363796+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.363768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:55:49.483155+0000","scrub_duration":0.0027930099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:03.416041+0000","last_change":"2024-04-19T03:40:03.416142+0000","last_active":"2024-04-19T03:40:03.416041+0000","last_peered":"2024-04-19T03:40:03.416041+0000","last_clean":"2024-04-19T03:40:03.416041+0000","last_became_active":"2024-04-19T03:39:43.433063+0000","last_became_peered":"2024-04-19T03:39:43.433063+0000","last_unstale":"2024-04-19T03:40:03.416041+0000","last_undegraded":"2024-04-19T03:40:03.416041+0000","last_fullsized":"2024-04-19T03:40:03.416041+0000","mapping_epoch":92,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8029","last_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_deep_scrub":"70'8029","last_deep_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_clean_scrub_stamp":"2024-04-19T03:40:03.416008+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:39.795688+0000","scrub_duration":0.002564808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368679+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:50.368679+0000","last_peered":"2024-04-19T03:39:50.368679+0000","last_clean":"2024-04-19T03:39:50.368679+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:50.368679+0000","last_undegraded":"2024-04-19T03:39:50.368679+0000","last_fullsized":"2024-04-19T03:39:50.368679+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810003+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:49.810003+0000","last_peered":"2024-04-19T03:39:49.810003+0000","last_clean":"2024-04-19T03:39:49.810003+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:49.810003+0000","last_undegraded":"2024-04-19T03:39:49.810003+0000","last_fullsized":"2024-04-19T03:39:49.810003+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4038,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:21.433541+0000","last_change":"2024-04-19T03:40:21.433640+0000","last_active":"2024-04-19T03:40:21.433541+0000","last_peered":"2024-04-19T03:40:21.433541+0000","last_clean":"2024-04-19T03:40:21.433541+0000","last_became_active":"2024-04-19T03:39:43.431742+0000","last_became_peered":"2024-04-19T03:39:43.431742+0000","last_unstale":"2024-04-19T03:40:21.433541+0000","last_undegraded":"2024-04-19T03:40:21.433541+0000","last_fullsized":"2024-04-19T03:40:21.433541+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3939","last_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_deep_scrub":"70'3939","last_deep_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_clean_scrub_stamp":"2024-04-19T03:40:21.433514+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:57.721359+0000","scrub_duration":0.0025512870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810017+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:49.810017+0000","last_peered":"2024-04-19T03:39:49.810017+0000","last_clean":"2024-04-19T03:39:49.810017+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:49.810017+0000","last_undegraded":"2024-04-19T03:39:49.810017+0000","last_fullsized":"2024-04-19T03:39:49.810017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2082,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810035+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:49.810035+0000","last_peered":"2024-04-19T03:39:49.810035+0000","last_clean":"2024-04-19T03:39:49.810035+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:49.810035+0000","last_undegraded":"2024-04-19T03:39:49.810035+0000","last_fullsized":"2024-04-19T03:39:49.810035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:14.424937+0000","last_change":"2024-04-19T03:40:14.425058+0000","last_active":"2024-04-19T03:40:14.424937+0000","last_peered":"2024-04-19T03:40:14.424937+0000","last_clean":"2024-04-19T03:40:14.424937+0000","last_became_active":"2024-04-19T03:39:43.435748+0000","last_became_peered":"2024-04-19T03:39:43.435748+0000","last_unstale":"2024-04-19T03:40:14.424937+0000","last_undegraded":"2024-04-19T03:40:14.424937+0000","last_fullsized":"2024-04-19T03:40:14.424937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2072","last_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_deep_scrub":"70'2072","last_deep_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_clean_scrub_stamp":"2024-04-19T03:40:14.424896+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:23.898309+0000","scrub_duration":0.0031291729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2124,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:31.388443+0000","last_change":"2024-04-19T03:40:31.388574+0000","last_active":"2024-04-19T03:40:31.388443+0000","last_peered":"2024-04-19T03:40:31.388443+0000","last_clean":"2024-04-19T03:40:31.388443+0000","last_became_active":"2024-04-19T03:39:43.430447+0000","last_became_peered":"2024-04-19T03:39:43.430447+0000","last_unstale":"2024-04-19T03:40:31.388443+0000","last_undegraded":"2024-04-19T03:40:31.388443+0000","last_fullsized":"2024-04-19T03:40:31.388443+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2025","last_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_deep_scrub":"70'2025","last_deep_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_clean_scrub_stamp":"2024-04-19T03:40:31.388419+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:12.219961+0000","scrub_duration":0.0023057400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:55.327799+0000","last_change":"2024-04-19T03:40:55.327902+0000","last_active":"2024-04-19T03:40:55.327799+0000","last_peered":"2024-04-19T03:40:55.327799+0000","last_clean":"2024-04-19T03:40:55.327799+0000","last_became_active":"2024-04-19T03:39:43.433748+0000","last_became_peered":"2024-04-19T03:39:43.433748+0000","last_unstale":"2024-04-19T03:40:55.327799+0000","last_undegraded":"2024-04-19T03:40:55.327799+0000","last_fullsized":"2024-04-19T03:40:55.327799+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2002","last_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_deep_scrub":"70'2002","last_deep_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_clean_scrub_stamp":"2024-04-19T03:40:55.327775+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:08:48.213870+0000","scrub_duration":0.0026441490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2069,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368633+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:50.368633+0000","last_peered":"2024-04-19T03:39:50.368633+0000","last_clean":"2024-04-19T03:39:50.368633+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:50.368633+0000","last_undegraded":"2024-04-19T03:39:50.368633+0000","last_fullsized":"2024-04-19T03:39:50.368633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809995+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:49.809995+0000","last_peered":"2024-04-19T03:39:49.809995+0000","last_clean":"2024-04-19T03:39:49.809995+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:49.809995+0000","last_undegraded":"2024-04-19T03:39:49.809995+0000","last_fullsized":"2024-04-19T03:39:49.809995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4141,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368638+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:50.368638+0000","last_peered":"2024-04-19T03:39:50.368638+0000","last_clean":"2024-04-19T03:39:50.368638+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:50.368638+0000","last_undegraded":"2024-04-19T03:39:50.368638+0000","last_fullsized":"2024-04-19T03:39:50.368638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4185,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.399718+0000","last_change":"2024-04-19T03:40:35.399826+0000","last_active":"2024-04-19T03:40:35.399718+0000","last_peered":"2024-04-19T03:40:35.399718+0000","last_clean":"2024-04-19T03:40:35.399718+0000","last_became_active":"2024-04-19T03:39:43.431899+0000","last_became_peered":"2024-04-19T03:39:43.431899+0000","last_unstale":"2024-04-19T03:40:35.399718+0000","last_undegraded":"2024-04-19T03:40:35.399718+0000","last_fullsized":"2024-04-19T03:40:35.399718+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4086","last_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_deep_scrub":"70'4086","last_deep_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.399694+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:10.836662+0000","scrub_duration":0.0025555930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:07.410632+0000","last_change":"2024-04-19T03:40:07.410737+0000","last_active":"2024-04-19T03:40:07.410632+0000","last_peered":"2024-04-19T03:40:07.410632+0000","last_clean":"2024-04-19T03:40:07.410632+0000","last_became_active":"2024-04-19T03:39:43.431732+0000","last_became_peered":"2024-04-19T03:39:43.431732+0000","last_unstale":"2024-04-19T03:40:07.410632+0000","last_undegraded":"2024-04-19T03:40:07.410632+0000","last_fullsized":"2024-04-19T03:40:07.410632+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'11","last_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_deep_scrub":"70'11","last_deep_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_clean_scrub_stamp":"2024-04-19T03:40:07.410606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:58.262646+0000","scrub_duration":0.0023107370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.207298+0000","last_change":"2024-04-19T03:41:07.207411+0000","last_active":"2024-04-19T03:41:07.207298+0000","last_peered":"2024-04-19T03:41:07.207298+0000","last_clean":"2024-04-19T03:41:07.207298+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:41:07.207298+0000","last_undegraded":"2024-04-19T03:41:07.207298+0000","last_fullsized":"2024-04-19T03:41:07.207298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.207263+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:15:12.629847+0000","scrub_duration":0.0031871450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368616+0000","last_change":"2024-04-19T03:39:22.421805+0000","last_active":"2024-04-19T03:39:50.368616+0000","last_peered":"2024-04-19T03:39:50.368616+0000","last_clean":"2024-04-19T03:39:50.368616+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:39:50.368616+0000","last_undegraded":"2024-04-19T03:39:50.368616+0000","last_fullsized":"2024-04-19T03:39:50.368616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.134428+0000","last_change":"2024-04-19T03:40:32.134573+0000","last_active":"2024-04-19T03:40:32.134428+0000","last_peered":"2024-04-19T03:40:32.134428+0000","last_clean":"2024-04-19T03:40:32.134428+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:40:32.134428+0000","last_undegraded":"2024-04-19T03:40:32.134428+0000","last_fullsized":"2024-04-19T03:40:32.134428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4021","last_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_deep_scrub":"70'4021","last_deep_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.134399+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:06.376575+0000","scrub_duration":0.0035905770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.324323+0000","last_change":"2024-04-19T03:40:04.324323+0000","last_active":"2024-04-19T03:40:04.324323+0000","last_peered":"2024-04-19T03:40:04.324323+0000","last_clean":"2024-04-19T03:40:04.324323+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:40:04.324323+0000","last_undegraded":"2024-04-19T03:40:04.324323+0000","last_fullsized":"2024-04-19T03:40:04.324323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1983","last_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_deep_scrub":"70'1983","last_deep_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.324180+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:46.731044+0000","scrub_duration":0.0027598010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":117,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368642+0000","last_change":"2024-04-19T03:39:19.424626+0000","last_active":"2024-04-19T03:39:50.368642+0000","last_peered":"2024-04-19T03:39:50.368642+0000","last_clean":"2024-04-19T03:39:50.368642+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:39:50.368642+0000","last_undegraded":"2024-04-19T03:39:50.368642+0000","last_fullsized":"2024-04-19T03:39:50.368642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2127,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:52.486220+0000","last_change":"2024-04-19T03:39:52.486333+0000","last_active":"2024-04-19T03:39:52.486220+0000","last_peered":"2024-04-19T03:39:52.486220+0000","last_clean":"2024-04-19T03:39:52.486220+0000","last_became_active":"2024-04-19T03:39:43.437065+0000","last_became_peered":"2024-04-19T03:39:43.437065+0000","last_unstale":"2024-04-19T03:39:52.486220+0000","last_undegraded":"2024-04-19T03:39:52.486220+0000","last_fullsized":"2024-04-19T03:39:52.486220+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2028","last_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_deep_scrub":"70'2028","last_deep_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_clean_scrub_stamp":"2024-04-19T03:39:52.486195+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:49.821209+0000","scrub_duration":0.0024754260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":92,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809578+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:49.809578+0000","last_peered":"2024-04-19T03:39:49.809578+0000","last_clean":"2024-04-19T03:39:49.809578+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:49.809578+0000","last_undegraded":"2024-04-19T03:39:49.809578+0000","last_fullsized":"2024-04-19T03:39:49.809578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":129,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:22.199937+0000","last_change":"2024-04-19T03:40:22.199937+0000","last_active":"2024-04-19T03:40:22.199937+0000","last_peered":"2024-04-19T03:40:22.199937+0000","last_clean":"2024-04-19T03:40:22.199937+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:40:22.199937+0000","last_undegraded":"2024-04-19T03:40:22.199937+0000","last_fullsized":"2024-04-19T03:40:22.199937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_clean_scrub_stamp":"2024-04-19T03:40:22.199728+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:08:02.693048+0000","scrub_duration":0.0026297960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.760857+0000","last_change":"2024-04-19T03:40:32.760857+0000","last_active":"2024-04-19T03:40:32.760857+0000","last_peered":"2024-04-19T03:40:32.760857+0000","last_clean":"2024-04-19T03:40:32.760857+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:40:32.760857+0000","last_undegraded":"2024-04-19T03:40:32.760857+0000","last_fullsized":"2024-04-19T03:40:32.760857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.760689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:48.412394+0000","scrub_duration":0.001792664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368611+0000","last_change":"2024-04-19T03:39:19.424437+0000","last_active":"2024-04-19T03:39:50.368611+0000","last_peered":"2024-04-19T03:39:50.368611+0000","last_clean":"2024-04-19T03:39:50.368611+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:39:50.368611+0000","last_undegraded":"2024-04-19T03:39:50.368611+0000","last_fullsized":"2024-04-19T03:39:50.368611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.857512+0000","last_change":"2024-04-19T03:40:39.857512+0000","last_active":"2024-04-19T03:40:39.857512+0000","last_peered":"2024-04-19T03:40:39.857512+0000","last_clean":"2024-04-19T03:40:39.857512+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:40:39.857512+0000","last_undegraded":"2024-04-19T03:40:39.857512+0000","last_fullsized":"2024-04-19T03:40:39.857512+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.857367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:14.099544+0000","scrub_duration":0.0016111649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.287222+0000","last_change":"2024-04-19T03:40:39.287366+0000","last_active":"2024-04-19T03:40:39.287222+0000","last_peered":"2024-04-19T03:40:39.287222+0000","last_clean":"2024-04-19T03:40:39.287222+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:40:39.287222+0000","last_undegraded":"2024-04-19T03:40:39.287222+0000","last_fullsized":"2024-04-19T03:40:39.287222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.287191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:08.985963+0000","scrub_duration":0.0020786289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.690988+0000","last_change":"2024-04-19T03:40:27.690988+0000","last_active":"2024-04-19T03:40:27.690988+0000","last_peered":"2024-04-19T03:40:27.690988+0000","last_clean":"2024-04-19T03:40:27.690988+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:40:27.690988+0000","last_undegraded":"2024-04-19T03:40:27.690988+0000","last_fullsized":"2024-04-19T03:40:27.690988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.690844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:32.347176+0000","scrub_duration":0.001791932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:59.727483+0000","last_change":"2024-04-19T03:39:59.727483+0000","last_active":"2024-04-19T03:39:59.727483+0000","last_peered":"2024-04-19T03:39:59.727483+0000","last_clean":"2024-04-19T03:39:59.727483+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:59.727483+0000","last_undegraded":"2024-04-19T03:39:59.727483+0000","last_fullsized":"2024-04-19T03:39:59.727483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_clean_scrub_stamp":"2024-04-19T03:39:59.727297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:17.092087+0000","scrub_duration":0.0035426419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:25.393482+0000","last_change":"2024-04-19T03:40:25.393587+0000","last_active":"2024-04-19T03:40:25.393482+0000","last_peered":"2024-04-19T03:40:25.393482+0000","last_clean":"2024-04-19T03:40:25.393482+0000","last_became_active":"2024-04-19T03:39:43.429210+0000","last_became_peered":"2024-04-19T03:39:43.429210+0000","last_unstale":"2024-04-19T03:40:25.393482+0000","last_undegraded":"2024-04-19T03:40:25.393482+0000","last_fullsized":"2024-04-19T03:40:25.393482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_clean_scrub_stamp":"2024-04-19T03:40:25.393456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:41.962081+0000","scrub_duration":0.002168045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:16.670035+0000","last_change":"2024-04-19T03:40:16.670035+0000","last_active":"2024-04-19T03:40:16.670035+0000","last_peered":"2024-04-19T03:40:16.670035+0000","last_clean":"2024-04-19T03:40:16.670035+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:40:16.670035+0000","last_undegraded":"2024-04-19T03:40:16.670035+0000","last_fullsized":"2024-04-19T03:40:16.670035+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5950","last_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_deep_scrub":"70'5950","last_deep_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_clean_scrub_stamp":"2024-04-19T03:40:16.669845+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:00.796011+0000","scrub_duration":0.0029482610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809582+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:49.809582+0000","last_peered":"2024-04-19T03:39:49.809582+0000","last_clean":"2024-04-19T03:39:49.809582+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:49.809582+0000","last_undegraded":"2024-04-19T03:39:49.809582+0000","last_fullsized":"2024-04-19T03:39:49.809582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.615150+0000","last_change":"2024-04-19T03:40:20.615150+0000","last_active":"2024-04-19T03:40:20.615150+0000","last_peered":"2024-04-19T03:40:20.615150+0000","last_clean":"2024-04-19T03:40:20.615150+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:40:20.615150+0000","last_undegraded":"2024-04-19T03:40:20.615150+0000","last_fullsized":"2024-04-19T03:40:20.615150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4063","last_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_deep_scrub":"70'4063","last_deep_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.614982+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:01.364729+0000","scrub_duration":0.003172963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"93'99","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.346102+0000","last_change":"2024-04-19T03:40:48.346209+0000","last_active":"2024-04-19T03:40:48.346102+0000","last_peered":"2024-04-19T03:40:48.346102+0000","last_clean":"2024-04-19T03:40:48.346102+0000","last_became_active":"2024-04-19T03:39:43.437298+0000","last_became_peered":"2024-04-19T03:39:43.437298+0000","last_unstale":"2024-04-19T03:40:48.346102+0000","last_undegraded":"2024-04-19T03:40:48.346102+0000","last_fullsized":"2024-04-19T03:40:48.346102+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'99","last_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_deep_scrub":"93'99","last_deep_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.346076+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:13.038605+0000","scrub_duration":0.007204322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4182,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:40.440866+0000","last_change":"2024-04-19T03:40:40.440980+0000","last_active":"2024-04-19T03:40:40.440866+0000","last_peered":"2024-04-19T03:40:40.440866+0000","last_clean":"2024-04-19T03:40:40.440866+0000","last_became_active":"2024-04-19T03:39:43.434605+0000","last_became_peered":"2024-04-19T03:39:43.434605+0000","last_unstale":"2024-04-19T03:40:40.440866+0000","last_undegraded":"2024-04-19T03:40:40.440866+0000","last_fullsized":"2024-04-19T03:40:40.440866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4083","last_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_deep_scrub":"70'4083","last_deep_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_clean_scrub_stamp":"2024-04-19T03:40:40.440842+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:45.344854+0000","scrub_duration":0.0025970279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"93'4","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.460389+0000","last_change":"2024-04-19T03:40:42.460494+0000","last_active":"2024-04-19T03:40:42.460389+0000","last_peered":"2024-04-19T03:40:42.460389+0000","last_clean":"2024-04-19T03:40:42.460389+0000","last_became_active":"2024-04-19T03:39:43.431842+0000","last_became_peered":"2024-04-19T03:39:43.431842+0000","last_unstale":"2024-04-19T03:40:42.460389+0000","last_undegraded":"2024-04-19T03:40:42.460389+0000","last_fullsized":"2024-04-19T03:40:42.460389+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.460363+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:49.733129+0000","scrub_duration":0.003431403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2076,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.285715+0000","last_change":"2024-04-19T03:40:08.285715+0000","last_active":"2024-04-19T03:40:08.285715+0000","last_peered":"2024-04-19T03:40:08.285715+0000","last_clean":"2024-04-19T03:40:08.285715+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:40:08.285715+0000","last_undegraded":"2024-04-19T03:40:08.285715+0000","last_fullsized":"2024-04-19T03:40:08.285715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1975","last_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_deep_scrub":"70'1975","last_deep_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.285526+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:52.411692+0000","scrub_duration":0.0032122520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368244+0000","last_change":"2024-04-19T03:39:19.423109+0000","last_active":"2024-04-19T03:39:50.368244+0000","last_peered":"2024-04-19T03:39:50.368244+0000","last_clean":"2024-04-19T03:39:50.368244+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:39:50.368244+0000","last_undegraded":"2024-04-19T03:39:50.368244+0000","last_fullsized":"2024-04-19T03:39:50.368244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:11.249784+0000","last_change":"2024-04-19T03:40:11.249784+0000","last_active":"2024-04-19T03:40:11.249784+0000","last_peered":"2024-04-19T03:40:11.249784+0000","last_clean":"2024-04-19T03:40:11.249784+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:40:11.249784+0000","last_undegraded":"2024-04-19T03:40:11.249784+0000","last_fullsized":"2024-04-19T03:40:11.249784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2033","last_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_deep_scrub":"70'2033","last_deep_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_clean_scrub_stamp":"2024-04-19T03:40:11.249632+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:04.679387+0000","scrub_duration":0.0039095689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:58.391315+0000","last_change":"2024-04-19T03:40:58.391420+0000","last_active":"2024-04-19T03:40:58.391315+0000","last_peered":"2024-04-19T03:40:58.391315+0000","last_clean":"2024-04-19T03:40:58.391315+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:40:58.391315+0000","last_undegraded":"2024-04-19T03:40:58.391315+0000","last_fullsized":"2024-04-19T03:40:58.391315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_clean_scrub_stamp":"2024-04-19T03:40:58.391280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:42.335959+0000","scrub_duration":0.001857837,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:30.761230+0000","last_change":"2024-04-19T03:40:30.761230+0000","last_active":"2024-04-19T03:40:30.761230+0000","last_peered":"2024-04-19T03:40:30.761230+0000","last_clean":"2024-04-19T03:40:30.761230+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:40:30.761230+0000","last_undegraded":"2024-04-19T03:40:30.761230+0000","last_fullsized":"2024-04-19T03:40:30.761230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'10","last_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_deep_scrub":"70'10","last_deep_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_clean_scrub_stamp":"2024-04-19T03:40:30.761100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:51.151497+0000","scrub_duration":0.0024608220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"93'13","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.342259+0000","last_change":"2024-04-19T03:40:33.342391+0000","last_active":"2024-04-19T03:40:33.342259+0000","last_peered":"2024-04-19T03:40:33.342259+0000","last_clean":"2024-04-19T03:40:33.342259+0000","last_became_active":"2024-04-19T03:39:43.436291+0000","last_became_peered":"2024-04-19T03:39:43.436291+0000","last_unstale":"2024-04-19T03:40:33.342259+0000","last_undegraded":"2024-04-19T03:40:33.342259+0000","last_fullsized":"2024-04-19T03:40:33.342259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'13","last_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_deep_scrub":"93'13","last_deep_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.342214+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:39:21.052990+0000","scrub_duration":0.0050089979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2219,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.743742+0000","last_change":"2024-04-19T03:40:33.743742+0000","last_active":"2024-04-19T03:40:33.743742+0000","last_peered":"2024-04-19T03:40:33.743742+0000","last_clean":"2024-04-19T03:40:33.743742+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:40:33.743742+0000","last_undegraded":"2024-04-19T03:40:33.743742+0000","last_fullsized":"2024-04-19T03:40:33.743742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2095","last_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_deep_scrub":"70'2095","last_deep_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.743609+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:30.726079+0000","scrub_duration":0.0029003269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"93'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.429095+0000","last_change":"2024-04-19T03:40:08.429204+0000","last_active":"2024-04-19T03:40:08.429095+0000","last_peered":"2024-04-19T03:40:08.429095+0000","last_clean":"2024-04-19T03:40:08.429095+0000","last_became_active":"2024-04-19T03:39:43.431751+0000","last_became_peered":"2024-04-19T03:39:43.431751+0000","last_unstale":"2024-04-19T03:40:08.429095+0000","last_undegraded":"2024-04-19T03:40:08.429095+0000","last_fullsized":"2024-04-19T03:40:08.429095+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.429067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:52.134126+0000","scrub_duration":0.0036343399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:02.298573+0000","last_change":"2024-04-19T03:40:02.298573+0000","last_active":"2024-04-19T03:40:02.298573+0000","last_peered":"2024-04-19T03:40:02.298573+0000","last_clean":"2024-04-19T03:40:02.298573+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:40:02.298573+0000","last_undegraded":"2024-04-19T03:40:02.298573+0000","last_fullsized":"2024-04-19T03:40:02.298573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2054","last_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_deep_scrub":"70'2054","last_deep_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_clean_scrub_stamp":"2024-04-19T03:40:02.298435+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:12.759109+0000","scrub_duration":0.0023525339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"93'3","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:02.299399+0000","last_change":"2024-04-19T03:41:02.299516+0000","last_active":"2024-04-19T03:41:02.299399+0000","last_peered":"2024-04-19T03:41:02.299399+0000","last_clean":"2024-04-19T03:41:02.299399+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:41:02.299399+0000","last_undegraded":"2024-04-19T03:41:02.299399+0000","last_fullsized":"2024-04-19T03:41:02.299399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_clean_scrub_stamp":"2024-04-19T03:41:02.299371+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:42.745471+0000","scrub_duration":0.0032937819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:01.328432+0000","last_change":"2024-04-19T03:41:01.328574+0000","last_active":"2024-04-19T03:41:01.328432+0000","last_peered":"2024-04-19T03:41:01.328432+0000","last_clean":"2024-04-19T03:41:01.328432+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:41:01.328432+0000","last_undegraded":"2024-04-19T03:41:01.328432+0000","last_fullsized":"2024-04-19T03:41:01.328432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2","last_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_deep_scrub":"70'2","last_deep_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_clean_scrub_stamp":"2024-04-19T03:41:01.328403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:19.548881+0000","scrub_duration":0.003585155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"93'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:04.299196+0000","last_change":"2024-04-19T03:41:04.299312+0000","last_active":"2024-04-19T03:41:04.299196+0000","last_peered":"2024-04-19T03:41:04.299196+0000","last_clean":"2024-04-19T03:41:04.299196+0000","last_became_active":"2024-04-19T03:39:43.436323+0000","last_became_peered":"2024-04-19T03:39:43.436323+0000","last_unstale":"2024-04-19T03:41:04.299196+0000","last_undegraded":"2024-04-19T03:41:04.299196+0000","last_fullsized":"2024-04-19T03:41:04.299196+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_clean_scrub_stamp":"2024-04-19T03:41:04.299169+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:01.619558+0000","scrub_duration":0.003662354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.490686+0000","last_change":"2024-04-19T03:39:51.490790+0000","last_active":"2024-04-19T03:39:51.490686+0000","last_peered":"2024-04-19T03:39:51.490686+0000","last_clean":"2024-04-19T03:39:51.490686+0000","last_became_active":"2024-04-19T03:39:43.434807+0000","last_became_peered":"2024-04-19T03:39:43.434807+0000","last_unstale":"2024-04-19T03:39:51.490686+0000","last_undegraded":"2024-04-19T03:39:51.490686+0000","last_fullsized":"2024-04-19T03:39:51.490686+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1981","last_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_deep_scrub":"70'1981","last_deep_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.490660+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.438851+0000","scrub_duration":0.002801207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.535662+0000","last_change":"2024-04-19T03:40:00.535767+0000","last_active":"2024-04-19T03:40:00.535662+0000","last_peered":"2024-04-19T03:40:00.535662+0000","last_clean":"2024-04-19T03:40:00.535662+0000","last_became_active":"2024-04-19T03:39:43.432885+0000","last_became_peered":"2024-04-19T03:39:43.432885+0000","last_unstale":"2024-04-19T03:40:00.535662+0000","last_undegraded":"2024-04-19T03:40:00.535662+0000","last_fullsized":"2024-04-19T03:40:00.535662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.535639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:09.252735+0000","scrub_duration":0.0018715909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.617468+0000","last_change":"2024-04-19T03:39:50.617468+0000","last_active":"2024-04-19T03:39:50.617468+0000","last_peered":"2024-04-19T03:39:50.617468+0000","last_clean":"2024-04-19T03:39:50.617468+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:50.617468+0000","last_undegraded":"2024-04-19T03:39:50.617468+0000","last_fullsized":"2024-04-19T03:39:50.617468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_clean_scrub_stamp":"2024-04-19T03:39:50.617321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:52.005449+0000","scrub_duration":0.0027065029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"69'3","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368233+0000","last_change":"2024-04-19T03:39:19.426052+0000","last_active":"2024-04-19T03:39:50.368233+0000","last_peered":"2024-04-19T03:39:50.368233+0000","last_clean":"2024-04-19T03:39:50.368233+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:39:50.368233+0000","last_undegraded":"2024-04-19T03:39:50.368233+0000","last_fullsized":"2024-04-19T03:39:50.368233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.395768+0000","last_change":"2024-04-19T03:40:23.395889+0000","last_active":"2024-04-19T03:40:23.395768+0000","last_peered":"2024-04-19T03:40:23.395768+0000","last_clean":"2024-04-19T03:40:23.395768+0000","last_became_active":"2024-04-19T03:39:43.433630+0000","last_became_peered":"2024-04-19T03:39:43.433630+0000","last_unstale":"2024-04-19T03:40:23.395768+0000","last_undegraded":"2024-04-19T03:40:23.395768+0000","last_fullsized":"2024-04-19T03:40:23.395768+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2008","last_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_deep_scrub":"70'2008","last_deep_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:23.395745+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:56:22.631622+0000","scrub_duration":0.002746283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:03.295461+0000","last_change":"2024-04-19T03:41:03.295590+0000","last_active":"2024-04-19T03:41:03.295461+0000","last_peered":"2024-04-19T03:41:03.295461+0000","last_clean":"2024-04-19T03:41:03.295461+0000","last_became_active":"2024-04-19T03:39:43.430616+0000","last_became_peered":"2024-04-19T03:39:43.430616+0000","last_unstale":"2024-04-19T03:41:03.295461+0000","last_undegraded":"2024-04-19T03:41:03.295461+0000","last_fullsized":"2024-04-19T03:41:03.295461+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_clean_scrub_stamp":"2024-04-19T03:41:03.295436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:40.226830+0000","scrub_duration":0.0017184609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.448534+0000","last_change":"2024-04-19T03:40:12.448673+0000","last_active":"2024-04-19T03:40:12.448534+0000","last_peered":"2024-04-19T03:40:12.448534+0000","last_clean":"2024-04-19T03:40:12.448534+0000","last_became_active":"2024-04-19T03:39:43.434699+0000","last_became_peered":"2024-04-19T03:39:43.434699+0000","last_unstale":"2024-04-19T03:40:12.448534+0000","last_undegraded":"2024-04-19T03:40:12.448534+0000","last_fullsized":"2024-04-19T03:40:12.448534+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2035","last_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_deep_scrub":"70'2035","last_deep_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.448493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:23.179035+0000","scrub_duration":0.002191452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809466+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:49.809466+0000","last_peered":"2024-04-19T03:39:49.809466+0000","last_clean":"2024-04-19T03:39:49.809466+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:49.809466+0000","last_undegraded":"2024-04-19T03:39:49.809466+0000","last_fullsized":"2024-04-19T03:39:49.809466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2144,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.427101+0000","last_change":"2024-04-19T03:40:18.427193+0000","last_active":"2024-04-19T03:40:18.427101+0000","last_peered":"2024-04-19T03:40:18.427101+0000","last_clean":"2024-04-19T03:40:18.427101+0000","last_became_active":"2024-04-19T03:39:43.431921+0000","last_became_peered":"2024-04-19T03:39:43.431921+0000","last_unstale":"2024-04-19T03:40:18.427101+0000","last_undegraded":"2024-04-19T03:40:18.427101+0000","last_fullsized":"2024-04-19T03:40:18.427101+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2045","last_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_deep_scrub":"70'2045","last_deep_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.427077+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:13.005299+0000","scrub_duration":0.0023622740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.368152+0000","last_change":"2024-04-19T03:40:54.368270+0000","last_active":"2024-04-19T03:40:54.368152+0000","last_peered":"2024-04-19T03:40:54.368152+0000","last_clean":"2024-04-19T03:40:54.368152+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:40:54.368152+0000","last_undegraded":"2024-04-19T03:40:54.368152+0000","last_fullsized":"2024-04-19T03:40:54.368152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.368123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:24.596193+0000","scrub_duration":0.001875411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6131,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:10.753203+0000","last_change":"2024-04-19T03:40:10.753203+0000","last_active":"2024-04-19T03:40:10.753203+0000","last_peered":"2024-04-19T03:40:10.753203+0000","last_clean":"2024-04-19T03:40:10.753203+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:40:10.753203+0000","last_undegraded":"2024-04-19T03:40:10.753203+0000","last_fullsized":"2024-04-19T03:40:10.753203+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6031","last_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_deep_scrub":"70'6031","last_deep_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_clean_scrub_stamp":"2024-04-19T03:40:10.753070+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:21.213744+0000","scrub_duration":0.003270387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"93'4","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.909530+0000","last_change":"2024-04-19T03:40:49.909639+0000","last_active":"2024-04-19T03:40:49.909530+0000","last_peered":"2024-04-19T03:40:49.909530+0000","last_clean":"2024-04-19T03:40:49.909530+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:40:49.909530+0000","last_undegraded":"2024-04-19T03:40:49.909530+0000","last_fullsized":"2024-04-19T03:40:49.909530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.909503+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:26.734830+0000","scrub_duration":0.0036995690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":95,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809426+0000","last_change":"2024-04-19T03:35:54.409187+0000","last_active":"2024-04-19T03:39:49.809426+0000","last_peered":"2024-04-19T03:39:49.809426+0000","last_clean":"2024-04-19T03:39:49.809426+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:39:49.809426+0000","last_undegraded":"2024-04-19T03:39:49.809426+0000","last_fullsized":"2024-04-19T03:39:49.809426+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.752557+0000","last_change":"2024-04-19T03:40:08.752671+0000","last_active":"2024-04-19T03:40:08.752557+0000","last_peered":"2024-04-19T03:40:08.752557+0000","last_clean":"2024-04-19T03:40:08.752557+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:40:08.752557+0000","last_undegraded":"2024-04-19T03:40:08.752557+0000","last_fullsized":"2024-04-19T03:40:08.752557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.752529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.556106+0000","scrub_duration":0.002237869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809406+0000","last_change":"2024-04-19T03:39:19.422339+0000","last_active":"2024-04-19T03:39:49.809406+0000","last_peered":"2024-04-19T03:39:49.809406+0000","last_clean":"2024-04-19T03:39:49.809406+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:39:49.809406+0000","last_undegraded":"2024-04-19T03:39:49.809406+0000","last_fullsized":"2024-04-19T03:39:49.809406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.007886+0000","last_change":"2024-04-19T03:41:05.008024+0000","last_active":"2024-04-19T03:41:05.007886+0000","last_peered":"2024-04-19T03:41:05.007886+0000","last_clean":"2024-04-19T03:41:05.007886+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:41:05.007886+0000","last_undegraded":"2024-04-19T03:41:05.007886+0000","last_fullsized":"2024-04-19T03:41:05.007886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_deep_scrub":"93'9","last_deep_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.007859+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:06.070427+0000","scrub_duration":0.003113757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.234200+0000","last_change":"2024-04-19T03:40:12.234200+0000","last_active":"2024-04-19T03:40:12.234200+0000","last_peered":"2024-04-19T03:40:12.234200+0000","last_clean":"2024-04-19T03:40:12.234200+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:40:12.234200+0000","last_undegraded":"2024-04-19T03:40:12.234200+0000","last_fullsized":"2024-04-19T03:40:12.234200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.234048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:52.983795+0000","scrub_duration":0.0021178159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.913833+0000","last_change":"2024-04-19T03:40:42.913932+0000","last_active":"2024-04-19T03:40:42.913833+0000","last_peered":"2024-04-19T03:40:42.913833+0000","last_clean":"2024-04-19T03:40:42.913833+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:40:42.913833+0000","last_undegraded":"2024-04-19T03:40:42.913833+0000","last_fullsized":"2024-04-19T03:40:42.913833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.913809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:11.158157+0000","scrub_duration":0.001532853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"93'159","reported_seq":244,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:52.249409+0000","last_change":"2024-04-19T03:40:52.249553+0000","last_active":"2024-04-19T03:40:52.249409+0000","last_peered":"2024-04-19T03:40:52.249409+0000","last_clean":"2024-04-19T03:40:52.249409+0000","last_became_active":"2024-04-19T03:39:43.438741+0000","last_became_peered":"2024-04-19T03:39:43.438741+0000","last_unstale":"2024-04-19T03:40:52.249409+0000","last_undegraded":"2024-04-19T03:40:52.249409+0000","last_fullsized":"2024-04-19T03:40:52.249409+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'159","last_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_deep_scrub":"93'159","last_deep_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_clean_scrub_stamp":"2024-04-19T03:40:52.249385+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:50.993077+0000","scrub_duration":0.006639893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":126,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.897457+0000","last_change":"2024-04-19T03:40:46.897576+0000","last_active":"2024-04-19T03:40:46.897457+0000","last_peered":"2024-04-19T03:40:46.897457+0000","last_clean":"2024-04-19T03:40:46.897457+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:40:46.897457+0000","last_undegraded":"2024-04-19T03:40:46.897457+0000","last_fullsized":"2024-04-19T03:40:46.897457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'5","last_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_deep_scrub":"93'5","last_deep_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.897430+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:16.596202+0000","scrub_duration":0.0029799929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.247773+0000","last_change":"2024-04-19T03:40:42.247912+0000","last_active":"2024-04-19T03:40:42.247773+0000","last_peered":"2024-04-19T03:40:42.247773+0000","last_clean":"2024-04-19T03:40:42.247773+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:40:42.247773+0000","last_undegraded":"2024-04-19T03:40:42.247773+0000","last_fullsized":"2024-04-19T03:40:42.247773+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8001","last_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_deep_scrub":"70'8001","last_deep_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.247746+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:19.073073+0000","scrub_duration":0.0039554270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.324361+0000","last_change":"2024-04-19T03:40:49.324496+0000","last_active":"2024-04-19T03:40:49.324361+0000","last_peered":"2024-04-19T03:40:49.324361+0000","last_clean":"2024-04-19T03:40:49.324361+0000","last_became_active":"2024-04-19T03:39:43.430609+0000","last_became_peered":"2024-04-19T03:39:43.430609+0000","last_unstale":"2024-04-19T03:40:49.324361+0000","last_undegraded":"2024-04-19T03:40:49.324361+0000","last_fullsized":"2024-04-19T03:40:49.324361+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.324336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:09.713311+0000","scrub_duration":0.0017616750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809495+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:49.809495+0000","last_peered":"2024-04-19T03:39:49.809495+0000","last_clean":"2024-04-19T03:39:49.809495+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:49.809495+0000","last_undegraded":"2024-04-19T03:39:49.809495+0000","last_fullsized":"2024-04-19T03:39:49.809495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:54.705566+0000","last_change":"2024-04-19T03:39:54.705566+0000","last_active":"2024-04-19T03:39:54.705566+0000","last_peered":"2024-04-19T03:39:54.705566+0000","last_clean":"2024-04-19T03:39:54.705566+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:54.705566+0000","last_undegraded":"2024-04-19T03:39:54.705566+0000","last_fullsized":"2024-04-19T03:39:54.705566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_clean_scrub_stamp":"2024-04-19T03:39:54.705417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:50:16.417137+0000","scrub_duration":0.0033800929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.451961+0000","last_change":"2024-04-19T03:40:20.452070+0000","last_active":"2024-04-19T03:40:20.451961+0000","last_peered":"2024-04-19T03:40:20.451961+0000","last_clean":"2024-04-19T03:40:20.451961+0000","last_became_active":"2024-04-19T03:39:43.435880+0000","last_became_peered":"2024-04-19T03:39:43.435880+0000","last_unstale":"2024-04-19T03:40:20.451961+0000","last_undegraded":"2024-04-19T03:40:20.451961+0000","last_fullsized":"2024-04-19T03:40:20.451961+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.451936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:29.525420+0000","scrub_duration":0.0019933870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.857769+0000","last_change":"2024-04-19T03:40:48.857891+0000","last_active":"2024-04-19T03:40:48.857769+0000","last_peered":"2024-04-19T03:40:48.857769+0000","last_clean":"2024-04-19T03:40:48.857769+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:40:48.857769+0000","last_undegraded":"2024-04-19T03:40:48.857769+0000","last_fullsized":"2024-04-19T03:40:48.857769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.857745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:15.620029+0000","scrub_duration":0.0021533479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:56.284062+0000","last_change":"2024-04-19T03:40:56.284196+0000","last_active":"2024-04-19T03:40:56.284062+0000","last_peered":"2024-04-19T03:40:56.284062+0000","last_clean":"2024-04-19T03:40:56.284062+0000","last_became_active":"2024-04-19T03:39:43.436182+0000","last_became_peered":"2024-04-19T03:39:43.436182+0000","last_unstale":"2024-04-19T03:40:56.284062+0000","last_undegraded":"2024-04-19T03:40:56.284062+0000","last_fullsized":"2024-04-19T03:40:56.284062+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_clean_scrub_stamp":"2024-04-19T03:40:56.284017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:50:30.538951+0000","scrub_duration":0.0026653649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":95,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809405+0000","last_change":"2024-04-19T03:35:54.409178+0000","last_active":"2024-04-19T03:39:49.809405+0000","last_peered":"2024-04-19T03:39:49.809405+0000","last_clean":"2024-04-19T03:39:49.809405+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:39:49.809405+0000","last_undegraded":"2024-04-19T03:39:49.809405+0000","last_fullsized":"2024-04-19T03:39:49.809405+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:17.412191+0000","last_change":"2024-04-19T03:40:17.412289+0000","last_active":"2024-04-19T03:40:17.412191+0000","last_peered":"2024-04-19T03:40:17.412191+0000","last_clean":"2024-04-19T03:40:17.412191+0000","last_became_active":"2024-04-19T03:39:43.430100+0000","last_became_peered":"2024-04-19T03:39:43.430100+0000","last_unstale":"2024-04-19T03:40:17.412191+0000","last_undegraded":"2024-04-19T03:40:17.412191+0000","last_fullsized":"2024-04-19T03:40:17.412191+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_clean_scrub_stamp":"2024-04-19T03:40:17.412165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:23.547748+0000","scrub_duration":0.001842256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":109,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.644185+0000","last_change":"2024-04-19T03:39:51.644185+0000","last_active":"2024-04-19T03:39:51.644185+0000","last_peered":"2024-04-19T03:39:51.644185+0000","last_clean":"2024-04-19T03:39:51.644185+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:51.644185+0000","last_undegraded":"2024-04-19T03:39:51.644185+0000","last_fullsized":"2024-04-19T03:39:51.644185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.644015+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:34.517088+0000","scrub_duration":0.0031723060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809427+0000","last_change":"2024-04-19T03:39:19.425888+0000","last_active":"2024-04-19T03:39:49.809427+0000","last_peered":"2024-04-19T03:39:49.809427+0000","last_clean":"2024-04-19T03:39:49.809427+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:39:49.809427+0000","last_undegraded":"2024-04-19T03:39:49.809427+0000","last_fullsized":"2024-04-19T03:39:49.809427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:53.388545+0000","last_clean_scrub_stamp":"2024-04-19T03:35:53.388545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.009918+0000","last_change":"2024-04-19T03:41:07.010082+0000","last_active":"2024-04-19T03:41:07.009918+0000","last_peered":"2024-04-19T03:41:07.009918+0000","last_clean":"2024-04-19T03:41:07.009918+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:41:07.009918+0000","last_undegraded":"2024-04-19T03:41:07.009918+0000","last_fullsized":"2024-04-19T03:41:07.009918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.009894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:02.384210+0000","scrub_duration":0.0020010129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2079,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:41.293688+0000","last_change":"2024-04-19T03:40:41.293806+0000","last_active":"2024-04-19T03:40:41.293688+0000","last_peered":"2024-04-19T03:40:41.293688+0000","last_clean":"2024-04-19T03:40:41.293688+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:40:41.293688+0000","last_undegraded":"2024-04-19T03:40:41.293688+0000","last_fullsized":"2024-04-19T03:40:41.293688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1954","last_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_deep_scrub":"70'1954","last_deep_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_clean_scrub_stamp":"2024-04-19T03:40:41.293661+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:08.055945+0000","scrub_duration":0.0022932429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:06.458430+0000","last_change":"2024-04-19T03:40:06.458556+0000","last_active":"2024-04-19T03:40:06.458430+0000","last_peered":"2024-04-19T03:40:06.458430+0000","last_clean":"2024-04-19T03:40:06.458430+0000","last_became_active":"2024-04-19T03:39:43.434441+0000","last_became_peered":"2024-04-19T03:39:43.434441+0000","last_unstale":"2024-04-19T03:40:06.458430+0000","last_undegraded":"2024-04-19T03:40:06.458430+0000","last_fullsized":"2024-04-19T03:40:06.458430+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_clean_scrub_stamp":"2024-04-19T03:40:06.458408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:59.975433+0000","scrub_duration":0.0018363920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:29.305946+0000","last_change":"2024-04-19T03:40:29.306077+0000","last_active":"2024-04-19T03:40:29.305946+0000","last_peered":"2024-04-19T03:40:29.305946+0000","last_clean":"2024-04-19T03:40:29.305946+0000","last_became_active":"2024-04-19T03:39:43.431591+0000","last_became_peered":"2024-04-19T03:39:43.431591+0000","last_unstale":"2024-04-19T03:40:29.305946+0000","last_undegraded":"2024-04-19T03:40:29.305946+0000","last_fullsized":"2024-04-19T03:40:29.305946+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_clean_scrub_stamp":"2024-04-19T03:40:29.305921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:42.842536+0000","scrub_duration":0.001644497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.325430+0000","last_change":"2024-04-19T03:40:00.325430+0000","last_active":"2024-04-19T03:40:00.325430+0000","last_peered":"2024-04-19T03:40:00.325430+0000","last_clean":"2024-04-19T03:40:00.325430+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:40:00.325430+0000","last_undegraded":"2024-04-19T03:40:00.325430+0000","last_fullsized":"2024-04-19T03:40:00.325430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.325262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:24.128839+0000","scrub_duration":0.0024403659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809604+0000","last_change":"2024-04-19T03:39:19.428118+0000","last_active":"2024-04-19T03:39:49.809604+0000","last_peered":"2024-04-19T03:39:49.809604+0000","last_clean":"2024-04-19T03:39:49.809604+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:39:49.809604+0000","last_undegraded":"2024-04-19T03:39:49.809604+0000","last_fullsized":"2024-04-19T03:39:49.809604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:57.365883+0000","last_change":"2024-04-19T03:40:57.365883+0000","last_active":"2024-04-19T03:40:57.365883+0000","last_peered":"2024-04-19T03:40:57.365883+0000","last_clean":"2024-04-19T03:40:57.365883+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:40:57.365883+0000","last_undegraded":"2024-04-19T03:40:57.365883+0000","last_fullsized":"2024-04-19T03:40:57.365883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2056","last_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_deep_scrub":"70'2056","last_deep_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_clean_scrub_stamp":"2024-04-19T03:40:57.365740+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:52.740055+0000","scrub_duration":0.0029402849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"93'3","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.315273+0000","last_change":"2024-04-19T03:40:54.315420+0000","last_active":"2024-04-19T03:40:54.315273+0000","last_peered":"2024-04-19T03:40:54.315273+0000","last_clean":"2024-04-19T03:40:54.315273+0000","last_became_active":"2024-04-19T03:39:43.430259+0000","last_became_peered":"2024-04-19T03:39:43.430259+0000","last_unstale":"2024-04-19T03:40:54.315273+0000","last_undegraded":"2024-04-19T03:40:54.315273+0000","last_fullsized":"2024-04-19T03:40:54.315273+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.315248+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:42.599141+0000","scrub_duration":0.003634445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2099,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:55.535916+0000","last_change":"2024-04-19T03:39:55.536049+0000","last_active":"2024-04-19T03:39:55.535916+0000","last_peered":"2024-04-19T03:39:55.535916+0000","last_clean":"2024-04-19T03:39:55.535916+0000","last_became_active":"2024-04-19T03:39:43.430703+0000","last_became_peered":"2024-04-19T03:39:43.430703+0000","last_unstale":"2024-04-19T03:39:55.535916+0000","last_undegraded":"2024-04-19T03:39:55.535916+0000","last_fullsized":"2024-04-19T03:39:55.535916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2000","last_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_deep_scrub":"70'2000","last_deep_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_clean_scrub_stamp":"2024-04-19T03:39:55.535891+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:22.625053+0000","scrub_duration":0.002398659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.300397+0000","last_change":"2024-04-19T03:40:46.300397+0000","last_active":"2024-04-19T03:40:46.300397+0000","last_peered":"2024-04-19T03:40:46.300397+0000","last_clean":"2024-04-19T03:40:46.300397+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:40:46.300397+0000","last_undegraded":"2024-04-19T03:40:46.300397+0000","last_fullsized":"2024-04-19T03:40:46.300397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.300234+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:31.841726+0000","scrub_duration":0.0033879449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:26.383401+0000","last_change":"2024-04-19T03:40:26.383543+0000","last_active":"2024-04-19T03:40:26.383401+0000","last_peered":"2024-04-19T03:40:26.383401+0000","last_clean":"2024-04-19T03:40:26.383401+0000","last_became_active":"2024-04-19T03:39:43.433233+0000","last_became_peered":"2024-04-19T03:39:43.433233+0000","last_unstale":"2024-04-19T03:40:26.383401+0000","last_undegraded":"2024-04-19T03:40:26.383401+0000","last_fullsized":"2024-04-19T03:40:26.383401+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'7","last_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_deep_scrub":"70'7","last_deep_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_clean_scrub_stamp":"2024-04-19T03:40:26.383375+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:52.425413+0000","scrub_duration":0.0024732740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.608048+0000","last_change":"2024-04-19T03:40:18.608178+0000","last_active":"2024-04-19T03:40:18.608048+0000","last_peered":"2024-04-19T03:40:18.608048+0000","last_clean":"2024-04-19T03:40:18.608048+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:40:18.608048+0000","last_undegraded":"2024-04-19T03:40:18.608048+0000","last_fullsized":"2024-04-19T03:40:18.608048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.608004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:12.037760+0000","scrub_duration":0.0019643289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809809+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:49.809809+0000","last_peered":"2024-04-19T03:39:49.809809+0000","last_clean":"2024-04-19T03:39:49.809809+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:49.809809+0000","last_undegraded":"2024-04-19T03:39:49.809809+0000","last_fullsized":"2024-04-19T03:39:49.809809+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.706465+0000","last_change":"2024-04-19T03:40:12.706465+0000","last_active":"2024-04-19T03:40:12.706465+0000","last_peered":"2024-04-19T03:40:12.706465+0000","last_clean":"2024-04-19T03:40:12.706465+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:40:12.706465+0000","last_undegraded":"2024-04-19T03:40:12.706465+0000","last_fullsized":"2024-04-19T03:40:12.706465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'6","last_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_deep_scrub":"93'6","last_deep_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.706336+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:55.113200+0000","scrub_duration":0.0042115119999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.337533+0000","last_change":"2024-04-19T03:41:05.337639+0000","last_active":"2024-04-19T03:41:05.337533+0000","last_peered":"2024-04-19T03:41:05.337533+0000","last_clean":"2024-04-19T03:41:05.337533+0000","last_became_active":"2024-04-19T03:39:43.435662+0000","last_became_peered":"2024-04-19T03:39:43.435662+0000","last_unstale":"2024-04-19T03:41:05.337533+0000","last_undegraded":"2024-04-19T03:41:05.337533+0000","last_fullsized":"2024-04-19T03:41:05.337533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.337507+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:19.212270+0000","scrub_duration":0.0024382739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.337417+0000","last_change":"2024-04-19T03:40:27.337549+0000","last_active":"2024-04-19T03:40:27.337417+0000","last_peered":"2024-04-19T03:40:27.337417+0000","last_clean":"2024-04-19T03:40:27.337417+0000","last_became_active":"2024-04-19T03:39:43.433006+0000","last_became_peered":"2024-04-19T03:39:43.433006+0000","last_unstale":"2024-04-19T03:40:27.337417+0000","last_undegraded":"2024-04-19T03:40:27.337417+0000","last_fullsized":"2024-04-19T03:40:27.337417+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.337390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:10.033965+0000","scrub_duration":0.0023860370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368576+0000","last_change":"2024-04-19T03:35:59.883016+0000","last_active":"2024-04-19T03:39:50.368576+0000","last_peered":"2024-04-19T03:39:50.368576+0000","last_clean":"2024-04-19T03:39:50.368576+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:39:50.368576+0000","last_undegraded":"2024-04-19T03:39:50.368576+0000","last_fullsized":"2024-04-19T03:39:50.368576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2090,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809882+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:49.809882+0000","last_peered":"2024-04-19T03:39:49.809882+0000","last_clean":"2024-04-19T03:39:49.809882+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:49.809882+0000","last_undegraded":"2024-04-19T03:39:49.809882+0000","last_fullsized":"2024-04-19T03:39:49.809882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368581+0000","last_change":"2024-04-19T03:35:59.882408+0000","last_active":"2024-04-19T03:39:50.368581+0000","last_peered":"2024-04-19T03:39:50.368581+0000","last_clean":"2024-04-19T03:39:50.368581+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:39:50.368581+0000","last_undegraded":"2024-04-19T03:39:50.368581+0000","last_fullsized":"2024-04-19T03:39:50.368581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.185614+0000","last_change":"2024-04-19T03:40:35.185736+0000","last_active":"2024-04-19T03:40:35.185614+0000","last_peered":"2024-04-19T03:40:35.185614+0000","last_clean":"2024-04-19T03:40:35.185614+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:40:35.185614+0000","last_undegraded":"2024-04-19T03:40:35.185614+0000","last_fullsized":"2024-04-19T03:40:35.185614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2053","last_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_deep_scrub":"70'2053","last_deep_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.185586+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:03.429934+0000","scrub_duration":0.0023438479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481816,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1652,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1691648,"data_stored":1258390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri Apr 19 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369840,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002000,"statfs":{"total":96636764160,"available":96258048000,"internally_reserved":0,"allocated":1679360,"data_stored":1257168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:41:08 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.42899999999999999},"min":{"1min":0.33100000000000002,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.622,"5min":1.087,"15min":1.087},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.58999999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.432}]},{"osd":2,"last update":"Fri Apr 19 03:40:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.48199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":790528,"data_stored":382380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:41:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.45100000000000001},"min":{"1min":0.28899999999999998,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58799999999999997,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.497},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.60599999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Apr 19 03:40:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:41:13.007 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.007 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.007 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.007 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.007 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.008 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.008 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.008 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.008 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.008 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.008 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.008 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.008 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.009 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.009 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.009 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.009 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.009 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.010 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.010 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.010 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.010 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-19T03:35:53.388545+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=53, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.010 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.010 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.011 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.011 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.011 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:13.011 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:41:33.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:41:33.396 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:41:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:41:33.406 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-04-19T03:41:32.363238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115826,"ondisk_log_size":115826,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795896,"kb_used_data":4064,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319624,"statfs":{"total":289910292480,"available":289095294976,"internally_reserved":0,"allocated":4161536,"data_stored":2897938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003345"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2069,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810082+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:49.810082+0000","last_peered":"2024-04-19T03:39:49.810082+0000","last_clean":"2024-04-19T03:39:49.810082+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:49.810082+0000","last_undegraded":"2024-04-19T03:39:49.810082+0000","last_fullsized":"2024-04-19T03:39:49.810082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":94,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810084+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:49.810084+0000","last_peered":"2024-04-19T03:39:49.810084+0000","last_clean":"2024-04-19T03:39:49.810084+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:49.810084+0000","last_undegraded":"2024-04-19T03:39:49.810084+0000","last_fullsized":"2024-04-19T03:39:49.810084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4093,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:28.291061+0000","last_change":"2024-04-19T03:40:28.291061+0000","last_active":"2024-04-19T03:40:28.291061+0000","last_peered":"2024-04-19T03:40:28.291061+0000","last_clean":"2024-04-19T03:40:28.291061+0000","last_became_active":"2024-04-19T03:39:43.437251+0000","last_became_peered":"2024-04-19T03:39:43.437251+0000","last_unstale":"2024-04-19T03:40:28.291061+0000","last_undegraded":"2024-04-19T03:40:28.291061+0000","last_fullsized":"2024-04-19T03:40:28.291061+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3993","last_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_deep_scrub":"70'3993","last_deep_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_clean_scrub_stamp":"2024-04-19T03:40:28.290885+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:17.123063+0000","scrub_duration":0.0023123509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.425893+0000","last_change":"2024-04-19T03:40:04.425893+0000","last_active":"2024-04-19T03:40:04.425893+0000","last_peered":"2024-04-19T03:40:04.425893+0000","last_clean":"2024-04-19T03:40:04.425893+0000","last_became_active":"2024-04-19T03:39:43.434583+0000","last_became_peered":"2024-04-19T03:39:43.434583+0000","last_unstale":"2024-04-19T03:40:04.425893+0000","last_undegraded":"2024-04-19T03:40:04.425893+0000","last_fullsized":"2024-04-19T03:40:04.425893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.425751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:07.588193+0000","scrub_duration":0.002196057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:50.306704+0000","last_change":"2024-04-19T03:40:50.306704+0000","last_active":"2024-04-19T03:40:50.306704+0000","last_peered":"2024-04-19T03:40:50.306704+0000","last_clean":"2024-04-19T03:40:50.306704+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:40:50.306704+0000","last_undegraded":"2024-04-19T03:40:50.306704+0000","last_fullsized":"2024-04-19T03:40:50.306704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2051","last_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_deep_scrub":"70'2051","last_deep_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_clean_scrub_stamp":"2024-04-19T03:40:50.306544+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:45.676931+0000","scrub_duration":0.0035400869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:47.306345+0000","last_change":"2024-04-19T03:40:47.306484+0000","last_active":"2024-04-19T03:40:47.306345+0000","last_peered":"2024-04-19T03:40:47.306345+0000","last_clean":"2024-04-19T03:40:47.306345+0000","last_became_active":"2024-04-19T03:39:43.429508+0000","last_became_peered":"2024-04-19T03:39:43.429508+0000","last_unstale":"2024-04-19T03:40:47.306345+0000","last_undegraded":"2024-04-19T03:40:47.306345+0000","last_fullsized":"2024-04-19T03:40:47.306345+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_clean_scrub_stamp":"2024-04-19T03:40:47.306304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:24.288058+0000","scrub_duration":0.0027027560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.363796+0000","last_change":"2024-04-19T03:40:32.363907+0000","last_active":"2024-04-19T03:40:32.363796+0000","last_peered":"2024-04-19T03:40:32.363796+0000","last_clean":"2024-04-19T03:40:32.363796+0000","last_became_active":"2024-04-19T03:39:43.428726+0000","last_became_peered":"2024-04-19T03:39:43.428726+0000","last_unstale":"2024-04-19T03:40:32.363796+0000","last_undegraded":"2024-04-19T03:40:32.363796+0000","last_fullsized":"2024-04-19T03:40:32.363796+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.363768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:55:49.483155+0000","scrub_duration":0.0027930099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8140,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:03.416041+0000","last_change":"2024-04-19T03:40:03.416142+0000","last_active":"2024-04-19T03:40:03.416041+0000","last_peered":"2024-04-19T03:40:03.416041+0000","last_clean":"2024-04-19T03:40:03.416041+0000","last_became_active":"2024-04-19T03:39:43.433063+0000","last_became_peered":"2024-04-19T03:39:43.433063+0000","last_unstale":"2024-04-19T03:40:03.416041+0000","last_undegraded":"2024-04-19T03:40:03.416041+0000","last_fullsized":"2024-04-19T03:40:03.416041+0000","mapping_epoch":92,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8029","last_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_deep_scrub":"70'8029","last_deep_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_clean_scrub_stamp":"2024-04-19T03:40:03.416008+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:39.795688+0000","scrub_duration":0.002564808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368679+0000","last_change":"2024-04-19T03:35:59.885647+0000","last_active":"2024-04-19T03:39:50.368679+0000","last_peered":"2024-04-19T03:39:50.368679+0000","last_clean":"2024-04-19T03:39:50.368679+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:39:50.368679+0000","last_undegraded":"2024-04-19T03:39:50.368679+0000","last_fullsized":"2024-04-19T03:39:50.368679+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6176,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810003+0000","last_change":"2024-04-19T03:35:59.881326+0000","last_active":"2024-04-19T03:39:49.810003+0000","last_peered":"2024-04-19T03:39:49.810003+0000","last_clean":"2024-04-19T03:39:49.810003+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:39:49.810003+0000","last_undegraded":"2024-04-19T03:39:49.810003+0000","last_fullsized":"2024-04-19T03:39:49.810003+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4038,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:21.433541+0000","last_change":"2024-04-19T03:40:21.433640+0000","last_active":"2024-04-19T03:40:21.433541+0000","last_peered":"2024-04-19T03:40:21.433541+0000","last_clean":"2024-04-19T03:40:21.433541+0000","last_became_active":"2024-04-19T03:39:43.431742+0000","last_became_peered":"2024-04-19T03:39:43.431742+0000","last_unstale":"2024-04-19T03:40:21.433541+0000","last_undegraded":"2024-04-19T03:40:21.433541+0000","last_fullsized":"2024-04-19T03:40:21.433541+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3939","last_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_deep_scrub":"70'3939","last_deep_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_clean_scrub_stamp":"2024-04-19T03:40:21.433514+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:57.721359+0000","scrub_duration":0.0025512870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810017+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:49.810017+0000","last_peered":"2024-04-19T03:39:49.810017+0000","last_clean":"2024-04-19T03:39:49.810017+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:49.810017+0000","last_undegraded":"2024-04-19T03:39:49.810017+0000","last_fullsized":"2024-04-19T03:39:49.810017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2082,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810035+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:49.810035+0000","last_peered":"2024-04-19T03:39:49.810035+0000","last_clean":"2024-04-19T03:39:49.810035+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:49.810035+0000","last_undegraded":"2024-04-19T03:39:49.810035+0000","last_fullsized":"2024-04-19T03:39:49.810035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2171,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:14.424937+0000","last_change":"2024-04-19T03:40:14.425058+0000","last_active":"2024-04-19T03:40:14.424937+0000","last_peered":"2024-04-19T03:40:14.424937+0000","last_clean":"2024-04-19T03:40:14.424937+0000","last_became_active":"2024-04-19T03:39:43.435748+0000","last_became_peered":"2024-04-19T03:39:43.435748+0000","last_unstale":"2024-04-19T03:40:14.424937+0000","last_undegraded":"2024-04-19T03:40:14.424937+0000","last_fullsized":"2024-04-19T03:40:14.424937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2072","last_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_deep_scrub":"70'2072","last_deep_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_clean_scrub_stamp":"2024-04-19T03:40:14.424896+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:23.898309+0000","scrub_duration":0.0031291729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2124,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:31.388443+0000","last_change":"2024-04-19T03:40:31.388574+0000","last_active":"2024-04-19T03:40:31.388443+0000","last_peered":"2024-04-19T03:40:31.388443+0000","last_clean":"2024-04-19T03:40:31.388443+0000","last_became_active":"2024-04-19T03:39:43.430447+0000","last_became_peered":"2024-04-19T03:39:43.430447+0000","last_unstale":"2024-04-19T03:40:31.388443+0000","last_undegraded":"2024-04-19T03:40:31.388443+0000","last_fullsized":"2024-04-19T03:40:31.388443+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2025","last_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_deep_scrub":"70'2025","last_deep_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_clean_scrub_stamp":"2024-04-19T03:40:31.388419+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:12.219961+0000","scrub_duration":0.0023057400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:55.327799+0000","last_change":"2024-04-19T03:40:55.327902+0000","last_active":"2024-04-19T03:40:55.327799+0000","last_peered":"2024-04-19T03:40:55.327799+0000","last_clean":"2024-04-19T03:40:55.327799+0000","last_became_active":"2024-04-19T03:39:43.433748+0000","last_became_peered":"2024-04-19T03:39:43.433748+0000","last_unstale":"2024-04-19T03:40:55.327799+0000","last_undegraded":"2024-04-19T03:40:55.327799+0000","last_fullsized":"2024-04-19T03:40:55.327799+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2002","last_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_deep_scrub":"70'2002","last_deep_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_clean_scrub_stamp":"2024-04-19T03:40:55.327775+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:08:48.213870+0000","scrub_duration":0.0026441490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2069,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368633+0000","last_change":"2024-04-19T03:35:59.885523+0000","last_active":"2024-04-19T03:39:50.368633+0000","last_peered":"2024-04-19T03:39:50.368633+0000","last_clean":"2024-04-19T03:39:50.368633+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:39:50.368633+0000","last_undegraded":"2024-04-19T03:39:50.368633+0000","last_fullsized":"2024-04-19T03:39:50.368633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809995+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:49.809995+0000","last_peered":"2024-04-19T03:39:49.809995+0000","last_clean":"2024-04-19T03:39:49.809995+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:49.809995+0000","last_undegraded":"2024-04-19T03:39:49.809995+0000","last_fullsized":"2024-04-19T03:39:49.809995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4141,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.368638+0000","last_change":"2024-04-19T03:35:59.882832+0000","last_active":"2024-04-19T03:39:50.368638+0000","last_peered":"2024-04-19T03:39:50.368638+0000","last_clean":"2024-04-19T03:39:50.368638+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:39:50.368638+0000","last_undegraded":"2024-04-19T03:39:50.368638+0000","last_fullsized":"2024-04-19T03:39:50.368638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4185,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.399718+0000","last_change":"2024-04-19T03:40:35.399826+0000","last_active":"2024-04-19T03:40:35.399718+0000","last_peered":"2024-04-19T03:40:35.399718+0000","last_clean":"2024-04-19T03:40:35.399718+0000","last_became_active":"2024-04-19T03:39:43.431899+0000","last_became_peered":"2024-04-19T03:39:43.431899+0000","last_unstale":"2024-04-19T03:40:35.399718+0000","last_undegraded":"2024-04-19T03:40:35.399718+0000","last_fullsized":"2024-04-19T03:40:35.399718+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4086","last_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_deep_scrub":"70'4086","last_deep_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.399694+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:10.836662+0000","scrub_duration":0.0025555930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:07.410632+0000","last_change":"2024-04-19T03:40:07.410737+0000","last_active":"2024-04-19T03:40:07.410632+0000","last_peered":"2024-04-19T03:40:07.410632+0000","last_clean":"2024-04-19T03:40:07.410632+0000","last_became_active":"2024-04-19T03:39:43.431732+0000","last_became_peered":"2024-04-19T03:39:43.431732+0000","last_unstale":"2024-04-19T03:40:07.410632+0000","last_undegraded":"2024-04-19T03:40:07.410632+0000","last_fullsized":"2024-04-19T03:40:07.410632+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'11","last_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_deep_scrub":"70'11","last_deep_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_clean_scrub_stamp":"2024-04-19T03:40:07.410606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:58.262646+0000","scrub_duration":0.0023107370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.207298+0000","last_change":"2024-04-19T03:41:07.207411+0000","last_active":"2024-04-19T03:41:07.207298+0000","last_peered":"2024-04-19T03:41:07.207298+0000","last_clean":"2024-04-19T03:41:07.207298+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:41:07.207298+0000","last_undegraded":"2024-04-19T03:41:07.207298+0000","last_fullsized":"2024-04-19T03:41:07.207298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.207263+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:15:12.629847+0000","scrub_duration":0.0031871450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:28.039679+0000","last_change":"2024-04-19T03:41:28.039806+0000","last_active":"2024-04-19T03:41:28.039679+0000","last_peered":"2024-04-19T03:41:28.039679+0000","last_clean":"2024-04-19T03:41:28.039679+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:41:28.039679+0000","last_undegraded":"2024-04-19T03:41:28.039679+0000","last_fullsized":"2024-04-19T03:41:28.039679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2044","last_scrub_stamp":"2024-04-19T03:41:28.039638+0000","last_deep_scrub":"70'2044","last_deep_scrub_stamp":"2024-04-19T03:41:28.039638+0000","last_clean_scrub_stamp":"2024-04-19T03:41:28.039638+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:46.663635+0000","scrub_duration":0.0029199209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.134428+0000","last_change":"2024-04-19T03:40:32.134573+0000","last_active":"2024-04-19T03:40:32.134428+0000","last_peered":"2024-04-19T03:40:32.134428+0000","last_clean":"2024-04-19T03:40:32.134428+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:40:32.134428+0000","last_undegraded":"2024-04-19T03:40:32.134428+0000","last_fullsized":"2024-04-19T03:40:32.134428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4021","last_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_deep_scrub":"70'4021","last_deep_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.134399+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:06.376575+0000","scrub_duration":0.0035905770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.324323+0000","last_change":"2024-04-19T03:40:04.324323+0000","last_active":"2024-04-19T03:40:04.324323+0000","last_peered":"2024-04-19T03:40:04.324323+0000","last_clean":"2024-04-19T03:40:04.324323+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:40:04.324323+0000","last_undegraded":"2024-04-19T03:40:04.324323+0000","last_fullsized":"2024-04-19T03:40:04.324323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1983","last_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_deep_scrub":"70'1983","last_deep_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.324180+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:46.731044+0000","scrub_duration":0.0027598010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:22.035905+0000","last_change":"2024-04-19T03:41:22.036031+0000","last_active":"2024-04-19T03:41:22.035905+0000","last_peered":"2024-04-19T03:41:22.035905+0000","last_clean":"2024-04-19T03:41:22.035905+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:41:22.035905+0000","last_undegraded":"2024-04-19T03:41:22.035905+0000","last_fullsized":"2024-04-19T03:41:22.035905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:41:22.035877+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:41:22.035877+0000","last_clean_scrub_stamp":"2024-04-19T03:41:22.035877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:30.669594+0000","scrub_duration":0.002404804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:52.486333+0000","last_change":"2024-04-19T03:39:52.486333+0000","last_active":"2024-04-19T03:39:52.486333+0000","last_peered":"2024-04-19T03:39:52.486333+0000","last_clean":"2024-04-19T03:39:52.486333+0000","last_became_active":"2024-04-19T03:39:43.437065+0000","last_became_peered":"2024-04-19T03:39:43.437065+0000","last_unstale":"2024-04-19T03:39:52.486333+0000","last_undegraded":"2024-04-19T03:39:52.486333+0000","last_fullsized":"2024-04-19T03:39:52.486333+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2028","last_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_deep_scrub":"70'2028","last_deep_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_clean_scrub_stamp":"2024-04-19T03:39:52.486195+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:49.821209+0000","scrub_duration":0.0024754260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":92,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809578+0000","last_change":"2024-04-19T03:35:59.432958+0000","last_active":"2024-04-19T03:39:49.809578+0000","last_peered":"2024-04-19T03:39:49.809578+0000","last_clean":"2024-04-19T03:39:49.809578+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:39:49.809578+0000","last_undegraded":"2024-04-19T03:39:49.809578+0000","last_fullsized":"2024-04-19T03:39:49.809578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":129,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:22.199937+0000","last_change":"2024-04-19T03:40:22.199937+0000","last_active":"2024-04-19T03:40:22.199937+0000","last_peered":"2024-04-19T03:40:22.199937+0000","last_clean":"2024-04-19T03:40:22.199937+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:40:22.199937+0000","last_undegraded":"2024-04-19T03:40:22.199937+0000","last_fullsized":"2024-04-19T03:40:22.199937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_clean_scrub_stamp":"2024-04-19T03:40:22.199728+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:08:02.693048+0000","scrub_duration":0.0026297960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.760857+0000","last_change":"2024-04-19T03:40:32.760857+0000","last_active":"2024-04-19T03:40:32.760857+0000","last_peered":"2024-04-19T03:40:32.760857+0000","last_clean":"2024-04-19T03:40:32.760857+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:40:32.760857+0000","last_undegraded":"2024-04-19T03:40:32.760857+0000","last_fullsized":"2024-04-19T03:40:32.760857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.760689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:48.412394+0000","scrub_duration":0.001792664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.970065+0000","last_change":"2024-04-19T03:41:17.970164+0000","last_active":"2024-04-19T03:41:17.970065+0000","last_peered":"2024-04-19T03:41:17.970065+0000","last_clean":"2024-04-19T03:41:17.970065+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:41:17.970065+0000","last_undegraded":"2024-04-19T03:41:17.970065+0000","last_fullsized":"2024-04-19T03:41:17.970065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:41:17.970042+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:41:17.970042+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.970042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:30.160406+0000","scrub_duration":0.0029412599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.857512+0000","last_change":"2024-04-19T03:40:39.857512+0000","last_active":"2024-04-19T03:40:39.857512+0000","last_peered":"2024-04-19T03:40:39.857512+0000","last_clean":"2024-04-19T03:40:39.857512+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:40:39.857512+0000","last_undegraded":"2024-04-19T03:40:39.857512+0000","last_fullsized":"2024-04-19T03:40:39.857512+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.857367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:14.099544+0000","scrub_duration":0.0016111649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.287222+0000","last_change":"2024-04-19T03:40:39.287366+0000","last_active":"2024-04-19T03:40:39.287222+0000","last_peered":"2024-04-19T03:40:39.287222+0000","last_clean":"2024-04-19T03:40:39.287222+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:40:39.287222+0000","last_undegraded":"2024-04-19T03:40:39.287222+0000","last_fullsized":"2024-04-19T03:40:39.287222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.287191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:08.985963+0000","scrub_duration":0.0020786289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.690988+0000","last_change":"2024-04-19T03:40:27.690988+0000","last_active":"2024-04-19T03:40:27.690988+0000","last_peered":"2024-04-19T03:40:27.690988+0000","last_clean":"2024-04-19T03:40:27.690988+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:40:27.690988+0000","last_undegraded":"2024-04-19T03:40:27.690988+0000","last_fullsized":"2024-04-19T03:40:27.690988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.690844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:32.347176+0000","scrub_duration":0.001791932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:59.727483+0000","last_change":"2024-04-19T03:39:59.727483+0000","last_active":"2024-04-19T03:39:59.727483+0000","last_peered":"2024-04-19T03:39:59.727483+0000","last_clean":"2024-04-19T03:39:59.727483+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:59.727483+0000","last_undegraded":"2024-04-19T03:39:59.727483+0000","last_fullsized":"2024-04-19T03:39:59.727483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_clean_scrub_stamp":"2024-04-19T03:39:59.727297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:17.092087+0000","scrub_duration":0.0035426419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:25.393482+0000","last_change":"2024-04-19T03:40:25.393587+0000","last_active":"2024-04-19T03:40:25.393482+0000","last_peered":"2024-04-19T03:40:25.393482+0000","last_clean":"2024-04-19T03:40:25.393482+0000","last_became_active":"2024-04-19T03:39:43.429210+0000","last_became_peered":"2024-04-19T03:39:43.429210+0000","last_unstale":"2024-04-19T03:40:25.393482+0000","last_undegraded":"2024-04-19T03:40:25.393482+0000","last_fullsized":"2024-04-19T03:40:25.393482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_clean_scrub_stamp":"2024-04-19T03:40:25.393456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:41.962081+0000","scrub_duration":0.002168045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:16.670035+0000","last_change":"2024-04-19T03:40:16.670035+0000","last_active":"2024-04-19T03:40:16.670035+0000","last_peered":"2024-04-19T03:40:16.670035+0000","last_clean":"2024-04-19T03:40:16.670035+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:40:16.670035+0000","last_undegraded":"2024-04-19T03:40:16.670035+0000","last_fullsized":"2024-04-19T03:40:16.670035+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5950","last_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_deep_scrub":"70'5950","last_deep_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_clean_scrub_stamp":"2024-04-19T03:40:16.669845+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:00.796011+0000","scrub_duration":0.0029482610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"70'6","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809582+0000","last_change":"2024-04-19T03:39:19.430254+0000","last_active":"2024-04-19T03:39:49.809582+0000","last_peered":"2024-04-19T03:39:49.809582+0000","last_clean":"2024-04-19T03:39:49.809582+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:39:49.809582+0000","last_undegraded":"2024-04-19T03:39:49.809582+0000","last_fullsized":"2024-04-19T03:39:49.809582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.615150+0000","last_change":"2024-04-19T03:40:20.615150+0000","last_active":"2024-04-19T03:40:20.615150+0000","last_peered":"2024-04-19T03:40:20.615150+0000","last_clean":"2024-04-19T03:40:20.615150+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:40:20.615150+0000","last_undegraded":"2024-04-19T03:40:20.615150+0000","last_fullsized":"2024-04-19T03:40:20.615150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4063","last_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_deep_scrub":"70'4063","last_deep_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.614982+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:01.364729+0000","scrub_duration":0.003172963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"93'99","reported_seq":69,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.346102+0000","last_change":"2024-04-19T03:40:48.346209+0000","last_active":"2024-04-19T03:40:48.346102+0000","last_peered":"2024-04-19T03:40:48.346102+0000","last_clean":"2024-04-19T03:40:48.346102+0000","last_became_active":"2024-04-19T03:39:43.437298+0000","last_became_peered":"2024-04-19T03:39:43.437298+0000","last_unstale":"2024-04-19T03:40:48.346102+0000","last_undegraded":"2024-04-19T03:40:48.346102+0000","last_fullsized":"2024-04-19T03:40:48.346102+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'99","last_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_deep_scrub":"93'99","last_deep_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.346076+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:13.038605+0000","scrub_duration":0.007204322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4182,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:40.440866+0000","last_change":"2024-04-19T03:40:40.440980+0000","last_active":"2024-04-19T03:40:40.440866+0000","last_peered":"2024-04-19T03:40:40.440866+0000","last_clean":"2024-04-19T03:40:40.440866+0000","last_became_active":"2024-04-19T03:39:43.434605+0000","last_became_peered":"2024-04-19T03:39:43.434605+0000","last_unstale":"2024-04-19T03:40:40.440866+0000","last_undegraded":"2024-04-19T03:40:40.440866+0000","last_fullsized":"2024-04-19T03:40:40.440866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4083","last_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_deep_scrub":"70'4083","last_deep_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_clean_scrub_stamp":"2024-04-19T03:40:40.440842+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:45.344854+0000","scrub_duration":0.0025970279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"93'4","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.460389+0000","last_change":"2024-04-19T03:40:42.460494+0000","last_active":"2024-04-19T03:40:42.460389+0000","last_peered":"2024-04-19T03:40:42.460389+0000","last_clean":"2024-04-19T03:40:42.460389+0000","last_became_active":"2024-04-19T03:39:43.431842+0000","last_became_peered":"2024-04-19T03:39:43.431842+0000","last_unstale":"2024-04-19T03:40:42.460389+0000","last_undegraded":"2024-04-19T03:40:42.460389+0000","last_fullsized":"2024-04-19T03:40:42.460389+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.460363+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:49.733129+0000","scrub_duration":0.003431403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2076,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.285715+0000","last_change":"2024-04-19T03:40:08.285715+0000","last_active":"2024-04-19T03:40:08.285715+0000","last_peered":"2024-04-19T03:40:08.285715+0000","last_clean":"2024-04-19T03:40:08.285715+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:40:08.285715+0000","last_undegraded":"2024-04-19T03:40:08.285715+0000","last_fullsized":"2024-04-19T03:40:08.285715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1975","last_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_deep_scrub":"70'1975","last_deep_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.285526+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:52.411692+0000","scrub_duration":0.0032122520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:11.030687+0000","last_change":"2024-04-19T03:41:11.030803+0000","last_active":"2024-04-19T03:41:11.030687+0000","last_peered":"2024-04-19T03:41:11.030687+0000","last_clean":"2024-04-19T03:41:11.030687+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:41:11.030687+0000","last_undegraded":"2024-04-19T03:41:11.030687+0000","last_fullsized":"2024-04-19T03:41:11.030687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:11.030662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:11.030662+0000","last_clean_scrub_stamp":"2024-04-19T03:41:11.030662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:29.251141+0000","scrub_duration":0.0017162169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:11.249784+0000","last_change":"2024-04-19T03:40:11.249784+0000","last_active":"2024-04-19T03:40:11.249784+0000","last_peered":"2024-04-19T03:40:11.249784+0000","last_clean":"2024-04-19T03:40:11.249784+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:40:11.249784+0000","last_undegraded":"2024-04-19T03:40:11.249784+0000","last_fullsized":"2024-04-19T03:40:11.249784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2033","last_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_deep_scrub":"70'2033","last_deep_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_clean_scrub_stamp":"2024-04-19T03:40:11.249632+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:04.679387+0000","scrub_duration":0.0039095689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:58.391315+0000","last_change":"2024-04-19T03:40:58.391420+0000","last_active":"2024-04-19T03:40:58.391315+0000","last_peered":"2024-04-19T03:40:58.391315+0000","last_clean":"2024-04-19T03:40:58.391315+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:40:58.391315+0000","last_undegraded":"2024-04-19T03:40:58.391315+0000","last_fullsized":"2024-04-19T03:40:58.391315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_clean_scrub_stamp":"2024-04-19T03:40:58.391280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:42.335959+0000","scrub_duration":0.001857837,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:30.761230+0000","last_change":"2024-04-19T03:40:30.761230+0000","last_active":"2024-04-19T03:40:30.761230+0000","last_peered":"2024-04-19T03:40:30.761230+0000","last_clean":"2024-04-19T03:40:30.761230+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:40:30.761230+0000","last_undegraded":"2024-04-19T03:40:30.761230+0000","last_fullsized":"2024-04-19T03:40:30.761230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'10","last_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_deep_scrub":"70'10","last_deep_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_clean_scrub_stamp":"2024-04-19T03:40:30.761100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:51.151497+0000","scrub_duration":0.0024608220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"93'13","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.342259+0000","last_change":"2024-04-19T03:40:33.342391+0000","last_active":"2024-04-19T03:40:33.342259+0000","last_peered":"2024-04-19T03:40:33.342259+0000","last_clean":"2024-04-19T03:40:33.342259+0000","last_became_active":"2024-04-19T03:39:43.436291+0000","last_became_peered":"2024-04-19T03:39:43.436291+0000","last_unstale":"2024-04-19T03:40:33.342259+0000","last_undegraded":"2024-04-19T03:40:33.342259+0000","last_fullsized":"2024-04-19T03:40:33.342259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'13","last_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_deep_scrub":"93'13","last_deep_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.342214+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:39:21.052990+0000","scrub_duration":0.0050089979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2219,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.743742+0000","last_change":"2024-04-19T03:40:33.743742+0000","last_active":"2024-04-19T03:40:33.743742+0000","last_peered":"2024-04-19T03:40:33.743742+0000","last_clean":"2024-04-19T03:40:33.743742+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:40:33.743742+0000","last_undegraded":"2024-04-19T03:40:33.743742+0000","last_fullsized":"2024-04-19T03:40:33.743742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2095","last_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_deep_scrub":"70'2095","last_deep_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.743609+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:30.726079+0000","scrub_duration":0.0029003269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"93'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.429095+0000","last_change":"2024-04-19T03:40:08.429204+0000","last_active":"2024-04-19T03:40:08.429095+0000","last_peered":"2024-04-19T03:40:08.429095+0000","last_clean":"2024-04-19T03:40:08.429095+0000","last_became_active":"2024-04-19T03:39:43.431751+0000","last_became_peered":"2024-04-19T03:39:43.431751+0000","last_unstale":"2024-04-19T03:40:08.429095+0000","last_undegraded":"2024-04-19T03:40:08.429095+0000","last_fullsized":"2024-04-19T03:40:08.429095+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.429067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:52.134126+0000","scrub_duration":0.0036343399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:02.298573+0000","last_change":"2024-04-19T03:40:02.298573+0000","last_active":"2024-04-19T03:40:02.298573+0000","last_peered":"2024-04-19T03:40:02.298573+0000","last_clean":"2024-04-19T03:40:02.298573+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:40:02.298573+0000","last_undegraded":"2024-04-19T03:40:02.298573+0000","last_fullsized":"2024-04-19T03:40:02.298573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2054","last_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_deep_scrub":"70'2054","last_deep_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_clean_scrub_stamp":"2024-04-19T03:40:02.298435+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:12.759109+0000","scrub_duration":0.0023525339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"93'3","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:02.299399+0000","last_change":"2024-04-19T03:41:02.299516+0000","last_active":"2024-04-19T03:41:02.299399+0000","last_peered":"2024-04-19T03:41:02.299399+0000","last_clean":"2024-04-19T03:41:02.299399+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:41:02.299399+0000","last_undegraded":"2024-04-19T03:41:02.299399+0000","last_fullsized":"2024-04-19T03:41:02.299399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_clean_scrub_stamp":"2024-04-19T03:41:02.299371+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:42.745471+0000","scrub_duration":0.0032937819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:01.328432+0000","last_change":"2024-04-19T03:41:01.328574+0000","last_active":"2024-04-19T03:41:01.328432+0000","last_peered":"2024-04-19T03:41:01.328432+0000","last_clean":"2024-04-19T03:41:01.328432+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:41:01.328432+0000","last_undegraded":"2024-04-19T03:41:01.328432+0000","last_fullsized":"2024-04-19T03:41:01.328432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2","last_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_deep_scrub":"70'2","last_deep_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_clean_scrub_stamp":"2024-04-19T03:41:01.328403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:19.548881+0000","scrub_duration":0.003585155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"93'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:04.299196+0000","last_change":"2024-04-19T03:41:04.299312+0000","last_active":"2024-04-19T03:41:04.299196+0000","last_peered":"2024-04-19T03:41:04.299196+0000","last_clean":"2024-04-19T03:41:04.299196+0000","last_became_active":"2024-04-19T03:39:43.436323+0000","last_became_peered":"2024-04-19T03:39:43.436323+0000","last_unstale":"2024-04-19T03:41:04.299196+0000","last_undegraded":"2024-04-19T03:41:04.299196+0000","last_fullsized":"2024-04-19T03:41:04.299196+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_clean_scrub_stamp":"2024-04-19T03:41:04.299169+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:01.619558+0000","scrub_duration":0.003662354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.490790+0000","last_change":"2024-04-19T03:39:51.490790+0000","last_active":"2024-04-19T03:39:51.490790+0000","last_peered":"2024-04-19T03:39:51.490790+0000","last_clean":"2024-04-19T03:39:51.490790+0000","last_became_active":"2024-04-19T03:39:43.434807+0000","last_became_peered":"2024-04-19T03:39:43.434807+0000","last_unstale":"2024-04-19T03:39:51.490790+0000","last_undegraded":"2024-04-19T03:39:51.490790+0000","last_fullsized":"2024-04-19T03:39:51.490790+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1981","last_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_deep_scrub":"70'1981","last_deep_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.490660+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.438851+0000","scrub_duration":0.002801207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.535662+0000","last_change":"2024-04-19T03:40:00.535767+0000","last_active":"2024-04-19T03:40:00.535662+0000","last_peered":"2024-04-19T03:40:00.535662+0000","last_clean":"2024-04-19T03:40:00.535662+0000","last_became_active":"2024-04-19T03:39:43.432885+0000","last_became_peered":"2024-04-19T03:39:43.432885+0000","last_unstale":"2024-04-19T03:40:00.535662+0000","last_undegraded":"2024-04-19T03:40:00.535662+0000","last_fullsized":"2024-04-19T03:40:00.535662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.535639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:09.252735+0000","scrub_duration":0.0018715909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.617468+0000","last_change":"2024-04-19T03:39:50.617468+0000","last_active":"2024-04-19T03:39:50.617468+0000","last_peered":"2024-04-19T03:39:50.617468+0000","last_clean":"2024-04-19T03:39:50.617468+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:50.617468+0000","last_undegraded":"2024-04-19T03:39:50.617468+0000","last_fullsized":"2024-04-19T03:39:50.617468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_clean_scrub_stamp":"2024-04-19T03:39:50.617321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:52.005449+0000","scrub_duration":0.0027065029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"93'4","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:09.036865+0000","last_change":"2024-04-19T03:41:09.037014+0000","last_active":"2024-04-19T03:41:09.036865+0000","last_peered":"2024-04-19T03:41:09.036865+0000","last_clean":"2024-04-19T03:41:09.036865+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:41:09.036865+0000","last_undegraded":"2024-04-19T03:41:09.036865+0000","last_fullsized":"2024-04-19T03:41:09.036865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:41:09.036840+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:41:09.036840+0000","last_clean_scrub_stamp":"2024-04-19T03:41:09.036840+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:52.981519+0000","scrub_duration":0.0033234079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.395768+0000","last_change":"2024-04-19T03:40:23.395889+0000","last_active":"2024-04-19T03:40:23.395768+0000","last_peered":"2024-04-19T03:40:23.395768+0000","last_clean":"2024-04-19T03:40:23.395768+0000","last_became_active":"2024-04-19T03:39:43.433630+0000","last_became_peered":"2024-04-19T03:39:43.433630+0000","last_unstale":"2024-04-19T03:40:23.395768+0000","last_undegraded":"2024-04-19T03:40:23.395768+0000","last_fullsized":"2024-04-19T03:40:23.395768+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2008","last_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_deep_scrub":"70'2008","last_deep_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:23.395745+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:56:22.631622+0000","scrub_duration":0.002746283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:03.295590+0000","last_change":"2024-04-19T03:41:03.295590+0000","last_active":"2024-04-19T03:41:03.295590+0000","last_peered":"2024-04-19T03:41:03.295590+0000","last_clean":"2024-04-19T03:41:03.295590+0000","last_became_active":"2024-04-19T03:39:43.430616+0000","last_became_peered":"2024-04-19T03:39:43.430616+0000","last_unstale":"2024-04-19T03:41:03.295590+0000","last_undegraded":"2024-04-19T03:41:03.295590+0000","last_fullsized":"2024-04-19T03:41:03.295590+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_clean_scrub_stamp":"2024-04-19T03:41:03.295436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:40.226830+0000","scrub_duration":0.0017184609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.448534+0000","last_change":"2024-04-19T03:40:12.448673+0000","last_active":"2024-04-19T03:40:12.448534+0000","last_peered":"2024-04-19T03:40:12.448534+0000","last_clean":"2024-04-19T03:40:12.448534+0000","last_became_active":"2024-04-19T03:39:43.434699+0000","last_became_peered":"2024-04-19T03:39:43.434699+0000","last_unstale":"2024-04-19T03:40:12.448534+0000","last_undegraded":"2024-04-19T03:40:12.448534+0000","last_fullsized":"2024-04-19T03:40:12.448534+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2035","last_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_deep_scrub":"70'2035","last_deep_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.448493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:23.179035+0000","scrub_duration":0.002191452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809466+0000","last_change":"2024-04-19T03:39:19.423598+0000","last_active":"2024-04-19T03:39:49.809466+0000","last_peered":"2024-04-19T03:39:49.809466+0000","last_clean":"2024-04-19T03:39:49.809466+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:39:49.809466+0000","last_undegraded":"2024-04-19T03:39:49.809466+0000","last_fullsized":"2024-04-19T03:39:49.809466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2144,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.427101+0000","last_change":"2024-04-19T03:40:18.427193+0000","last_active":"2024-04-19T03:40:18.427101+0000","last_peered":"2024-04-19T03:40:18.427101+0000","last_clean":"2024-04-19T03:40:18.427101+0000","last_became_active":"2024-04-19T03:39:43.431921+0000","last_became_peered":"2024-04-19T03:39:43.431921+0000","last_unstale":"2024-04-19T03:40:18.427101+0000","last_undegraded":"2024-04-19T03:40:18.427101+0000","last_fullsized":"2024-04-19T03:40:18.427101+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2045","last_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_deep_scrub":"70'2045","last_deep_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.427077+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:13.005299+0000","scrub_duration":0.0023622740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.368152+0000","last_change":"2024-04-19T03:40:54.368270+0000","last_active":"2024-04-19T03:40:54.368152+0000","last_peered":"2024-04-19T03:40:54.368152+0000","last_clean":"2024-04-19T03:40:54.368152+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:40:54.368152+0000","last_undegraded":"2024-04-19T03:40:54.368152+0000","last_fullsized":"2024-04-19T03:40:54.368152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.368123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:24.596193+0000","scrub_duration":0.001875411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6131,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:10.753203+0000","last_change":"2024-04-19T03:40:10.753203+0000","last_active":"2024-04-19T03:40:10.753203+0000","last_peered":"2024-04-19T03:40:10.753203+0000","last_clean":"2024-04-19T03:40:10.753203+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:40:10.753203+0000","last_undegraded":"2024-04-19T03:40:10.753203+0000","last_fullsized":"2024-04-19T03:40:10.753203+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6031","last_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_deep_scrub":"70'6031","last_deep_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_clean_scrub_stamp":"2024-04-19T03:40:10.753070+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:21.213744+0000","scrub_duration":0.003270387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"93'4","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.909530+0000","last_change":"2024-04-19T03:40:49.909639+0000","last_active":"2024-04-19T03:40:49.909530+0000","last_peered":"2024-04-19T03:40:49.909530+0000","last_clean":"2024-04-19T03:40:49.909530+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:40:49.909530+0000","last_undegraded":"2024-04-19T03:40:49.909530+0000","last_fullsized":"2024-04-19T03:40:49.909530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.909503+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:26.734830+0000","scrub_duration":0.0036995690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:13.104252+0000","last_change":"2024-04-19T03:41:13.104365+0000","last_active":"2024-04-19T03:41:13.104252+0000","last_peered":"2024-04-19T03:41:13.104252+0000","last_clean":"2024-04-19T03:41:13.104252+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:41:13.104252+0000","last_undegraded":"2024-04-19T03:41:13.104252+0000","last_fullsized":"2024-04-19T03:41:13.104252+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:13.104225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:13.104225+0000","last_clean_scrub_stamp":"2024-04-19T03:41:13.104225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:15.360559+0000","scrub_duration":0.001898673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.752557+0000","last_change":"2024-04-19T03:40:08.752671+0000","last_active":"2024-04-19T03:40:08.752557+0000","last_peered":"2024-04-19T03:40:08.752557+0000","last_clean":"2024-04-19T03:40:08.752557+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:40:08.752557+0000","last_undegraded":"2024-04-19T03:40:08.752557+0000","last_fullsized":"2024-04-19T03:40:08.752557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.752529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.556106+0000","scrub_duration":0.002237869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:11.153126+0000","last_change":"2024-04-19T03:41:11.153236+0000","last_active":"2024-04-19T03:41:11.153126+0000","last_peered":"2024-04-19T03:41:11.153126+0000","last_clean":"2024-04-19T03:41:11.153126+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:41:11.153126+0000","last_undegraded":"2024-04-19T03:41:11.153126+0000","last_fullsized":"2024-04-19T03:41:11.153126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:11.153098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:11.153098+0000","last_clean_scrub_stamp":"2024-04-19T03:41:11.153098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:19.786815+0000","scrub_duration":0.0017749490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.007886+0000","last_change":"2024-04-19T03:41:05.008024+0000","last_active":"2024-04-19T03:41:05.007886+0000","last_peered":"2024-04-19T03:41:05.007886+0000","last_clean":"2024-04-19T03:41:05.007886+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:41:05.007886+0000","last_undegraded":"2024-04-19T03:41:05.007886+0000","last_fullsized":"2024-04-19T03:41:05.007886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_deep_scrub":"93'9","last_deep_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.007859+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:06.070427+0000","scrub_duration":0.003113757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.234200+0000","last_change":"2024-04-19T03:40:12.234200+0000","last_active":"2024-04-19T03:40:12.234200+0000","last_peered":"2024-04-19T03:40:12.234200+0000","last_clean":"2024-04-19T03:40:12.234200+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:40:12.234200+0000","last_undegraded":"2024-04-19T03:40:12.234200+0000","last_fullsized":"2024-04-19T03:40:12.234200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.234048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:52.983795+0000","scrub_duration":0.0021178159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.913833+0000","last_change":"2024-04-19T03:40:42.913932+0000","last_active":"2024-04-19T03:40:42.913833+0000","last_peered":"2024-04-19T03:40:42.913833+0000","last_clean":"2024-04-19T03:40:42.913833+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:40:42.913833+0000","last_undegraded":"2024-04-19T03:40:42.913833+0000","last_fullsized":"2024-04-19T03:40:42.913833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.913809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:11.158157+0000","scrub_duration":0.001532853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"93'159","reported_seq":245,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:52.249553+0000","last_change":"2024-04-19T03:40:52.249553+0000","last_active":"2024-04-19T03:40:52.249553+0000","last_peered":"2024-04-19T03:40:52.249553+0000","last_clean":"2024-04-19T03:40:52.249553+0000","last_became_active":"2024-04-19T03:39:43.438741+0000","last_became_peered":"2024-04-19T03:39:43.438741+0000","last_unstale":"2024-04-19T03:40:52.249553+0000","last_undegraded":"2024-04-19T03:40:52.249553+0000","last_fullsized":"2024-04-19T03:40:52.249553+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'159","last_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_deep_scrub":"93'159","last_deep_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_clean_scrub_stamp":"2024-04-19T03:40:52.249385+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:50.993077+0000","scrub_duration":0.006639893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":126,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.897457+0000","last_change":"2024-04-19T03:40:46.897576+0000","last_active":"2024-04-19T03:40:46.897457+0000","last_peered":"2024-04-19T03:40:46.897457+0000","last_clean":"2024-04-19T03:40:46.897457+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:40:46.897457+0000","last_undegraded":"2024-04-19T03:40:46.897457+0000","last_fullsized":"2024-04-19T03:40:46.897457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'5","last_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_deep_scrub":"93'5","last_deep_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.897430+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:16.596202+0000","scrub_duration":0.0029799929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.247773+0000","last_change":"2024-04-19T03:40:42.247912+0000","last_active":"2024-04-19T03:40:42.247773+0000","last_peered":"2024-04-19T03:40:42.247773+0000","last_clean":"2024-04-19T03:40:42.247773+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:40:42.247773+0000","last_undegraded":"2024-04-19T03:40:42.247773+0000","last_fullsized":"2024-04-19T03:40:42.247773+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8001","last_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_deep_scrub":"70'8001","last_deep_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.247746+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:19.073073+0000","scrub_duration":0.0039554270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.324496+0000","last_change":"2024-04-19T03:40:49.324496+0000","last_active":"2024-04-19T03:40:49.324496+0000","last_peered":"2024-04-19T03:40:49.324496+0000","last_clean":"2024-04-19T03:40:49.324496+0000","last_became_active":"2024-04-19T03:39:43.430609+0000","last_became_peered":"2024-04-19T03:39:43.430609+0000","last_unstale":"2024-04-19T03:40:49.324496+0000","last_undegraded":"2024-04-19T03:40:49.324496+0000","last_fullsized":"2024-04-19T03:40:49.324496+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.324336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:09.713311+0000","scrub_duration":0.0017616750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809495+0000","last_change":"2024-04-19T03:39:19.427804+0000","last_active":"2024-04-19T03:39:49.809495+0000","last_peered":"2024-04-19T03:39:49.809495+0000","last_clean":"2024-04-19T03:39:49.809495+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:39:49.809495+0000","last_undegraded":"2024-04-19T03:39:49.809495+0000","last_fullsized":"2024-04-19T03:39:49.809495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:58.410930+0000","last_clean_scrub_stamp":"2024-04-19T03:35:58.410930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:54.705566+0000","last_change":"2024-04-19T03:39:54.705566+0000","last_active":"2024-04-19T03:39:54.705566+0000","last_peered":"2024-04-19T03:39:54.705566+0000","last_clean":"2024-04-19T03:39:54.705566+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:54.705566+0000","last_undegraded":"2024-04-19T03:39:54.705566+0000","last_fullsized":"2024-04-19T03:39:54.705566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_clean_scrub_stamp":"2024-04-19T03:39:54.705417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:50:16.417137+0000","scrub_duration":0.0033800929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.452070+0000","last_change":"2024-04-19T03:40:20.452070+0000","last_active":"2024-04-19T03:40:20.452070+0000","last_peered":"2024-04-19T03:40:20.452070+0000","last_clean":"2024-04-19T03:40:20.452070+0000","last_became_active":"2024-04-19T03:39:43.435880+0000","last_became_peered":"2024-04-19T03:39:43.435880+0000","last_unstale":"2024-04-19T03:40:20.452070+0000","last_undegraded":"2024-04-19T03:40:20.452070+0000","last_fullsized":"2024-04-19T03:40:20.452070+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.451936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:29.525420+0000","scrub_duration":0.0019933870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.857769+0000","last_change":"2024-04-19T03:40:48.857891+0000","last_active":"2024-04-19T03:40:48.857769+0000","last_peered":"2024-04-19T03:40:48.857769+0000","last_clean":"2024-04-19T03:40:48.857769+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:40:48.857769+0000","last_undegraded":"2024-04-19T03:40:48.857769+0000","last_fullsized":"2024-04-19T03:40:48.857769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.857745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:15.620029+0000","scrub_duration":0.0021533479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:56.284196+0000","last_change":"2024-04-19T03:40:56.284196+0000","last_active":"2024-04-19T03:40:56.284196+0000","last_peered":"2024-04-19T03:40:56.284196+0000","last_clean":"2024-04-19T03:40:56.284196+0000","last_became_active":"2024-04-19T03:39:43.436182+0000","last_became_peered":"2024-04-19T03:39:43.436182+0000","last_unstale":"2024-04-19T03:40:56.284196+0000","last_undegraded":"2024-04-19T03:40:56.284196+0000","last_fullsized":"2024-04-19T03:40:56.284196+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_clean_scrub_stamp":"2024-04-19T03:40:56.284017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:50:30.538951+0000","scrub_duration":0.0026653649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.159695+0000","last_change":"2024-04-19T03:41:17.159804+0000","last_active":"2024-04-19T03:41:17.159695+0000","last_peered":"2024-04-19T03:41:17.159695+0000","last_clean":"2024-04-19T03:41:17.159695+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:41:17.159695+0000","last_undegraded":"2024-04-19T03:41:17.159695+0000","last_fullsized":"2024-04-19T03:41:17.159695+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:17.159669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:17.159669+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.159669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:35.783665+0000","scrub_duration":0.001766386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:17.412289+0000","last_change":"2024-04-19T03:40:17.412289+0000","last_active":"2024-04-19T03:40:17.412289+0000","last_peered":"2024-04-19T03:40:17.412289+0000","last_clean":"2024-04-19T03:40:17.412289+0000","last_became_active":"2024-04-19T03:39:43.430100+0000","last_became_peered":"2024-04-19T03:39:43.430100+0000","last_unstale":"2024-04-19T03:40:17.412289+0000","last_undegraded":"2024-04-19T03:40:17.412289+0000","last_fullsized":"2024-04-19T03:40:17.412289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_clean_scrub_stamp":"2024-04-19T03:40:17.412165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:23.547748+0000","scrub_duration":0.001842256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":109,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.644185+0000","last_change":"2024-04-19T03:39:51.644185+0000","last_active":"2024-04-19T03:39:51.644185+0000","last_peered":"2024-04-19T03:39:51.644185+0000","last_clean":"2024-04-19T03:39:51.644185+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:51.644185+0000","last_undegraded":"2024-04-19T03:39:51.644185+0000","last_fullsized":"2024-04-19T03:39:51.644185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.644015+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:34.517088+0000","scrub_duration":0.0031723060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:18.177597+0000","last_change":"2024-04-19T03:41:18.177701+0000","last_active":"2024-04-19T03:41:18.177597+0000","last_peered":"2024-04-19T03:41:18.177597+0000","last_clean":"2024-04-19T03:41:18.177597+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:41:18.177597+0000","last_undegraded":"2024-04-19T03:41:18.177597+0000","last_fullsized":"2024-04-19T03:41:18.177597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:18.177571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:18.177571+0000","last_clean_scrub_stamp":"2024-04-19T03:41:18.177571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:17.247688+0000","scrub_duration":0.001928417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.009918+0000","last_change":"2024-04-19T03:41:07.010082+0000","last_active":"2024-04-19T03:41:07.009918+0000","last_peered":"2024-04-19T03:41:07.009918+0000","last_clean":"2024-04-19T03:41:07.009918+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:41:07.009918+0000","last_undegraded":"2024-04-19T03:41:07.009918+0000","last_fullsized":"2024-04-19T03:41:07.009918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.009894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:02.384210+0000","scrub_duration":0.0020010129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2079,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:41.293688+0000","last_change":"2024-04-19T03:40:41.293806+0000","last_active":"2024-04-19T03:40:41.293688+0000","last_peered":"2024-04-19T03:40:41.293688+0000","last_clean":"2024-04-19T03:40:41.293688+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:40:41.293688+0000","last_undegraded":"2024-04-19T03:40:41.293688+0000","last_fullsized":"2024-04-19T03:40:41.293688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1954","last_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_deep_scrub":"70'1954","last_deep_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_clean_scrub_stamp":"2024-04-19T03:40:41.293661+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:08.055945+0000","scrub_duration":0.0022932429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:06.458556+0000","last_change":"2024-04-19T03:40:06.458556+0000","last_active":"2024-04-19T03:40:06.458556+0000","last_peered":"2024-04-19T03:40:06.458556+0000","last_clean":"2024-04-19T03:40:06.458556+0000","last_became_active":"2024-04-19T03:39:43.434441+0000","last_became_peered":"2024-04-19T03:39:43.434441+0000","last_unstale":"2024-04-19T03:40:06.458556+0000","last_undegraded":"2024-04-19T03:40:06.458556+0000","last_fullsized":"2024-04-19T03:40:06.458556+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_clean_scrub_stamp":"2024-04-19T03:40:06.458408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:59.975433+0000","scrub_duration":0.0018363920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:29.306077+0000","last_change":"2024-04-19T03:40:29.306077+0000","last_active":"2024-04-19T03:40:29.306077+0000","last_peered":"2024-04-19T03:40:29.306077+0000","last_clean":"2024-04-19T03:40:29.306077+0000","last_became_active":"2024-04-19T03:39:43.431591+0000","last_became_peered":"2024-04-19T03:39:43.431591+0000","last_unstale":"2024-04-19T03:40:29.306077+0000","last_undegraded":"2024-04-19T03:40:29.306077+0000","last_fullsized":"2024-04-19T03:40:29.306077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_clean_scrub_stamp":"2024-04-19T03:40:29.305921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:42.842536+0000","scrub_duration":0.001644497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.325430+0000","last_change":"2024-04-19T03:40:00.325430+0000","last_active":"2024-04-19T03:40:00.325430+0000","last_peered":"2024-04-19T03:40:00.325430+0000","last_clean":"2024-04-19T03:40:00.325430+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:40:00.325430+0000","last_undegraded":"2024-04-19T03:40:00.325430+0000","last_fullsized":"2024-04-19T03:40:00.325430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.325262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:24.128839+0000","scrub_duration":0.0024403659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:10.199887+0000","last_change":"2024-04-19T03:41:10.200012+0000","last_active":"2024-04-19T03:41:10.199887+0000","last_peered":"2024-04-19T03:41:10.199887+0000","last_clean":"2024-04-19T03:41:10.199887+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:41:10.199887+0000","last_undegraded":"2024-04-19T03:41:10.199887+0000","last_fullsized":"2024-04-19T03:41:10.199887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:41:10.199856+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:41:10.199856+0000","last_clean_scrub_stamp":"2024-04-19T03:41:10.199856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:03:21.601285+0000","scrub_duration":0.0019170070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:57.365883+0000","last_change":"2024-04-19T03:40:57.365883+0000","last_active":"2024-04-19T03:40:57.365883+0000","last_peered":"2024-04-19T03:40:57.365883+0000","last_clean":"2024-04-19T03:40:57.365883+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:40:57.365883+0000","last_undegraded":"2024-04-19T03:40:57.365883+0000","last_fullsized":"2024-04-19T03:40:57.365883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2056","last_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_deep_scrub":"70'2056","last_deep_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_clean_scrub_stamp":"2024-04-19T03:40:57.365740+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:52.740055+0000","scrub_duration":0.0029402849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"93'3","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.315273+0000","last_change":"2024-04-19T03:40:54.315420+0000","last_active":"2024-04-19T03:40:54.315273+0000","last_peered":"2024-04-19T03:40:54.315273+0000","last_clean":"2024-04-19T03:40:54.315273+0000","last_became_active":"2024-04-19T03:39:43.430259+0000","last_became_peered":"2024-04-19T03:39:43.430259+0000","last_unstale":"2024-04-19T03:40:54.315273+0000","last_undegraded":"2024-04-19T03:40:54.315273+0000","last_fullsized":"2024-04-19T03:40:54.315273+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.315248+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:42.599141+0000","scrub_duration":0.003634445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2099,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:55.535916+0000","last_change":"2024-04-19T03:39:55.536049+0000","last_active":"2024-04-19T03:39:55.535916+0000","last_peered":"2024-04-19T03:39:55.535916+0000","last_clean":"2024-04-19T03:39:55.535916+0000","last_became_active":"2024-04-19T03:39:43.430703+0000","last_became_peered":"2024-04-19T03:39:43.430703+0000","last_unstale":"2024-04-19T03:39:55.535916+0000","last_undegraded":"2024-04-19T03:39:55.535916+0000","last_fullsized":"2024-04-19T03:39:55.535916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2000","last_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_deep_scrub":"70'2000","last_deep_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_clean_scrub_stamp":"2024-04-19T03:39:55.535891+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:22.625053+0000","scrub_duration":0.002398659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.300397+0000","last_change":"2024-04-19T03:40:46.300397+0000","last_active":"2024-04-19T03:40:46.300397+0000","last_peered":"2024-04-19T03:40:46.300397+0000","last_clean":"2024-04-19T03:40:46.300397+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:40:46.300397+0000","last_undegraded":"2024-04-19T03:40:46.300397+0000","last_fullsized":"2024-04-19T03:40:46.300397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.300234+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:31.841726+0000","scrub_duration":0.0033879449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:26.383401+0000","last_change":"2024-04-19T03:40:26.383543+0000","last_active":"2024-04-19T03:40:26.383401+0000","last_peered":"2024-04-19T03:40:26.383401+0000","last_clean":"2024-04-19T03:40:26.383401+0000","last_became_active":"2024-04-19T03:39:43.433233+0000","last_became_peered":"2024-04-19T03:39:43.433233+0000","last_unstale":"2024-04-19T03:40:26.383401+0000","last_undegraded":"2024-04-19T03:40:26.383401+0000","last_fullsized":"2024-04-19T03:40:26.383401+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'7","last_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_deep_scrub":"70'7","last_deep_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_clean_scrub_stamp":"2024-04-19T03:40:26.383375+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:52.425413+0000","scrub_duration":0.0024732740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.608048+0000","last_change":"2024-04-19T03:40:18.608178+0000","last_active":"2024-04-19T03:40:18.608048+0000","last_peered":"2024-04-19T03:40:18.608048+0000","last_clean":"2024-04-19T03:40:18.608048+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:40:18.608048+0000","last_undegraded":"2024-04-19T03:40:18.608048+0000","last_fullsized":"2024-04-19T03:40:18.608048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.608004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:12.037760+0000","scrub_duration":0.0019643289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809809+0000","last_change":"2024-04-19T03:35:59.881728+0000","last_active":"2024-04-19T03:39:49.809809+0000","last_peered":"2024-04-19T03:39:49.809809+0000","last_clean":"2024-04-19T03:39:49.809809+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:39:49.809809+0000","last_undegraded":"2024-04-19T03:39:49.809809+0000","last_fullsized":"2024-04-19T03:39:49.809809+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.706465+0000","last_change":"2024-04-19T03:40:12.706465+0000","last_active":"2024-04-19T03:40:12.706465+0000","last_peered":"2024-04-19T03:40:12.706465+0000","last_clean":"2024-04-19T03:40:12.706465+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:40:12.706465+0000","last_undegraded":"2024-04-19T03:40:12.706465+0000","last_fullsized":"2024-04-19T03:40:12.706465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'6","last_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_deep_scrub":"93'6","last_deep_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.706336+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:55.113200+0000","scrub_duration":0.0042115119999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.337533+0000","last_change":"2024-04-19T03:41:05.337639+0000","last_active":"2024-04-19T03:41:05.337533+0000","last_peered":"2024-04-19T03:41:05.337533+0000","last_clean":"2024-04-19T03:41:05.337533+0000","last_became_active":"2024-04-19T03:39:43.435662+0000","last_became_peered":"2024-04-19T03:39:43.435662+0000","last_unstale":"2024-04-19T03:41:05.337533+0000","last_undegraded":"2024-04-19T03:41:05.337533+0000","last_fullsized":"2024-04-19T03:41:05.337533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.337507+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:19.212270+0000","scrub_duration":0.0024382739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.337549+0000","last_change":"2024-04-19T03:40:27.337549+0000","last_active":"2024-04-19T03:40:27.337549+0000","last_peered":"2024-04-19T03:40:27.337549+0000","last_clean":"2024-04-19T03:40:27.337549+0000","last_became_active":"2024-04-19T03:39:43.433006+0000","last_became_peered":"2024-04-19T03:39:43.433006+0000","last_unstale":"2024-04-19T03:40:27.337549+0000","last_undegraded":"2024-04-19T03:40:27.337549+0000","last_fullsized":"2024-04-19T03:40:27.337549+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.337390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:10.033965+0000","scrub_duration":0.0023860370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":112,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:12.011414+0000","last_change":"2024-04-19T03:41:12.011573+0000","last_active":"2024-04-19T03:41:12.011414+0000","last_peered":"2024-04-19T03:41:12.011414+0000","last_clean":"2024-04-19T03:41:12.011414+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:41:12.011414+0000","last_undegraded":"2024-04-19T03:41:12.011414+0000","last_fullsized":"2024-04-19T03:41:12.011414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'12","last_scrub_stamp":"2024-04-19T03:41:12.011372+0000","last_deep_scrub":"70'12","last_deep_scrub_stamp":"2024-04-19T03:41:12.011372+0000","last_clean_scrub_stamp":"2024-04-19T03:41:12.011372+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:20.950499+0000","scrub_duration":0.0034687899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2090,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809882+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:49.809882+0000","last_peered":"2024-04-19T03:39:49.809882+0000","last_clean":"2024-04-19T03:39:49.809882+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:49.809882+0000","last_undegraded":"2024-04-19T03:39:49.809882+0000","last_fullsized":"2024-04-19T03:39:49.809882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.008433+0000","last_change":"2024-04-19T03:41:17.008586+0000","last_active":"2024-04-19T03:41:17.008433+0000","last_peered":"2024-04-19T03:41:17.008433+0000","last_clean":"2024-04-19T03:41:17.008433+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:41:17.008433+0000","last_undegraded":"2024-04-19T03:41:17.008433+0000","last_fullsized":"2024-04-19T03:41:17.008433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2016","last_scrub_stamp":"2024-04-19T03:41:17.008393+0000","last_deep_scrub":"70'2016","last_deep_scrub_stamp":"2024-04-19T03:41:17.008393+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.008393+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:15:22.430976+0000","scrub_duration":0.0034046279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.185614+0000","last_change":"2024-04-19T03:40:35.185736+0000","last_active":"2024-04-19T03:40:35.185614+0000","last_peered":"2024-04-19T03:40:35.185614+0000","last_clean":"2024-04-19T03:40:35.185614+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:40:35.185614+0000","last_undegraded":"2024-04-19T03:40:35.185614+0000","last_fullsized":"2024-04-19T03:40:35.185614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2053","last_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_deep_scrub":"70'2053","last_deep_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.185586+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:03.429934+0000","scrub_duration":0.0023438479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481820,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1652,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1691648,"data_stored":1258390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Apr 19 03:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.48899999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369840,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002000,"statfs":{"total":96636764160,"available":96258048000,"internally_reserved":0,"allocated":1679360,"data_stored":1257168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:41:08 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.42899999999999999},"min":{"1min":0.33100000000000002,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.622,"5min":1.087,"15min":1.087},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.58999999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Apr 19 03:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.53600000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738438,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":790528,"data_stored":382380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:41:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.45100000000000001},"min":{"1min":0.28899999999999998,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58799999999999997,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.60599999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.26900000000000002}]},{"osd":2,"last update":"Fri Apr 19 03:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.63800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.64900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.40999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:41:33.415 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.416 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.416 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.416 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.417 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.417 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.417 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.418 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.418 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.418 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.419 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.420 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.421 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:35:58.410930+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=58, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.421 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.422 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:33.422 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:41:53.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:41:53.803 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:41:53.805 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:41:53.817 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-04-19T03:41:52.368148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115828,"ondisk_log_size":115828,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795896,"kb_used_data":4064,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319624,"statfs":{"total":289910292480,"available":289095294976,"internally_reserved":0,"allocated":4161536,"data_stored":2897938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003077"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2069,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810082+0000","last_change":"2024-04-19T03:35:59.881725+0000","last_active":"2024-04-19T03:39:49.810082+0000","last_peered":"2024-04-19T03:39:49.810082+0000","last_clean":"2024-04-19T03:39:49.810082+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:39:49.810082+0000","last_undegraded":"2024-04-19T03:39:49.810082+0000","last_fullsized":"2024-04-19T03:39:49.810082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":94,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810084+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:49.810084+0000","last_peered":"2024-04-19T03:39:49.810084+0000","last_clean":"2024-04-19T03:39:49.810084+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:49.810084+0000","last_undegraded":"2024-04-19T03:39:49.810084+0000","last_fullsized":"2024-04-19T03:39:49.810084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4093,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:28.291061+0000","last_change":"2024-04-19T03:40:28.291061+0000","last_active":"2024-04-19T03:40:28.291061+0000","last_peered":"2024-04-19T03:40:28.291061+0000","last_clean":"2024-04-19T03:40:28.291061+0000","last_became_active":"2024-04-19T03:39:43.437251+0000","last_became_peered":"2024-04-19T03:39:43.437251+0000","last_unstale":"2024-04-19T03:40:28.291061+0000","last_undegraded":"2024-04-19T03:40:28.291061+0000","last_fullsized":"2024-04-19T03:40:28.291061+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3993","last_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_deep_scrub":"70'3993","last_deep_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_clean_scrub_stamp":"2024-04-19T03:40:28.290885+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:17.123063+0000","scrub_duration":0.0023123509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.425893+0000","last_change":"2024-04-19T03:40:04.425893+0000","last_active":"2024-04-19T03:40:04.425893+0000","last_peered":"2024-04-19T03:40:04.425893+0000","last_clean":"2024-04-19T03:40:04.425893+0000","last_became_active":"2024-04-19T03:39:43.434583+0000","last_became_peered":"2024-04-19T03:39:43.434583+0000","last_unstale":"2024-04-19T03:40:04.425893+0000","last_undegraded":"2024-04-19T03:40:04.425893+0000","last_fullsized":"2024-04-19T03:40:04.425893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.425751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:07.588193+0000","scrub_duration":0.002196057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:50.306704+0000","last_change":"2024-04-19T03:40:50.306704+0000","last_active":"2024-04-19T03:40:50.306704+0000","last_peered":"2024-04-19T03:40:50.306704+0000","last_clean":"2024-04-19T03:40:50.306704+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:40:50.306704+0000","last_undegraded":"2024-04-19T03:40:50.306704+0000","last_fullsized":"2024-04-19T03:40:50.306704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2051","last_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_deep_scrub":"70'2051","last_deep_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_clean_scrub_stamp":"2024-04-19T03:40:50.306544+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:45.676931+0000","scrub_duration":0.0035400869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:47.306484+0000","last_change":"2024-04-19T03:40:47.306484+0000","last_active":"2024-04-19T03:40:47.306484+0000","last_peered":"2024-04-19T03:40:47.306484+0000","last_clean":"2024-04-19T03:40:47.306484+0000","last_became_active":"2024-04-19T03:39:43.429508+0000","last_became_peered":"2024-04-19T03:39:43.429508+0000","last_unstale":"2024-04-19T03:40:47.306484+0000","last_undegraded":"2024-04-19T03:40:47.306484+0000","last_fullsized":"2024-04-19T03:40:47.306484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_clean_scrub_stamp":"2024-04-19T03:40:47.306304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:24.288058+0000","scrub_duration":0.0027027560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.363907+0000","last_change":"2024-04-19T03:40:32.363907+0000","last_active":"2024-04-19T03:40:32.363907+0000","last_peered":"2024-04-19T03:40:32.363907+0000","last_clean":"2024-04-19T03:40:32.363907+0000","last_became_active":"2024-04-19T03:39:43.428726+0000","last_became_peered":"2024-04-19T03:39:43.428726+0000","last_unstale":"2024-04-19T03:40:32.363907+0000","last_undegraded":"2024-04-19T03:40:32.363907+0000","last_fullsized":"2024-04-19T03:40:32.363907+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.363768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:55:49.483155+0000","scrub_duration":0.0027930099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8141,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:03.416142+0000","last_change":"2024-04-19T03:40:03.416142+0000","last_active":"2024-04-19T03:40:03.416142+0000","last_peered":"2024-04-19T03:40:03.416142+0000","last_clean":"2024-04-19T03:40:03.416142+0000","last_became_active":"2024-04-19T03:39:43.433063+0000","last_became_peered":"2024-04-19T03:39:43.433063+0000","last_unstale":"2024-04-19T03:40:03.416142+0000","last_undegraded":"2024-04-19T03:40:03.416142+0000","last_fullsized":"2024-04-19T03:40:03.416142+0000","mapping_epoch":92,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8029","last_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_deep_scrub":"70'8029","last_deep_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_clean_scrub_stamp":"2024-04-19T03:40:03.416008+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:39.795688+0000","scrub_duration":0.002564808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:41.102056+0000","last_change":"2024-04-19T03:41:41.102169+0000","last_active":"2024-04-19T03:41:41.102056+0000","last_peered":"2024-04-19T03:41:41.102056+0000","last_clean":"2024-04-19T03:41:41.102056+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:41:41.102056+0000","last_undegraded":"2024-04-19T03:41:41.102056+0000","last_fullsized":"2024-04-19T03:41:41.102056+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6074","last_scrub_stamp":"2024-04-19T03:41:41.102029+0000","last_deep_scrub":"70'6074","last_deep_scrub_stamp":"2024-04-19T03:41:41.102029+0000","last_clean_scrub_stamp":"2024-04-19T03:41:41.102029+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:50.860638+0000","scrub_duration":0.0040250590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6187,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:44.241689+0000","last_change":"2024-04-19T03:41:44.241814+0000","last_active":"2024-04-19T03:41:44.241689+0000","last_peered":"2024-04-19T03:41:44.241689+0000","last_clean":"2024-04-19T03:41:44.241689+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:41:44.241689+0000","last_undegraded":"2024-04-19T03:41:44.241689+0000","last_fullsized":"2024-04-19T03:41:44.241689+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6086","last_scrub_stamp":"2024-04-19T03:41:44.241662+0000","last_deep_scrub":"70'6086","last_deep_scrub_stamp":"2024-04-19T03:41:44.241662+0000","last_clean_scrub_stamp":"2024-04-19T03:41:44.241662+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:12.120455+0000","scrub_duration":0.004073119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4039,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:21.433640+0000","last_change":"2024-04-19T03:40:21.433640+0000","last_active":"2024-04-19T03:40:21.433640+0000","last_peered":"2024-04-19T03:40:21.433640+0000","last_clean":"2024-04-19T03:40:21.433640+0000","last_became_active":"2024-04-19T03:39:43.431742+0000","last_became_peered":"2024-04-19T03:39:43.431742+0000","last_unstale":"2024-04-19T03:40:21.433640+0000","last_undegraded":"2024-04-19T03:40:21.433640+0000","last_fullsized":"2024-04-19T03:40:21.433640+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3939","last_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_deep_scrub":"70'3939","last_deep_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_clean_scrub_stamp":"2024-04-19T03:40:21.433514+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:57.721359+0000","scrub_duration":0.0025512870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810017+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:49.810017+0000","last_peered":"2024-04-19T03:39:49.810017+0000","last_clean":"2024-04-19T03:39:49.810017+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:49.810017+0000","last_undegraded":"2024-04-19T03:39:49.810017+0000","last_fullsized":"2024-04-19T03:39:49.810017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2082,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810035+0000","last_change":"2024-04-19T03:35:59.881530+0000","last_active":"2024-04-19T03:39:49.810035+0000","last_peered":"2024-04-19T03:39:49.810035+0000","last_clean":"2024-04-19T03:39:49.810035+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:39:49.810035+0000","last_undegraded":"2024-04-19T03:39:49.810035+0000","last_fullsized":"2024-04-19T03:39:49.810035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:14.425058+0000","last_change":"2024-04-19T03:40:14.425058+0000","last_active":"2024-04-19T03:40:14.425058+0000","last_peered":"2024-04-19T03:40:14.425058+0000","last_clean":"2024-04-19T03:40:14.425058+0000","last_became_active":"2024-04-19T03:39:43.435748+0000","last_became_peered":"2024-04-19T03:39:43.435748+0000","last_unstale":"2024-04-19T03:40:14.425058+0000","last_undegraded":"2024-04-19T03:40:14.425058+0000","last_fullsized":"2024-04-19T03:40:14.425058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2072","last_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_deep_scrub":"70'2072","last_deep_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_clean_scrub_stamp":"2024-04-19T03:40:14.424896+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:23.898309+0000","scrub_duration":0.0031291729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2125,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:31.388574+0000","last_change":"2024-04-19T03:40:31.388574+0000","last_active":"2024-04-19T03:40:31.388574+0000","last_peered":"2024-04-19T03:40:31.388574+0000","last_clean":"2024-04-19T03:40:31.388574+0000","last_became_active":"2024-04-19T03:39:43.430447+0000","last_became_peered":"2024-04-19T03:39:43.430447+0000","last_unstale":"2024-04-19T03:40:31.388574+0000","last_undegraded":"2024-04-19T03:40:31.388574+0000","last_fullsized":"2024-04-19T03:40:31.388574+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2025","last_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_deep_scrub":"70'2025","last_deep_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_clean_scrub_stamp":"2024-04-19T03:40:31.388419+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:12.219961+0000","scrub_duration":0.0023057400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:55.327902+0000","last_change":"2024-04-19T03:40:55.327902+0000","last_active":"2024-04-19T03:40:55.327902+0000","last_peered":"2024-04-19T03:40:55.327902+0000","last_clean":"2024-04-19T03:40:55.327902+0000","last_became_active":"2024-04-19T03:39:43.433748+0000","last_became_peered":"2024-04-19T03:39:43.433748+0000","last_unstale":"2024-04-19T03:40:55.327902+0000","last_undegraded":"2024-04-19T03:40:55.327902+0000","last_fullsized":"2024-04-19T03:40:55.327902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2002","last_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_deep_scrub":"70'2002","last_deep_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_clean_scrub_stamp":"2024-04-19T03:40:55.327775+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:08:48.213870+0000","scrub_duration":0.0026441490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:30.038201+0000","last_change":"2024-04-19T03:41:30.038366+0000","last_active":"2024-04-19T03:41:30.038201+0000","last_peered":"2024-04-19T03:41:30.038201+0000","last_clean":"2024-04-19T03:41:30.038201+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:41:30.038201+0000","last_undegraded":"2024-04-19T03:41:30.038201+0000","last_fullsized":"2024-04-19T03:41:30.038201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1980","last_scrub_stamp":"2024-04-19T03:41:30.038158+0000","last_deep_scrub":"70'1980","last_deep_scrub_stamp":"2024-04-19T03:41:30.038158+0000","last_clean_scrub_stamp":"2024-04-19T03:41:30.038158+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:39.586687+0000","scrub_duration":0.0027094950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809995+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:49.809995+0000","last_peered":"2024-04-19T03:39:49.809995+0000","last_clean":"2024-04-19T03:39:49.809995+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:49.809995+0000","last_undegraded":"2024-04-19T03:39:49.809995+0000","last_fullsized":"2024-04-19T03:39:49.809995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:29.015153+0000","last_change":"2024-04-19T03:41:29.015259+0000","last_active":"2024-04-19T03:41:29.015153+0000","last_peered":"2024-04-19T03:41:29.015153+0000","last_clean":"2024-04-19T03:41:29.015153+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:41:29.015153+0000","last_undegraded":"2024-04-19T03:41:29.015153+0000","last_fullsized":"2024-04-19T03:41:29.015153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4052","last_scrub_stamp":"2024-04-19T03:41:29.015128+0000","last_deep_scrub":"70'4052","last_deep_scrub_stamp":"2024-04-19T03:41:29.015128+0000","last_clean_scrub_stamp":"2024-04-19T03:41:29.015128+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:28.085244+0000","scrub_duration":0.0035691020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4186,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.399826+0000","last_change":"2024-04-19T03:40:35.399826+0000","last_active":"2024-04-19T03:40:35.399826+0000","last_peered":"2024-04-19T03:40:35.399826+0000","last_clean":"2024-04-19T03:40:35.399826+0000","last_became_active":"2024-04-19T03:39:43.431899+0000","last_became_peered":"2024-04-19T03:39:43.431899+0000","last_unstale":"2024-04-19T03:40:35.399826+0000","last_undegraded":"2024-04-19T03:40:35.399826+0000","last_fullsized":"2024-04-19T03:40:35.399826+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4086","last_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_deep_scrub":"70'4086","last_deep_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.399694+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:10.836662+0000","scrub_duration":0.0025555930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:07.410737+0000","last_change":"2024-04-19T03:40:07.410737+0000","last_active":"2024-04-19T03:40:07.410737+0000","last_peered":"2024-04-19T03:40:07.410737+0000","last_clean":"2024-04-19T03:40:07.410737+0000","last_became_active":"2024-04-19T03:39:43.431732+0000","last_became_peered":"2024-04-19T03:39:43.431732+0000","last_unstale":"2024-04-19T03:40:07.410737+0000","last_undegraded":"2024-04-19T03:40:07.410737+0000","last_fullsized":"2024-04-19T03:40:07.410737+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'11","last_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_deep_scrub":"70'11","last_deep_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_clean_scrub_stamp":"2024-04-19T03:40:07.410606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:58.262646+0000","scrub_duration":0.0023107370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.207298+0000","last_change":"2024-04-19T03:41:07.207411+0000","last_active":"2024-04-19T03:41:07.207298+0000","last_peered":"2024-04-19T03:41:07.207298+0000","last_clean":"2024-04-19T03:41:07.207298+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:41:07.207298+0000","last_undegraded":"2024-04-19T03:41:07.207298+0000","last_fullsized":"2024-04-19T03:41:07.207298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.207263+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:15:12.629847+0000","scrub_duration":0.0031871450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:28.039679+0000","last_change":"2024-04-19T03:41:28.039806+0000","last_active":"2024-04-19T03:41:28.039679+0000","last_peered":"2024-04-19T03:41:28.039679+0000","last_clean":"2024-04-19T03:41:28.039679+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:41:28.039679+0000","last_undegraded":"2024-04-19T03:41:28.039679+0000","last_fullsized":"2024-04-19T03:41:28.039679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2044","last_scrub_stamp":"2024-04-19T03:41:28.039638+0000","last_deep_scrub":"70'2044","last_deep_scrub_stamp":"2024-04-19T03:41:28.039638+0000","last_clean_scrub_stamp":"2024-04-19T03:41:28.039638+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:46.663635+0000","scrub_duration":0.0029199209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.134428+0000","last_change":"2024-04-19T03:40:32.134573+0000","last_active":"2024-04-19T03:40:32.134428+0000","last_peered":"2024-04-19T03:40:32.134428+0000","last_clean":"2024-04-19T03:40:32.134428+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:40:32.134428+0000","last_undegraded":"2024-04-19T03:40:32.134428+0000","last_fullsized":"2024-04-19T03:40:32.134428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4021","last_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_deep_scrub":"70'4021","last_deep_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.134399+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:06.376575+0000","scrub_duration":0.0035905770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.324323+0000","last_change":"2024-04-19T03:40:04.324323+0000","last_active":"2024-04-19T03:40:04.324323+0000","last_peered":"2024-04-19T03:40:04.324323+0000","last_clean":"2024-04-19T03:40:04.324323+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:40:04.324323+0000","last_undegraded":"2024-04-19T03:40:04.324323+0000","last_fullsized":"2024-04-19T03:40:04.324323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1983","last_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_deep_scrub":"70'1983","last_deep_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.324180+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:46.731044+0000","scrub_duration":0.0027598010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:22.035905+0000","last_change":"2024-04-19T03:41:22.036031+0000","last_active":"2024-04-19T03:41:22.035905+0000","last_peered":"2024-04-19T03:41:22.035905+0000","last_clean":"2024-04-19T03:41:22.035905+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:41:22.035905+0000","last_undegraded":"2024-04-19T03:41:22.035905+0000","last_fullsized":"2024-04-19T03:41:22.035905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:41:22.035877+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:41:22.035877+0000","last_clean_scrub_stamp":"2024-04-19T03:41:22.035877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:30.669594+0000","scrub_duration":0.002404804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:52.486333+0000","last_change":"2024-04-19T03:39:52.486333+0000","last_active":"2024-04-19T03:39:52.486333+0000","last_peered":"2024-04-19T03:39:52.486333+0000","last_clean":"2024-04-19T03:39:52.486333+0000","last_became_active":"2024-04-19T03:39:43.437065+0000","last_became_peered":"2024-04-19T03:39:43.437065+0000","last_unstale":"2024-04-19T03:39:52.486333+0000","last_undegraded":"2024-04-19T03:39:52.486333+0000","last_fullsized":"2024-04-19T03:39:52.486333+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2028","last_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_deep_scrub":"70'2028","last_deep_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_clean_scrub_stamp":"2024-04-19T03:39:52.486195+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:49.821209+0000","scrub_duration":0.0024754260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:37.231826+0000","last_change":"2024-04-19T03:41:37.231947+0000","last_active":"2024-04-19T03:41:37.231826+0000","last_peered":"2024-04-19T03:41:37.231826+0000","last_clean":"2024-04-19T03:41:37.231826+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:41:37.231826+0000","last_undegraded":"2024-04-19T03:41:37.231826+0000","last_fullsized":"2024-04-19T03:41:37.231826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:41:37.231798+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:41:37.231798+0000","last_clean_scrub_stamp":"2024-04-19T03:41:37.231798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:47:49.109320+0000","scrub_duration":0.0020331149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":129,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:22.199937+0000","last_change":"2024-04-19T03:40:22.199937+0000","last_active":"2024-04-19T03:40:22.199937+0000","last_peered":"2024-04-19T03:40:22.199937+0000","last_clean":"2024-04-19T03:40:22.199937+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:40:22.199937+0000","last_undegraded":"2024-04-19T03:40:22.199937+0000","last_fullsized":"2024-04-19T03:40:22.199937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_clean_scrub_stamp":"2024-04-19T03:40:22.199728+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:08:02.693048+0000","scrub_duration":0.0026297960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.760857+0000","last_change":"2024-04-19T03:40:32.760857+0000","last_active":"2024-04-19T03:40:32.760857+0000","last_peered":"2024-04-19T03:40:32.760857+0000","last_clean":"2024-04-19T03:40:32.760857+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:40:32.760857+0000","last_undegraded":"2024-04-19T03:40:32.760857+0000","last_fullsized":"2024-04-19T03:40:32.760857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.760689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:48.412394+0000","scrub_duration":0.001792664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.970065+0000","last_change":"2024-04-19T03:41:17.970164+0000","last_active":"2024-04-19T03:41:17.970065+0000","last_peered":"2024-04-19T03:41:17.970065+0000","last_clean":"2024-04-19T03:41:17.970065+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:41:17.970065+0000","last_undegraded":"2024-04-19T03:41:17.970065+0000","last_fullsized":"2024-04-19T03:41:17.970065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:41:17.970042+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:41:17.970042+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.970042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:30.160406+0000","scrub_duration":0.0029412599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.857512+0000","last_change":"2024-04-19T03:40:39.857512+0000","last_active":"2024-04-19T03:40:39.857512+0000","last_peered":"2024-04-19T03:40:39.857512+0000","last_clean":"2024-04-19T03:40:39.857512+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:40:39.857512+0000","last_undegraded":"2024-04-19T03:40:39.857512+0000","last_fullsized":"2024-04-19T03:40:39.857512+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.857367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:14.099544+0000","scrub_duration":0.0016111649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.287222+0000","last_change":"2024-04-19T03:40:39.287366+0000","last_active":"2024-04-19T03:40:39.287222+0000","last_peered":"2024-04-19T03:40:39.287222+0000","last_clean":"2024-04-19T03:40:39.287222+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:40:39.287222+0000","last_undegraded":"2024-04-19T03:40:39.287222+0000","last_fullsized":"2024-04-19T03:40:39.287222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.287191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:08.985963+0000","scrub_duration":0.0020786289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.690988+0000","last_change":"2024-04-19T03:40:27.690988+0000","last_active":"2024-04-19T03:40:27.690988+0000","last_peered":"2024-04-19T03:40:27.690988+0000","last_clean":"2024-04-19T03:40:27.690988+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:40:27.690988+0000","last_undegraded":"2024-04-19T03:40:27.690988+0000","last_fullsized":"2024-04-19T03:40:27.690988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.690844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:32.347176+0000","scrub_duration":0.001791932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:59.727483+0000","last_change":"2024-04-19T03:39:59.727483+0000","last_active":"2024-04-19T03:39:59.727483+0000","last_peered":"2024-04-19T03:39:59.727483+0000","last_clean":"2024-04-19T03:39:59.727483+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:59.727483+0000","last_undegraded":"2024-04-19T03:39:59.727483+0000","last_fullsized":"2024-04-19T03:39:59.727483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_clean_scrub_stamp":"2024-04-19T03:39:59.727297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:17.092087+0000","scrub_duration":0.0035426419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:25.393587+0000","last_change":"2024-04-19T03:40:25.393587+0000","last_active":"2024-04-19T03:40:25.393587+0000","last_peered":"2024-04-19T03:40:25.393587+0000","last_clean":"2024-04-19T03:40:25.393587+0000","last_became_active":"2024-04-19T03:39:43.429210+0000","last_became_peered":"2024-04-19T03:39:43.429210+0000","last_unstale":"2024-04-19T03:40:25.393587+0000","last_undegraded":"2024-04-19T03:40:25.393587+0000","last_fullsized":"2024-04-19T03:40:25.393587+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_clean_scrub_stamp":"2024-04-19T03:40:25.393456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:41.962081+0000","scrub_duration":0.002168045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:16.670035+0000","last_change":"2024-04-19T03:40:16.670035+0000","last_active":"2024-04-19T03:40:16.670035+0000","last_peered":"2024-04-19T03:40:16.670035+0000","last_clean":"2024-04-19T03:40:16.670035+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:40:16.670035+0000","last_undegraded":"2024-04-19T03:40:16.670035+0000","last_fullsized":"2024-04-19T03:40:16.670035+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5950","last_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_deep_scrub":"70'5950","last_deep_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_clean_scrub_stamp":"2024-04-19T03:40:16.669845+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:00.796011+0000","scrub_duration":0.0029482610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"93'8","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:42.240191+0000","last_change":"2024-04-19T03:41:42.240315+0000","last_active":"2024-04-19T03:41:42.240191+0000","last_peered":"2024-04-19T03:41:42.240191+0000","last_clean":"2024-04-19T03:41:42.240191+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:41:42.240191+0000","last_undegraded":"2024-04-19T03:41:42.240191+0000","last_fullsized":"2024-04-19T03:41:42.240191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'8","last_scrub_stamp":"2024-04-19T03:41:42.240166+0000","last_deep_scrub":"93'8","last_deep_scrub_stamp":"2024-04-19T03:41:42.240166+0000","last_clean_scrub_stamp":"2024-04-19T03:41:42.240166+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:01.948223+0000","scrub_duration":0.0037955760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.615150+0000","last_change":"2024-04-19T03:40:20.615150+0000","last_active":"2024-04-19T03:40:20.615150+0000","last_peered":"2024-04-19T03:40:20.615150+0000","last_clean":"2024-04-19T03:40:20.615150+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:40:20.615150+0000","last_undegraded":"2024-04-19T03:40:20.615150+0000","last_fullsized":"2024-04-19T03:40:20.615150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4063","last_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_deep_scrub":"70'4063","last_deep_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.614982+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:01.364729+0000","scrub_duration":0.003172963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"93'99","reported_seq":70,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.346209+0000","last_change":"2024-04-19T03:40:48.346209+0000","last_active":"2024-04-19T03:40:48.346209+0000","last_peered":"2024-04-19T03:40:48.346209+0000","last_clean":"2024-04-19T03:40:48.346209+0000","last_became_active":"2024-04-19T03:39:43.437298+0000","last_became_peered":"2024-04-19T03:39:43.437298+0000","last_unstale":"2024-04-19T03:40:48.346209+0000","last_undegraded":"2024-04-19T03:40:48.346209+0000","last_fullsized":"2024-04-19T03:40:48.346209+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'99","last_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_deep_scrub":"93'99","last_deep_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.346076+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:13.038605+0000","scrub_duration":0.007204322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:40.440980+0000","last_change":"2024-04-19T03:40:40.440980+0000","last_active":"2024-04-19T03:40:40.440980+0000","last_peered":"2024-04-19T03:40:40.440980+0000","last_clean":"2024-04-19T03:40:40.440980+0000","last_became_active":"2024-04-19T03:39:43.434605+0000","last_became_peered":"2024-04-19T03:39:43.434605+0000","last_unstale":"2024-04-19T03:40:40.440980+0000","last_undegraded":"2024-04-19T03:40:40.440980+0000","last_fullsized":"2024-04-19T03:40:40.440980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4083","last_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_deep_scrub":"70'4083","last_deep_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_clean_scrub_stamp":"2024-04-19T03:40:40.440842+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:45.344854+0000","scrub_duration":0.0025970279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"93'4","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.460494+0000","last_change":"2024-04-19T03:40:42.460494+0000","last_active":"2024-04-19T03:40:42.460494+0000","last_peered":"2024-04-19T03:40:42.460494+0000","last_clean":"2024-04-19T03:40:42.460494+0000","last_became_active":"2024-04-19T03:39:43.431842+0000","last_became_peered":"2024-04-19T03:39:43.431842+0000","last_unstale":"2024-04-19T03:40:42.460494+0000","last_undegraded":"2024-04-19T03:40:42.460494+0000","last_fullsized":"2024-04-19T03:40:42.460494+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.460363+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:49.733129+0000","scrub_duration":0.003431403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2076,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.285715+0000","last_change":"2024-04-19T03:40:08.285715+0000","last_active":"2024-04-19T03:40:08.285715+0000","last_peered":"2024-04-19T03:40:08.285715+0000","last_clean":"2024-04-19T03:40:08.285715+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:40:08.285715+0000","last_undegraded":"2024-04-19T03:40:08.285715+0000","last_fullsized":"2024-04-19T03:40:08.285715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1975","last_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_deep_scrub":"70'1975","last_deep_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.285526+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:52.411692+0000","scrub_duration":0.0032122520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:11.030687+0000","last_change":"2024-04-19T03:41:11.030803+0000","last_active":"2024-04-19T03:41:11.030687+0000","last_peered":"2024-04-19T03:41:11.030687+0000","last_clean":"2024-04-19T03:41:11.030687+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:41:11.030687+0000","last_undegraded":"2024-04-19T03:41:11.030687+0000","last_fullsized":"2024-04-19T03:41:11.030687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:11.030662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:11.030662+0000","last_clean_scrub_stamp":"2024-04-19T03:41:11.030662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:29.251141+0000","scrub_duration":0.0017162169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:11.249784+0000","last_change":"2024-04-19T03:40:11.249784+0000","last_active":"2024-04-19T03:40:11.249784+0000","last_peered":"2024-04-19T03:40:11.249784+0000","last_clean":"2024-04-19T03:40:11.249784+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:40:11.249784+0000","last_undegraded":"2024-04-19T03:40:11.249784+0000","last_fullsized":"2024-04-19T03:40:11.249784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2033","last_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_deep_scrub":"70'2033","last_deep_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_clean_scrub_stamp":"2024-04-19T03:40:11.249632+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:04.679387+0000","scrub_duration":0.0039095689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:58.391315+0000","last_change":"2024-04-19T03:40:58.391420+0000","last_active":"2024-04-19T03:40:58.391315+0000","last_peered":"2024-04-19T03:40:58.391315+0000","last_clean":"2024-04-19T03:40:58.391315+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:40:58.391315+0000","last_undegraded":"2024-04-19T03:40:58.391315+0000","last_fullsized":"2024-04-19T03:40:58.391315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_clean_scrub_stamp":"2024-04-19T03:40:58.391280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:42.335959+0000","scrub_duration":0.001857837,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:30.761230+0000","last_change":"2024-04-19T03:40:30.761230+0000","last_active":"2024-04-19T03:40:30.761230+0000","last_peered":"2024-04-19T03:40:30.761230+0000","last_clean":"2024-04-19T03:40:30.761230+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:40:30.761230+0000","last_undegraded":"2024-04-19T03:40:30.761230+0000","last_fullsized":"2024-04-19T03:40:30.761230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'10","last_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_deep_scrub":"70'10","last_deep_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_clean_scrub_stamp":"2024-04-19T03:40:30.761100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:51.151497+0000","scrub_duration":0.0024608220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"93'13","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.342391+0000","last_change":"2024-04-19T03:40:33.342391+0000","last_active":"2024-04-19T03:40:33.342391+0000","last_peered":"2024-04-19T03:40:33.342391+0000","last_clean":"2024-04-19T03:40:33.342391+0000","last_became_active":"2024-04-19T03:39:43.436291+0000","last_became_peered":"2024-04-19T03:39:43.436291+0000","last_unstale":"2024-04-19T03:40:33.342391+0000","last_undegraded":"2024-04-19T03:40:33.342391+0000","last_fullsized":"2024-04-19T03:40:33.342391+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'13","last_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_deep_scrub":"93'13","last_deep_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.342214+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:39:21.052990+0000","scrub_duration":0.0050089979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2219,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.743742+0000","last_change":"2024-04-19T03:40:33.743742+0000","last_active":"2024-04-19T03:40:33.743742+0000","last_peered":"2024-04-19T03:40:33.743742+0000","last_clean":"2024-04-19T03:40:33.743742+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:40:33.743742+0000","last_undegraded":"2024-04-19T03:40:33.743742+0000","last_fullsized":"2024-04-19T03:40:33.743742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2095","last_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_deep_scrub":"70'2095","last_deep_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.743609+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:30.726079+0000","scrub_duration":0.0029003269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"93'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.429204+0000","last_change":"2024-04-19T03:40:08.429204+0000","last_active":"2024-04-19T03:40:08.429204+0000","last_peered":"2024-04-19T03:40:08.429204+0000","last_clean":"2024-04-19T03:40:08.429204+0000","last_became_active":"2024-04-19T03:39:43.431751+0000","last_became_peered":"2024-04-19T03:39:43.431751+0000","last_unstale":"2024-04-19T03:40:08.429204+0000","last_undegraded":"2024-04-19T03:40:08.429204+0000","last_fullsized":"2024-04-19T03:40:08.429204+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.429067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:52.134126+0000","scrub_duration":0.0036343399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:02.298573+0000","last_change":"2024-04-19T03:40:02.298573+0000","last_active":"2024-04-19T03:40:02.298573+0000","last_peered":"2024-04-19T03:40:02.298573+0000","last_clean":"2024-04-19T03:40:02.298573+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:40:02.298573+0000","last_undegraded":"2024-04-19T03:40:02.298573+0000","last_fullsized":"2024-04-19T03:40:02.298573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2054","last_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_deep_scrub":"70'2054","last_deep_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_clean_scrub_stamp":"2024-04-19T03:40:02.298435+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:12.759109+0000","scrub_duration":0.0023525339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"93'3","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:02.299399+0000","last_change":"2024-04-19T03:41:02.299516+0000","last_active":"2024-04-19T03:41:02.299399+0000","last_peered":"2024-04-19T03:41:02.299399+0000","last_clean":"2024-04-19T03:41:02.299399+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:41:02.299399+0000","last_undegraded":"2024-04-19T03:41:02.299399+0000","last_fullsized":"2024-04-19T03:41:02.299399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_clean_scrub_stamp":"2024-04-19T03:41:02.299371+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:42.745471+0000","scrub_duration":0.0032937819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:01.328432+0000","last_change":"2024-04-19T03:41:01.328574+0000","last_active":"2024-04-19T03:41:01.328432+0000","last_peered":"2024-04-19T03:41:01.328432+0000","last_clean":"2024-04-19T03:41:01.328432+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:41:01.328432+0000","last_undegraded":"2024-04-19T03:41:01.328432+0000","last_fullsized":"2024-04-19T03:41:01.328432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2","last_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_deep_scrub":"70'2","last_deep_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_clean_scrub_stamp":"2024-04-19T03:41:01.328403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:19.548881+0000","scrub_duration":0.003585155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"93'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:04.299312+0000","last_change":"2024-04-19T03:41:04.299312+0000","last_active":"2024-04-19T03:41:04.299312+0000","last_peered":"2024-04-19T03:41:04.299312+0000","last_clean":"2024-04-19T03:41:04.299312+0000","last_became_active":"2024-04-19T03:39:43.436323+0000","last_became_peered":"2024-04-19T03:39:43.436323+0000","last_unstale":"2024-04-19T03:41:04.299312+0000","last_undegraded":"2024-04-19T03:41:04.299312+0000","last_fullsized":"2024-04-19T03:41:04.299312+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_clean_scrub_stamp":"2024-04-19T03:41:04.299169+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:01.619558+0000","scrub_duration":0.003662354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.490790+0000","last_change":"2024-04-19T03:39:51.490790+0000","last_active":"2024-04-19T03:39:51.490790+0000","last_peered":"2024-04-19T03:39:51.490790+0000","last_clean":"2024-04-19T03:39:51.490790+0000","last_became_active":"2024-04-19T03:39:43.434807+0000","last_became_peered":"2024-04-19T03:39:43.434807+0000","last_unstale":"2024-04-19T03:39:51.490790+0000","last_undegraded":"2024-04-19T03:39:51.490790+0000","last_fullsized":"2024-04-19T03:39:51.490790+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1981","last_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_deep_scrub":"70'1981","last_deep_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.490660+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.438851+0000","scrub_duration":0.002801207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.535767+0000","last_change":"2024-04-19T03:40:00.535767+0000","last_active":"2024-04-19T03:40:00.535767+0000","last_peered":"2024-04-19T03:40:00.535767+0000","last_clean":"2024-04-19T03:40:00.535767+0000","last_became_active":"2024-04-19T03:39:43.432885+0000","last_became_peered":"2024-04-19T03:39:43.432885+0000","last_unstale":"2024-04-19T03:40:00.535767+0000","last_undegraded":"2024-04-19T03:40:00.535767+0000","last_fullsized":"2024-04-19T03:40:00.535767+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.535639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:09.252735+0000","scrub_duration":0.0018715909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.617468+0000","last_change":"2024-04-19T03:39:50.617468+0000","last_active":"2024-04-19T03:39:50.617468+0000","last_peered":"2024-04-19T03:39:50.617468+0000","last_clean":"2024-04-19T03:39:50.617468+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:50.617468+0000","last_undegraded":"2024-04-19T03:39:50.617468+0000","last_fullsized":"2024-04-19T03:39:50.617468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_clean_scrub_stamp":"2024-04-19T03:39:50.617321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:52.005449+0000","scrub_duration":0.0027065029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"93'4","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:09.036865+0000","last_change":"2024-04-19T03:41:09.037014+0000","last_active":"2024-04-19T03:41:09.036865+0000","last_peered":"2024-04-19T03:41:09.036865+0000","last_clean":"2024-04-19T03:41:09.036865+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:41:09.036865+0000","last_undegraded":"2024-04-19T03:41:09.036865+0000","last_fullsized":"2024-04-19T03:41:09.036865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:41:09.036840+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:41:09.036840+0000","last_clean_scrub_stamp":"2024-04-19T03:41:09.036840+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:52.981519+0000","scrub_duration":0.0033234079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.395889+0000","last_change":"2024-04-19T03:40:23.395889+0000","last_active":"2024-04-19T03:40:23.395889+0000","last_peered":"2024-04-19T03:40:23.395889+0000","last_clean":"2024-04-19T03:40:23.395889+0000","last_became_active":"2024-04-19T03:39:43.433630+0000","last_became_peered":"2024-04-19T03:39:43.433630+0000","last_unstale":"2024-04-19T03:40:23.395889+0000","last_undegraded":"2024-04-19T03:40:23.395889+0000","last_fullsized":"2024-04-19T03:40:23.395889+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2008","last_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_deep_scrub":"70'2008","last_deep_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:23.395745+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:56:22.631622+0000","scrub_duration":0.002746283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:03.295590+0000","last_change":"2024-04-19T03:41:03.295590+0000","last_active":"2024-04-19T03:41:03.295590+0000","last_peered":"2024-04-19T03:41:03.295590+0000","last_clean":"2024-04-19T03:41:03.295590+0000","last_became_active":"2024-04-19T03:39:43.430616+0000","last_became_peered":"2024-04-19T03:39:43.430616+0000","last_unstale":"2024-04-19T03:41:03.295590+0000","last_undegraded":"2024-04-19T03:41:03.295590+0000","last_fullsized":"2024-04-19T03:41:03.295590+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_clean_scrub_stamp":"2024-04-19T03:41:03.295436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:40.226830+0000","scrub_duration":0.0017184609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.448673+0000","last_change":"2024-04-19T03:40:12.448673+0000","last_active":"2024-04-19T03:40:12.448673+0000","last_peered":"2024-04-19T03:40:12.448673+0000","last_clean":"2024-04-19T03:40:12.448673+0000","last_became_active":"2024-04-19T03:39:43.434699+0000","last_became_peered":"2024-04-19T03:39:43.434699+0000","last_unstale":"2024-04-19T03:40:12.448673+0000","last_undegraded":"2024-04-19T03:40:12.448673+0000","last_fullsized":"2024-04-19T03:40:12.448673+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2035","last_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_deep_scrub":"70'2035","last_deep_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.448493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:23.179035+0000","scrub_duration":0.002191452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:39.214451+0000","last_change":"2024-04-19T03:41:39.214563+0000","last_active":"2024-04-19T03:41:39.214451+0000","last_peered":"2024-04-19T03:41:39.214451+0000","last_clean":"2024-04-19T03:41:39.214451+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:41:39.214451+0000","last_undegraded":"2024-04-19T03:41:39.214451+0000","last_fullsized":"2024-04-19T03:41:39.214451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:39.214425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:39.214425+0000","last_clean_scrub_stamp":"2024-04-19T03:41:39.214425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:04:18.944057+0000","scrub_duration":0.0020519650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.427193+0000","last_change":"2024-04-19T03:40:18.427193+0000","last_active":"2024-04-19T03:40:18.427193+0000","last_peered":"2024-04-19T03:40:18.427193+0000","last_clean":"2024-04-19T03:40:18.427193+0000","last_became_active":"2024-04-19T03:39:43.431921+0000","last_became_peered":"2024-04-19T03:39:43.431921+0000","last_unstale":"2024-04-19T03:40:18.427193+0000","last_undegraded":"2024-04-19T03:40:18.427193+0000","last_fullsized":"2024-04-19T03:40:18.427193+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2045","last_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_deep_scrub":"70'2045","last_deep_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.427077+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:13.005299+0000","scrub_duration":0.0023622740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.368152+0000","last_change":"2024-04-19T03:40:54.368270+0000","last_active":"2024-04-19T03:40:54.368152+0000","last_peered":"2024-04-19T03:40:54.368152+0000","last_clean":"2024-04-19T03:40:54.368152+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:40:54.368152+0000","last_undegraded":"2024-04-19T03:40:54.368152+0000","last_fullsized":"2024-04-19T03:40:54.368152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.368123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:24.596193+0000","scrub_duration":0.001875411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6131,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:10.753203+0000","last_change":"2024-04-19T03:40:10.753203+0000","last_active":"2024-04-19T03:40:10.753203+0000","last_peered":"2024-04-19T03:40:10.753203+0000","last_clean":"2024-04-19T03:40:10.753203+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:40:10.753203+0000","last_undegraded":"2024-04-19T03:40:10.753203+0000","last_fullsized":"2024-04-19T03:40:10.753203+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6031","last_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_deep_scrub":"70'6031","last_deep_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_clean_scrub_stamp":"2024-04-19T03:40:10.753070+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:21.213744+0000","scrub_duration":0.003270387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"93'4","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.909530+0000","last_change":"2024-04-19T03:40:49.909639+0000","last_active":"2024-04-19T03:40:49.909530+0000","last_peered":"2024-04-19T03:40:49.909530+0000","last_clean":"2024-04-19T03:40:49.909530+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:40:49.909530+0000","last_undegraded":"2024-04-19T03:40:49.909530+0000","last_fullsized":"2024-04-19T03:40:49.909530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.909503+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:26.734830+0000","scrub_duration":0.0036995690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:13.104252+0000","last_change":"2024-04-19T03:41:13.104365+0000","last_active":"2024-04-19T03:41:13.104252+0000","last_peered":"2024-04-19T03:41:13.104252+0000","last_clean":"2024-04-19T03:41:13.104252+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:41:13.104252+0000","last_undegraded":"2024-04-19T03:41:13.104252+0000","last_fullsized":"2024-04-19T03:41:13.104252+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:13.104225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:13.104225+0000","last_clean_scrub_stamp":"2024-04-19T03:41:13.104225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:15.360559+0000","scrub_duration":0.001898673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.752557+0000","last_change":"2024-04-19T03:40:08.752671+0000","last_active":"2024-04-19T03:40:08.752557+0000","last_peered":"2024-04-19T03:40:08.752557+0000","last_clean":"2024-04-19T03:40:08.752557+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:40:08.752557+0000","last_undegraded":"2024-04-19T03:40:08.752557+0000","last_fullsized":"2024-04-19T03:40:08.752557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.752529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.556106+0000","scrub_duration":0.002237869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:11.153126+0000","last_change":"2024-04-19T03:41:11.153236+0000","last_active":"2024-04-19T03:41:11.153126+0000","last_peered":"2024-04-19T03:41:11.153126+0000","last_clean":"2024-04-19T03:41:11.153126+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:41:11.153126+0000","last_undegraded":"2024-04-19T03:41:11.153126+0000","last_fullsized":"2024-04-19T03:41:11.153126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:11.153098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:11.153098+0000","last_clean_scrub_stamp":"2024-04-19T03:41:11.153098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:19.786815+0000","scrub_duration":0.0017749490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.007886+0000","last_change":"2024-04-19T03:41:05.008024+0000","last_active":"2024-04-19T03:41:05.007886+0000","last_peered":"2024-04-19T03:41:05.007886+0000","last_clean":"2024-04-19T03:41:05.007886+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:41:05.007886+0000","last_undegraded":"2024-04-19T03:41:05.007886+0000","last_fullsized":"2024-04-19T03:41:05.007886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_deep_scrub":"93'9","last_deep_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.007859+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:06.070427+0000","scrub_duration":0.003113757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.234200+0000","last_change":"2024-04-19T03:40:12.234200+0000","last_active":"2024-04-19T03:40:12.234200+0000","last_peered":"2024-04-19T03:40:12.234200+0000","last_clean":"2024-04-19T03:40:12.234200+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:40:12.234200+0000","last_undegraded":"2024-04-19T03:40:12.234200+0000","last_fullsized":"2024-04-19T03:40:12.234200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.234048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:52.983795+0000","scrub_duration":0.0021178159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.913833+0000","last_change":"2024-04-19T03:40:42.913932+0000","last_active":"2024-04-19T03:40:42.913833+0000","last_peered":"2024-04-19T03:40:42.913833+0000","last_clean":"2024-04-19T03:40:42.913833+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:40:42.913833+0000","last_undegraded":"2024-04-19T03:40:42.913833+0000","last_fullsized":"2024-04-19T03:40:42.913833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.913809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:11.158157+0000","scrub_duration":0.001532853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"93'159","reported_seq":245,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:52.249553+0000","last_change":"2024-04-19T03:40:52.249553+0000","last_active":"2024-04-19T03:40:52.249553+0000","last_peered":"2024-04-19T03:40:52.249553+0000","last_clean":"2024-04-19T03:40:52.249553+0000","last_became_active":"2024-04-19T03:39:43.438741+0000","last_became_peered":"2024-04-19T03:39:43.438741+0000","last_unstale":"2024-04-19T03:40:52.249553+0000","last_undegraded":"2024-04-19T03:40:52.249553+0000","last_fullsized":"2024-04-19T03:40:52.249553+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'159","last_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_deep_scrub":"93'159","last_deep_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_clean_scrub_stamp":"2024-04-19T03:40:52.249385+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:50.993077+0000","scrub_duration":0.006639893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":126,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.897457+0000","last_change":"2024-04-19T03:40:46.897576+0000","last_active":"2024-04-19T03:40:46.897457+0000","last_peered":"2024-04-19T03:40:46.897457+0000","last_clean":"2024-04-19T03:40:46.897457+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:40:46.897457+0000","last_undegraded":"2024-04-19T03:40:46.897457+0000","last_fullsized":"2024-04-19T03:40:46.897457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'5","last_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_deep_scrub":"93'5","last_deep_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.897430+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:16.596202+0000","scrub_duration":0.0029799929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.247773+0000","last_change":"2024-04-19T03:40:42.247912+0000","last_active":"2024-04-19T03:40:42.247773+0000","last_peered":"2024-04-19T03:40:42.247773+0000","last_clean":"2024-04-19T03:40:42.247773+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:40:42.247773+0000","last_undegraded":"2024-04-19T03:40:42.247773+0000","last_fullsized":"2024-04-19T03:40:42.247773+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8001","last_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_deep_scrub":"70'8001","last_deep_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.247746+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:19.073073+0000","scrub_duration":0.0039554270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.324496+0000","last_change":"2024-04-19T03:40:49.324496+0000","last_active":"2024-04-19T03:40:49.324496+0000","last_peered":"2024-04-19T03:40:49.324496+0000","last_clean":"2024-04-19T03:40:49.324496+0000","last_became_active":"2024-04-19T03:39:43.430609+0000","last_became_peered":"2024-04-19T03:39:43.430609+0000","last_unstale":"2024-04-19T03:40:49.324496+0000","last_undegraded":"2024-04-19T03:40:49.324496+0000","last_fullsized":"2024-04-19T03:40:49.324496+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.324336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:09.713311+0000","scrub_duration":0.0017616750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:31.194263+0000","last_change":"2024-04-19T03:41:31.194380+0000","last_active":"2024-04-19T03:41:31.194263+0000","last_peered":"2024-04-19T03:41:31.194263+0000","last_clean":"2024-04-19T03:41:31.194263+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:41:31.194263+0000","last_undegraded":"2024-04-19T03:41:31.194263+0000","last_fullsized":"2024-04-19T03:41:31.194263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:31.194230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:31.194230+0000","last_clean_scrub_stamp":"2024-04-19T03:41:31.194230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:40.952838+0000","scrub_duration":0.0017914579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:54.705566+0000","last_change":"2024-04-19T03:39:54.705566+0000","last_active":"2024-04-19T03:39:54.705566+0000","last_peered":"2024-04-19T03:39:54.705566+0000","last_clean":"2024-04-19T03:39:54.705566+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:54.705566+0000","last_undegraded":"2024-04-19T03:39:54.705566+0000","last_fullsized":"2024-04-19T03:39:54.705566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_clean_scrub_stamp":"2024-04-19T03:39:54.705417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:50:16.417137+0000","scrub_duration":0.0033800929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.452070+0000","last_change":"2024-04-19T03:40:20.452070+0000","last_active":"2024-04-19T03:40:20.452070+0000","last_peered":"2024-04-19T03:40:20.452070+0000","last_clean":"2024-04-19T03:40:20.452070+0000","last_became_active":"2024-04-19T03:39:43.435880+0000","last_became_peered":"2024-04-19T03:39:43.435880+0000","last_unstale":"2024-04-19T03:40:20.452070+0000","last_undegraded":"2024-04-19T03:40:20.452070+0000","last_fullsized":"2024-04-19T03:40:20.452070+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.451936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:29.525420+0000","scrub_duration":0.0019933870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.857769+0000","last_change":"2024-04-19T03:40:48.857891+0000","last_active":"2024-04-19T03:40:48.857769+0000","last_peered":"2024-04-19T03:40:48.857769+0000","last_clean":"2024-04-19T03:40:48.857769+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:40:48.857769+0000","last_undegraded":"2024-04-19T03:40:48.857769+0000","last_fullsized":"2024-04-19T03:40:48.857769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.857745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:15.620029+0000","scrub_duration":0.0021533479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:56.284196+0000","last_change":"2024-04-19T03:40:56.284196+0000","last_active":"2024-04-19T03:40:56.284196+0000","last_peered":"2024-04-19T03:40:56.284196+0000","last_clean":"2024-04-19T03:40:56.284196+0000","last_became_active":"2024-04-19T03:39:43.436182+0000","last_became_peered":"2024-04-19T03:39:43.436182+0000","last_unstale":"2024-04-19T03:40:56.284196+0000","last_undegraded":"2024-04-19T03:40:56.284196+0000","last_fullsized":"2024-04-19T03:40:56.284196+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_clean_scrub_stamp":"2024-04-19T03:40:56.284017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:50:30.538951+0000","scrub_duration":0.0026653649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.159695+0000","last_change":"2024-04-19T03:41:17.159804+0000","last_active":"2024-04-19T03:41:17.159695+0000","last_peered":"2024-04-19T03:41:17.159695+0000","last_clean":"2024-04-19T03:41:17.159695+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:41:17.159695+0000","last_undegraded":"2024-04-19T03:41:17.159695+0000","last_fullsized":"2024-04-19T03:41:17.159695+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:17.159669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:17.159669+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.159669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:35.783665+0000","scrub_duration":0.001766386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:17.412289+0000","last_change":"2024-04-19T03:40:17.412289+0000","last_active":"2024-04-19T03:40:17.412289+0000","last_peered":"2024-04-19T03:40:17.412289+0000","last_clean":"2024-04-19T03:40:17.412289+0000","last_became_active":"2024-04-19T03:39:43.430100+0000","last_became_peered":"2024-04-19T03:39:43.430100+0000","last_unstale":"2024-04-19T03:40:17.412289+0000","last_undegraded":"2024-04-19T03:40:17.412289+0000","last_fullsized":"2024-04-19T03:40:17.412289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_clean_scrub_stamp":"2024-04-19T03:40:17.412165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:23.547748+0000","scrub_duration":0.001842256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":109,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.644185+0000","last_change":"2024-04-19T03:39:51.644185+0000","last_active":"2024-04-19T03:39:51.644185+0000","last_peered":"2024-04-19T03:39:51.644185+0000","last_clean":"2024-04-19T03:39:51.644185+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:51.644185+0000","last_undegraded":"2024-04-19T03:39:51.644185+0000","last_fullsized":"2024-04-19T03:39:51.644185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.644015+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:34.517088+0000","scrub_duration":0.0031723060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:18.177597+0000","last_change":"2024-04-19T03:41:18.177701+0000","last_active":"2024-04-19T03:41:18.177597+0000","last_peered":"2024-04-19T03:41:18.177597+0000","last_clean":"2024-04-19T03:41:18.177597+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:41:18.177597+0000","last_undegraded":"2024-04-19T03:41:18.177597+0000","last_fullsized":"2024-04-19T03:41:18.177597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:18.177571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:18.177571+0000","last_clean_scrub_stamp":"2024-04-19T03:41:18.177571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:17.247688+0000","scrub_duration":0.001928417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.009918+0000","last_change":"2024-04-19T03:41:07.010082+0000","last_active":"2024-04-19T03:41:07.009918+0000","last_peered":"2024-04-19T03:41:07.009918+0000","last_clean":"2024-04-19T03:41:07.009918+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:41:07.009918+0000","last_undegraded":"2024-04-19T03:41:07.009918+0000","last_fullsized":"2024-04-19T03:41:07.009918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.009894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:02.384210+0000","scrub_duration":0.0020010129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2079,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:41.293688+0000","last_change":"2024-04-19T03:40:41.293806+0000","last_active":"2024-04-19T03:40:41.293688+0000","last_peered":"2024-04-19T03:40:41.293688+0000","last_clean":"2024-04-19T03:40:41.293688+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:40:41.293688+0000","last_undegraded":"2024-04-19T03:40:41.293688+0000","last_fullsized":"2024-04-19T03:40:41.293688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1954","last_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_deep_scrub":"70'1954","last_deep_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_clean_scrub_stamp":"2024-04-19T03:40:41.293661+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:08.055945+0000","scrub_duration":0.0022932429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:06.458556+0000","last_change":"2024-04-19T03:40:06.458556+0000","last_active":"2024-04-19T03:40:06.458556+0000","last_peered":"2024-04-19T03:40:06.458556+0000","last_clean":"2024-04-19T03:40:06.458556+0000","last_became_active":"2024-04-19T03:39:43.434441+0000","last_became_peered":"2024-04-19T03:39:43.434441+0000","last_unstale":"2024-04-19T03:40:06.458556+0000","last_undegraded":"2024-04-19T03:40:06.458556+0000","last_fullsized":"2024-04-19T03:40:06.458556+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_clean_scrub_stamp":"2024-04-19T03:40:06.458408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:59.975433+0000","scrub_duration":0.0018363920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:29.306077+0000","last_change":"2024-04-19T03:40:29.306077+0000","last_active":"2024-04-19T03:40:29.306077+0000","last_peered":"2024-04-19T03:40:29.306077+0000","last_clean":"2024-04-19T03:40:29.306077+0000","last_became_active":"2024-04-19T03:39:43.431591+0000","last_became_peered":"2024-04-19T03:39:43.431591+0000","last_unstale":"2024-04-19T03:40:29.306077+0000","last_undegraded":"2024-04-19T03:40:29.306077+0000","last_fullsized":"2024-04-19T03:40:29.306077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_clean_scrub_stamp":"2024-04-19T03:40:29.305921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:42.842536+0000","scrub_duration":0.001644497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.325430+0000","last_change":"2024-04-19T03:40:00.325430+0000","last_active":"2024-04-19T03:40:00.325430+0000","last_peered":"2024-04-19T03:40:00.325430+0000","last_clean":"2024-04-19T03:40:00.325430+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:40:00.325430+0000","last_undegraded":"2024-04-19T03:40:00.325430+0000","last_fullsized":"2024-04-19T03:40:00.325430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.325262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:24.128839+0000","scrub_duration":0.0024403659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:10.199887+0000","last_change":"2024-04-19T03:41:10.200012+0000","last_active":"2024-04-19T03:41:10.199887+0000","last_peered":"2024-04-19T03:41:10.199887+0000","last_clean":"2024-04-19T03:41:10.199887+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:41:10.199887+0000","last_undegraded":"2024-04-19T03:41:10.199887+0000","last_fullsized":"2024-04-19T03:41:10.199887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:41:10.199856+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:41:10.199856+0000","last_clean_scrub_stamp":"2024-04-19T03:41:10.199856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:03:21.601285+0000","scrub_duration":0.0019170070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:57.365883+0000","last_change":"2024-04-19T03:40:57.365883+0000","last_active":"2024-04-19T03:40:57.365883+0000","last_peered":"2024-04-19T03:40:57.365883+0000","last_clean":"2024-04-19T03:40:57.365883+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:40:57.365883+0000","last_undegraded":"2024-04-19T03:40:57.365883+0000","last_fullsized":"2024-04-19T03:40:57.365883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2056","last_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_deep_scrub":"70'2056","last_deep_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_clean_scrub_stamp":"2024-04-19T03:40:57.365740+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:52.740055+0000","scrub_duration":0.0029402849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"93'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.315420+0000","last_change":"2024-04-19T03:40:54.315420+0000","last_active":"2024-04-19T03:40:54.315420+0000","last_peered":"2024-04-19T03:40:54.315420+0000","last_clean":"2024-04-19T03:40:54.315420+0000","last_became_active":"2024-04-19T03:39:43.430259+0000","last_became_peered":"2024-04-19T03:39:43.430259+0000","last_unstale":"2024-04-19T03:40:54.315420+0000","last_undegraded":"2024-04-19T03:40:54.315420+0000","last_fullsized":"2024-04-19T03:40:54.315420+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.315248+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:42.599141+0000","scrub_duration":0.003634445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2100,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:55.536049+0000","last_change":"2024-04-19T03:39:55.536049+0000","last_active":"2024-04-19T03:39:55.536049+0000","last_peered":"2024-04-19T03:39:55.536049+0000","last_clean":"2024-04-19T03:39:55.536049+0000","last_became_active":"2024-04-19T03:39:43.430703+0000","last_became_peered":"2024-04-19T03:39:43.430703+0000","last_unstale":"2024-04-19T03:39:55.536049+0000","last_undegraded":"2024-04-19T03:39:55.536049+0000","last_fullsized":"2024-04-19T03:39:55.536049+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2000","last_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_deep_scrub":"70'2000","last_deep_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_clean_scrub_stamp":"2024-04-19T03:39:55.535891+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:22.625053+0000","scrub_duration":0.002398659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.300397+0000","last_change":"2024-04-19T03:40:46.300397+0000","last_active":"2024-04-19T03:40:46.300397+0000","last_peered":"2024-04-19T03:40:46.300397+0000","last_clean":"2024-04-19T03:40:46.300397+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:40:46.300397+0000","last_undegraded":"2024-04-19T03:40:46.300397+0000","last_fullsized":"2024-04-19T03:40:46.300397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.300234+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:31.841726+0000","scrub_duration":0.0033879449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:26.383543+0000","last_change":"2024-04-19T03:40:26.383543+0000","last_active":"2024-04-19T03:40:26.383543+0000","last_peered":"2024-04-19T03:40:26.383543+0000","last_clean":"2024-04-19T03:40:26.383543+0000","last_became_active":"2024-04-19T03:39:43.433233+0000","last_became_peered":"2024-04-19T03:39:43.433233+0000","last_unstale":"2024-04-19T03:40:26.383543+0000","last_undegraded":"2024-04-19T03:40:26.383543+0000","last_fullsized":"2024-04-19T03:40:26.383543+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'7","last_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_deep_scrub":"70'7","last_deep_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_clean_scrub_stamp":"2024-04-19T03:40:26.383375+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:52.425413+0000","scrub_duration":0.0024732740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.608048+0000","last_change":"2024-04-19T03:40:18.608178+0000","last_active":"2024-04-19T03:40:18.608048+0000","last_peered":"2024-04-19T03:40:18.608048+0000","last_clean":"2024-04-19T03:40:18.608048+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:40:18.608048+0000","last_undegraded":"2024-04-19T03:40:18.608048+0000","last_fullsized":"2024-04-19T03:40:18.608048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.608004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:12.037760+0000","scrub_duration":0.0019643289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:46.173427+0000","last_change":"2024-04-19T03:41:46.173539+0000","last_active":"2024-04-19T03:41:46.173427+0000","last_peered":"2024-04-19T03:41:46.173427+0000","last_clean":"2024-04-19T03:41:46.173427+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:41:46.173427+0000","last_undegraded":"2024-04-19T03:41:46.173427+0000","last_fullsized":"2024-04-19T03:41:46.173427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4062","last_scrub_stamp":"2024-04-19T03:41:46.173399+0000","last_deep_scrub":"70'4062","last_deep_scrub_stamp":"2024-04-19T03:41:46.173399+0000","last_clean_scrub_stamp":"2024-04-19T03:41:46.173399+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:52.166988+0000","scrub_duration":0.004049955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.706465+0000","last_change":"2024-04-19T03:40:12.706465+0000","last_active":"2024-04-19T03:40:12.706465+0000","last_peered":"2024-04-19T03:40:12.706465+0000","last_clean":"2024-04-19T03:40:12.706465+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:40:12.706465+0000","last_undegraded":"2024-04-19T03:40:12.706465+0000","last_fullsized":"2024-04-19T03:40:12.706465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'6","last_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_deep_scrub":"93'6","last_deep_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.706336+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:55.113200+0000","scrub_duration":0.0042115119999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.337639+0000","last_change":"2024-04-19T03:41:05.337639+0000","last_active":"2024-04-19T03:41:05.337639+0000","last_peered":"2024-04-19T03:41:05.337639+0000","last_clean":"2024-04-19T03:41:05.337639+0000","last_became_active":"2024-04-19T03:39:43.435662+0000","last_became_peered":"2024-04-19T03:39:43.435662+0000","last_unstale":"2024-04-19T03:41:05.337639+0000","last_undegraded":"2024-04-19T03:41:05.337639+0000","last_fullsized":"2024-04-19T03:41:05.337639+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.337507+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:19.212270+0000","scrub_duration":0.0024382739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.337549+0000","last_change":"2024-04-19T03:40:27.337549+0000","last_active":"2024-04-19T03:40:27.337549+0000","last_peered":"2024-04-19T03:40:27.337549+0000","last_clean":"2024-04-19T03:40:27.337549+0000","last_became_active":"2024-04-19T03:39:43.433006+0000","last_became_peered":"2024-04-19T03:39:43.433006+0000","last_unstale":"2024-04-19T03:40:27.337549+0000","last_undegraded":"2024-04-19T03:40:27.337549+0000","last_fullsized":"2024-04-19T03:40:27.337549+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.337390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:10.033965+0000","scrub_duration":0.0023860370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":112,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:12.011414+0000","last_change":"2024-04-19T03:41:12.011573+0000","last_active":"2024-04-19T03:41:12.011414+0000","last_peered":"2024-04-19T03:41:12.011414+0000","last_clean":"2024-04-19T03:41:12.011414+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:41:12.011414+0000","last_undegraded":"2024-04-19T03:41:12.011414+0000","last_fullsized":"2024-04-19T03:41:12.011414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'12","last_scrub_stamp":"2024-04-19T03:41:12.011372+0000","last_deep_scrub":"70'12","last_deep_scrub_stamp":"2024-04-19T03:41:12.011372+0000","last_clean_scrub_stamp":"2024-04-19T03:41:12.011372+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:20.950499+0000","scrub_duration":0.0034687899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2090,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809882+0000","last_change":"2024-04-19T03:39:22.424405+0000","last_active":"2024-04-19T03:39:49.809882+0000","last_peered":"2024-04-19T03:39:49.809882+0000","last_clean":"2024-04-19T03:39:49.809882+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:39:49.809882+0000","last_undegraded":"2024-04-19T03:39:49.809882+0000","last_fullsized":"2024-04-19T03:39:49.809882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.008433+0000","last_change":"2024-04-19T03:41:17.008586+0000","last_active":"2024-04-19T03:41:17.008433+0000","last_peered":"2024-04-19T03:41:17.008433+0000","last_clean":"2024-04-19T03:41:17.008433+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:41:17.008433+0000","last_undegraded":"2024-04-19T03:41:17.008433+0000","last_fullsized":"2024-04-19T03:41:17.008433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2016","last_scrub_stamp":"2024-04-19T03:41:17.008393+0000","last_deep_scrub":"70'2016","last_deep_scrub_stamp":"2024-04-19T03:41:17.008393+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.008393+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:15:22.430976+0000","scrub_duration":0.0034046279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.185614+0000","last_change":"2024-04-19T03:40:35.185736+0000","last_active":"2024-04-19T03:40:35.185614+0000","last_peered":"2024-04-19T03:40:35.185614+0000","last_clean":"2024-04-19T03:40:35.185614+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:40:35.185614+0000","last_undegraded":"2024-04-19T03:40:35.185614+0000","last_fullsized":"2024-04-19T03:40:35.185614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2053","last_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_deep_scrub":"70'2053","last_deep_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.185586+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:03.429934+0000","scrub_duration":0.0023438479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481824,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1652,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1691648,"data_stored":1258390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Apr 19 03:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.48899999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369840,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002000,"statfs":{"total":96636764160,"available":96258048000,"internally_reserved":0,"allocated":1679360,"data_stored":1257168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:41:08 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.42899999999999999},"min":{"1min":0.33100000000000002,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.622,"5min":1.087,"15min":1.087},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.58999999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Apr 19 03:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.375},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738442,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":790528,"data_stored":382380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:41:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.45100000000000001},"min":{"1min":0.28899999999999998,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58799999999999997,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.60599999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Apr 19 03:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.63800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.64900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:41:53.822 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:53.822 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:53.822 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:53.822 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:53.822 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:53.823 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:41:53.823 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:42:13.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:42:14.209 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:42:14.212 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:42:14.219 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-04-19T03:42:12.373058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115828,"ondisk_log_size":115828,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795896,"kb_used_data":4064,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319624,"statfs":{"total":289910292480,"available":289095294976,"internally_reserved":0,"allocated":4161536,"data_stored":2897938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003005"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:57.107151+0000","last_change":"2024-04-19T03:41:57.107264+0000","last_active":"2024-04-19T03:41:57.107151+0000","last_peered":"2024-04-19T03:41:57.107151+0000","last_clean":"2024-04-19T03:41:57.107151+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:41:57.107151+0000","last_undegraded":"2024-04-19T03:41:57.107151+0000","last_fullsized":"2024-04-19T03:41:57.107151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1979","last_scrub_stamp":"2024-04-19T03:41:57.107124+0000","last_deep_scrub":"70'1979","last_deep_scrub_stamp":"2024-04-19T03:41:57.107124+0000","last_clean_scrub_stamp":"2024-04-19T03:41:57.107124+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:32.343944+0000","scrub_duration":0.00263583,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":94,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810084+0000","last_change":"2024-04-19T03:35:59.882928+0000","last_active":"2024-04-19T03:39:49.810084+0000","last_peered":"2024-04-19T03:39:49.810084+0000","last_clean":"2024-04-19T03:39:49.810084+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:39:49.810084+0000","last_undegraded":"2024-04-19T03:39:49.810084+0000","last_fullsized":"2024-04-19T03:39:49.810084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4093,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:28.291061+0000","last_change":"2024-04-19T03:40:28.291061+0000","last_active":"2024-04-19T03:40:28.291061+0000","last_peered":"2024-04-19T03:40:28.291061+0000","last_clean":"2024-04-19T03:40:28.291061+0000","last_became_active":"2024-04-19T03:39:43.437251+0000","last_became_peered":"2024-04-19T03:39:43.437251+0000","last_unstale":"2024-04-19T03:40:28.291061+0000","last_undegraded":"2024-04-19T03:40:28.291061+0000","last_fullsized":"2024-04-19T03:40:28.291061+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3993","last_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_deep_scrub":"70'3993","last_deep_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_clean_scrub_stamp":"2024-04-19T03:40:28.290885+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:17.123063+0000","scrub_duration":0.0023123509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.425893+0000","last_change":"2024-04-19T03:40:04.425893+0000","last_active":"2024-04-19T03:40:04.425893+0000","last_peered":"2024-04-19T03:40:04.425893+0000","last_clean":"2024-04-19T03:40:04.425893+0000","last_became_active":"2024-04-19T03:39:43.434583+0000","last_became_peered":"2024-04-19T03:39:43.434583+0000","last_unstale":"2024-04-19T03:40:04.425893+0000","last_undegraded":"2024-04-19T03:40:04.425893+0000","last_fullsized":"2024-04-19T03:40:04.425893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.425751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:07.588193+0000","scrub_duration":0.002196057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:50.306704+0000","last_change":"2024-04-19T03:40:50.306704+0000","last_active":"2024-04-19T03:40:50.306704+0000","last_peered":"2024-04-19T03:40:50.306704+0000","last_clean":"2024-04-19T03:40:50.306704+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:40:50.306704+0000","last_undegraded":"2024-04-19T03:40:50.306704+0000","last_fullsized":"2024-04-19T03:40:50.306704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2051","last_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_deep_scrub":"70'2051","last_deep_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_clean_scrub_stamp":"2024-04-19T03:40:50.306544+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:45.676931+0000","scrub_duration":0.0035400869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:47.306484+0000","last_change":"2024-04-19T03:40:47.306484+0000","last_active":"2024-04-19T03:40:47.306484+0000","last_peered":"2024-04-19T03:40:47.306484+0000","last_clean":"2024-04-19T03:40:47.306484+0000","last_became_active":"2024-04-19T03:39:43.429508+0000","last_became_peered":"2024-04-19T03:39:43.429508+0000","last_unstale":"2024-04-19T03:40:47.306484+0000","last_undegraded":"2024-04-19T03:40:47.306484+0000","last_fullsized":"2024-04-19T03:40:47.306484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_clean_scrub_stamp":"2024-04-19T03:40:47.306304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:24.288058+0000","scrub_duration":0.0027027560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.363907+0000","last_change":"2024-04-19T03:40:32.363907+0000","last_active":"2024-04-19T03:40:32.363907+0000","last_peered":"2024-04-19T03:40:32.363907+0000","last_clean":"2024-04-19T03:40:32.363907+0000","last_became_active":"2024-04-19T03:39:43.428726+0000","last_became_peered":"2024-04-19T03:39:43.428726+0000","last_unstale":"2024-04-19T03:40:32.363907+0000","last_undegraded":"2024-04-19T03:40:32.363907+0000","last_fullsized":"2024-04-19T03:40:32.363907+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.363768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:55:49.483155+0000","scrub_duration":0.0027930099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8141,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:03.416142+0000","last_change":"2024-04-19T03:40:03.416142+0000","last_active":"2024-04-19T03:40:03.416142+0000","last_peered":"2024-04-19T03:40:03.416142+0000","last_clean":"2024-04-19T03:40:03.416142+0000","last_became_active":"2024-04-19T03:39:43.433063+0000","last_became_peered":"2024-04-19T03:39:43.433063+0000","last_unstale":"2024-04-19T03:40:03.416142+0000","last_undegraded":"2024-04-19T03:40:03.416142+0000","last_fullsized":"2024-04-19T03:40:03.416142+0000","mapping_epoch":92,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8029","last_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_deep_scrub":"70'8029","last_deep_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_clean_scrub_stamp":"2024-04-19T03:40:03.416008+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:39.795688+0000","scrub_duration":0.002564808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:41.102056+0000","last_change":"2024-04-19T03:41:41.102169+0000","last_active":"2024-04-19T03:41:41.102056+0000","last_peered":"2024-04-19T03:41:41.102056+0000","last_clean":"2024-04-19T03:41:41.102056+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:41:41.102056+0000","last_undegraded":"2024-04-19T03:41:41.102056+0000","last_fullsized":"2024-04-19T03:41:41.102056+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6074","last_scrub_stamp":"2024-04-19T03:41:41.102029+0000","last_deep_scrub":"70'6074","last_deep_scrub_stamp":"2024-04-19T03:41:41.102029+0000","last_clean_scrub_stamp":"2024-04-19T03:41:41.102029+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:50.860638+0000","scrub_duration":0.0040250590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6187,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:44.241689+0000","last_change":"2024-04-19T03:41:44.241814+0000","last_active":"2024-04-19T03:41:44.241689+0000","last_peered":"2024-04-19T03:41:44.241689+0000","last_clean":"2024-04-19T03:41:44.241689+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:41:44.241689+0000","last_undegraded":"2024-04-19T03:41:44.241689+0000","last_fullsized":"2024-04-19T03:41:44.241689+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6086","last_scrub_stamp":"2024-04-19T03:41:44.241662+0000","last_deep_scrub":"70'6086","last_deep_scrub_stamp":"2024-04-19T03:41:44.241662+0000","last_clean_scrub_stamp":"2024-04-19T03:41:44.241662+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:12.120455+0000","scrub_duration":0.004073119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4039,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:21.433640+0000","last_change":"2024-04-19T03:40:21.433640+0000","last_active":"2024-04-19T03:40:21.433640+0000","last_peered":"2024-04-19T03:40:21.433640+0000","last_clean":"2024-04-19T03:40:21.433640+0000","last_became_active":"2024-04-19T03:39:43.431742+0000","last_became_peered":"2024-04-19T03:39:43.431742+0000","last_unstale":"2024-04-19T03:40:21.433640+0000","last_undegraded":"2024-04-19T03:40:21.433640+0000","last_fullsized":"2024-04-19T03:40:21.433640+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3939","last_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_deep_scrub":"70'3939","last_deep_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_clean_scrub_stamp":"2024-04-19T03:40:21.433514+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:57.721359+0000","scrub_duration":0.0025512870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2181,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.810017+0000","last_change":"2024-04-19T03:39:22.424847+0000","last_active":"2024-04-19T03:39:49.810017+0000","last_peered":"2024-04-19T03:39:49.810017+0000","last_clean":"2024-04-19T03:39:49.810017+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:39:49.810017+0000","last_undegraded":"2024-04-19T03:39:49.810017+0000","last_fullsized":"2024-04-19T03:39:49.810017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2093,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:53.110283+0000","last_change":"2024-04-19T03:41:53.110404+0000","last_active":"2024-04-19T03:41:53.110283+0000","last_peered":"2024-04-19T03:41:53.110283+0000","last_clean":"2024-04-19T03:41:53.110283+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:41:53.110283+0000","last_undegraded":"2024-04-19T03:41:53.110283+0000","last_fullsized":"2024-04-19T03:41:53.110283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1992","last_scrub_stamp":"2024-04-19T03:41:53.110247+0000","last_deep_scrub":"70'1992","last_deep_scrub_stamp":"2024-04-19T03:41:53.110247+0000","last_clean_scrub_stamp":"2024-04-19T03:41:53.110247+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:05.030834+0000","scrub_duration":0.0029438989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:14.425058+0000","last_change":"2024-04-19T03:40:14.425058+0000","last_active":"2024-04-19T03:40:14.425058+0000","last_peered":"2024-04-19T03:40:14.425058+0000","last_clean":"2024-04-19T03:40:14.425058+0000","last_became_active":"2024-04-19T03:39:43.435748+0000","last_became_peered":"2024-04-19T03:39:43.435748+0000","last_unstale":"2024-04-19T03:40:14.425058+0000","last_undegraded":"2024-04-19T03:40:14.425058+0000","last_fullsized":"2024-04-19T03:40:14.425058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2072","last_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_deep_scrub":"70'2072","last_deep_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_clean_scrub_stamp":"2024-04-19T03:40:14.424896+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:23.898309+0000","scrub_duration":0.0031291729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2125,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:31.388574+0000","last_change":"2024-04-19T03:40:31.388574+0000","last_active":"2024-04-19T03:40:31.388574+0000","last_peered":"2024-04-19T03:40:31.388574+0000","last_clean":"2024-04-19T03:40:31.388574+0000","last_became_active":"2024-04-19T03:39:43.430447+0000","last_became_peered":"2024-04-19T03:39:43.430447+0000","last_unstale":"2024-04-19T03:40:31.388574+0000","last_undegraded":"2024-04-19T03:40:31.388574+0000","last_fullsized":"2024-04-19T03:40:31.388574+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2025","last_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_deep_scrub":"70'2025","last_deep_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_clean_scrub_stamp":"2024-04-19T03:40:31.388419+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:12.219961+0000","scrub_duration":0.0023057400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:55.327902+0000","last_change":"2024-04-19T03:40:55.327902+0000","last_active":"2024-04-19T03:40:55.327902+0000","last_peered":"2024-04-19T03:40:55.327902+0000","last_clean":"2024-04-19T03:40:55.327902+0000","last_became_active":"2024-04-19T03:39:43.433748+0000","last_became_peered":"2024-04-19T03:39:43.433748+0000","last_unstale":"2024-04-19T03:40:55.327902+0000","last_undegraded":"2024-04-19T03:40:55.327902+0000","last_fullsized":"2024-04-19T03:40:55.327902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2002","last_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_deep_scrub":"70'2002","last_deep_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_clean_scrub_stamp":"2024-04-19T03:40:55.327775+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:08:48.213870+0000","scrub_duration":0.0026441490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:30.038201+0000","last_change":"2024-04-19T03:41:30.038366+0000","last_active":"2024-04-19T03:41:30.038201+0000","last_peered":"2024-04-19T03:41:30.038201+0000","last_clean":"2024-04-19T03:41:30.038201+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:41:30.038201+0000","last_undegraded":"2024-04-19T03:41:30.038201+0000","last_fullsized":"2024-04-19T03:41:30.038201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1980","last_scrub_stamp":"2024-04-19T03:41:30.038158+0000","last_deep_scrub":"70'1980","last_deep_scrub_stamp":"2024-04-19T03:41:30.038158+0000","last_clean_scrub_stamp":"2024-04-19T03:41:30.038158+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:39.586687+0000","scrub_duration":0.0027094950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2148,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:49.809995+0000","last_change":"2024-04-19T03:35:59.882878+0000","last_active":"2024-04-19T03:39:49.809995+0000","last_peered":"2024-04-19T03:39:49.809995+0000","last_clean":"2024-04-19T03:39:49.809995+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:39:49.809995+0000","last_undegraded":"2024-04-19T03:39:49.809995+0000","last_fullsized":"2024-04-19T03:39:49.809995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:35:59.415213+0000","last_clean_scrub_stamp":"2024-04-19T03:35:59.415213+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:29.015153+0000","last_change":"2024-04-19T03:41:29.015259+0000","last_active":"2024-04-19T03:41:29.015153+0000","last_peered":"2024-04-19T03:41:29.015153+0000","last_clean":"2024-04-19T03:41:29.015153+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:41:29.015153+0000","last_undegraded":"2024-04-19T03:41:29.015153+0000","last_fullsized":"2024-04-19T03:41:29.015153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4052","last_scrub_stamp":"2024-04-19T03:41:29.015128+0000","last_deep_scrub":"70'4052","last_deep_scrub_stamp":"2024-04-19T03:41:29.015128+0000","last_clean_scrub_stamp":"2024-04-19T03:41:29.015128+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:28.085244+0000","scrub_duration":0.0035691020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4186,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.399826+0000","last_change":"2024-04-19T03:40:35.399826+0000","last_active":"2024-04-19T03:40:35.399826+0000","last_peered":"2024-04-19T03:40:35.399826+0000","last_clean":"2024-04-19T03:40:35.399826+0000","last_became_active":"2024-04-19T03:39:43.431899+0000","last_became_peered":"2024-04-19T03:39:43.431899+0000","last_unstale":"2024-04-19T03:40:35.399826+0000","last_undegraded":"2024-04-19T03:40:35.399826+0000","last_fullsized":"2024-04-19T03:40:35.399826+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4086","last_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_deep_scrub":"70'4086","last_deep_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.399694+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:10.836662+0000","scrub_duration":0.0025555930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:07.410737+0000","last_change":"2024-04-19T03:40:07.410737+0000","last_active":"2024-04-19T03:40:07.410737+0000","last_peered":"2024-04-19T03:40:07.410737+0000","last_clean":"2024-04-19T03:40:07.410737+0000","last_became_active":"2024-04-19T03:39:43.431732+0000","last_became_peered":"2024-04-19T03:39:43.431732+0000","last_unstale":"2024-04-19T03:40:07.410737+0000","last_undegraded":"2024-04-19T03:40:07.410737+0000","last_fullsized":"2024-04-19T03:40:07.410737+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'11","last_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_deep_scrub":"70'11","last_deep_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_clean_scrub_stamp":"2024-04-19T03:40:07.410606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:58.262646+0000","scrub_duration":0.0023107370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.207298+0000","last_change":"2024-04-19T03:41:07.207411+0000","last_active":"2024-04-19T03:41:07.207298+0000","last_peered":"2024-04-19T03:41:07.207298+0000","last_clean":"2024-04-19T03:41:07.207298+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:41:07.207298+0000","last_undegraded":"2024-04-19T03:41:07.207298+0000","last_fullsized":"2024-04-19T03:41:07.207298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.207263+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:15:12.629847+0000","scrub_duration":0.0031871450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:28.039679+0000","last_change":"2024-04-19T03:41:28.039806+0000","last_active":"2024-04-19T03:41:28.039679+0000","last_peered":"2024-04-19T03:41:28.039679+0000","last_clean":"2024-04-19T03:41:28.039679+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:41:28.039679+0000","last_undegraded":"2024-04-19T03:41:28.039679+0000","last_fullsized":"2024-04-19T03:41:28.039679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2044","last_scrub_stamp":"2024-04-19T03:41:28.039638+0000","last_deep_scrub":"70'2044","last_deep_scrub_stamp":"2024-04-19T03:41:28.039638+0000","last_clean_scrub_stamp":"2024-04-19T03:41:28.039638+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:46.663635+0000","scrub_duration":0.0029199209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.134428+0000","last_change":"2024-04-19T03:40:32.134573+0000","last_active":"2024-04-19T03:40:32.134428+0000","last_peered":"2024-04-19T03:40:32.134428+0000","last_clean":"2024-04-19T03:40:32.134428+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:40:32.134428+0000","last_undegraded":"2024-04-19T03:40:32.134428+0000","last_fullsized":"2024-04-19T03:40:32.134428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4021","last_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_deep_scrub":"70'4021","last_deep_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.134399+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:06.376575+0000","scrub_duration":0.0035905770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.324323+0000","last_change":"2024-04-19T03:40:04.324323+0000","last_active":"2024-04-19T03:40:04.324323+0000","last_peered":"2024-04-19T03:40:04.324323+0000","last_clean":"2024-04-19T03:40:04.324323+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:40:04.324323+0000","last_undegraded":"2024-04-19T03:40:04.324323+0000","last_fullsized":"2024-04-19T03:40:04.324323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1983","last_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_deep_scrub":"70'1983","last_deep_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.324180+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:46.731044+0000","scrub_duration":0.0027598010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:22.035905+0000","last_change":"2024-04-19T03:41:22.036031+0000","last_active":"2024-04-19T03:41:22.035905+0000","last_peered":"2024-04-19T03:41:22.035905+0000","last_clean":"2024-04-19T03:41:22.035905+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:41:22.035905+0000","last_undegraded":"2024-04-19T03:41:22.035905+0000","last_fullsized":"2024-04-19T03:41:22.035905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:41:22.035877+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:41:22.035877+0000","last_clean_scrub_stamp":"2024-04-19T03:41:22.035877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:30.669594+0000","scrub_duration":0.002404804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:52.486333+0000","last_change":"2024-04-19T03:39:52.486333+0000","last_active":"2024-04-19T03:39:52.486333+0000","last_peered":"2024-04-19T03:39:52.486333+0000","last_clean":"2024-04-19T03:39:52.486333+0000","last_became_active":"2024-04-19T03:39:43.437065+0000","last_became_peered":"2024-04-19T03:39:43.437065+0000","last_unstale":"2024-04-19T03:39:52.486333+0000","last_undegraded":"2024-04-19T03:39:52.486333+0000","last_fullsized":"2024-04-19T03:39:52.486333+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2028","last_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_deep_scrub":"70'2028","last_deep_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_clean_scrub_stamp":"2024-04-19T03:39:52.486195+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:49.821209+0000","scrub_duration":0.0024754260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:37.231826+0000","last_change":"2024-04-19T03:41:37.231947+0000","last_active":"2024-04-19T03:41:37.231826+0000","last_peered":"2024-04-19T03:41:37.231826+0000","last_clean":"2024-04-19T03:41:37.231826+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:41:37.231826+0000","last_undegraded":"2024-04-19T03:41:37.231826+0000","last_fullsized":"2024-04-19T03:41:37.231826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:41:37.231798+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:41:37.231798+0000","last_clean_scrub_stamp":"2024-04-19T03:41:37.231798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:47:49.109320+0000","scrub_duration":0.0020331149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":129,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:22.199937+0000","last_change":"2024-04-19T03:40:22.199937+0000","last_active":"2024-04-19T03:40:22.199937+0000","last_peered":"2024-04-19T03:40:22.199937+0000","last_clean":"2024-04-19T03:40:22.199937+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:40:22.199937+0000","last_undegraded":"2024-04-19T03:40:22.199937+0000","last_fullsized":"2024-04-19T03:40:22.199937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_clean_scrub_stamp":"2024-04-19T03:40:22.199728+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:08:02.693048+0000","scrub_duration":0.0026297960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.760857+0000","last_change":"2024-04-19T03:40:32.760857+0000","last_active":"2024-04-19T03:40:32.760857+0000","last_peered":"2024-04-19T03:40:32.760857+0000","last_clean":"2024-04-19T03:40:32.760857+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:40:32.760857+0000","last_undegraded":"2024-04-19T03:40:32.760857+0000","last_fullsized":"2024-04-19T03:40:32.760857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.760689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:48.412394+0000","scrub_duration":0.001792664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.970164+0000","last_change":"2024-04-19T03:41:17.970164+0000","last_active":"2024-04-19T03:41:17.970164+0000","last_peered":"2024-04-19T03:41:17.970164+0000","last_clean":"2024-04-19T03:41:17.970164+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:41:17.970164+0000","last_undegraded":"2024-04-19T03:41:17.970164+0000","last_fullsized":"2024-04-19T03:41:17.970164+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:41:17.970042+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:41:17.970042+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.970042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:30.160406+0000","scrub_duration":0.0029412599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.857512+0000","last_change":"2024-04-19T03:40:39.857512+0000","last_active":"2024-04-19T03:40:39.857512+0000","last_peered":"2024-04-19T03:40:39.857512+0000","last_clean":"2024-04-19T03:40:39.857512+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:40:39.857512+0000","last_undegraded":"2024-04-19T03:40:39.857512+0000","last_fullsized":"2024-04-19T03:40:39.857512+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.857367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:14.099544+0000","scrub_duration":0.0016111649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.287222+0000","last_change":"2024-04-19T03:40:39.287366+0000","last_active":"2024-04-19T03:40:39.287222+0000","last_peered":"2024-04-19T03:40:39.287222+0000","last_clean":"2024-04-19T03:40:39.287222+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:40:39.287222+0000","last_undegraded":"2024-04-19T03:40:39.287222+0000","last_fullsized":"2024-04-19T03:40:39.287222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.287191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:08.985963+0000","scrub_duration":0.0020786289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.690988+0000","last_change":"2024-04-19T03:40:27.690988+0000","last_active":"2024-04-19T03:40:27.690988+0000","last_peered":"2024-04-19T03:40:27.690988+0000","last_clean":"2024-04-19T03:40:27.690988+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:40:27.690988+0000","last_undegraded":"2024-04-19T03:40:27.690988+0000","last_fullsized":"2024-04-19T03:40:27.690988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.690844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:32.347176+0000","scrub_duration":0.001791932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:59.727483+0000","last_change":"2024-04-19T03:39:59.727483+0000","last_active":"2024-04-19T03:39:59.727483+0000","last_peered":"2024-04-19T03:39:59.727483+0000","last_clean":"2024-04-19T03:39:59.727483+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:59.727483+0000","last_undegraded":"2024-04-19T03:39:59.727483+0000","last_fullsized":"2024-04-19T03:39:59.727483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_clean_scrub_stamp":"2024-04-19T03:39:59.727297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:17.092087+0000","scrub_duration":0.0035426419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:25.393587+0000","last_change":"2024-04-19T03:40:25.393587+0000","last_active":"2024-04-19T03:40:25.393587+0000","last_peered":"2024-04-19T03:40:25.393587+0000","last_clean":"2024-04-19T03:40:25.393587+0000","last_became_active":"2024-04-19T03:39:43.429210+0000","last_became_peered":"2024-04-19T03:39:43.429210+0000","last_unstale":"2024-04-19T03:40:25.393587+0000","last_undegraded":"2024-04-19T03:40:25.393587+0000","last_fullsized":"2024-04-19T03:40:25.393587+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_clean_scrub_stamp":"2024-04-19T03:40:25.393456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:41.962081+0000","scrub_duration":0.002168045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:16.670035+0000","last_change":"2024-04-19T03:40:16.670035+0000","last_active":"2024-04-19T03:40:16.670035+0000","last_peered":"2024-04-19T03:40:16.670035+0000","last_clean":"2024-04-19T03:40:16.670035+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:40:16.670035+0000","last_undegraded":"2024-04-19T03:40:16.670035+0000","last_fullsized":"2024-04-19T03:40:16.670035+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5950","last_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_deep_scrub":"70'5950","last_deep_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_clean_scrub_stamp":"2024-04-19T03:40:16.669845+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:00.796011+0000","scrub_duration":0.0029482610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"93'8","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:42.240191+0000","last_change":"2024-04-19T03:41:42.240315+0000","last_active":"2024-04-19T03:41:42.240191+0000","last_peered":"2024-04-19T03:41:42.240191+0000","last_clean":"2024-04-19T03:41:42.240191+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:41:42.240191+0000","last_undegraded":"2024-04-19T03:41:42.240191+0000","last_fullsized":"2024-04-19T03:41:42.240191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'8","last_scrub_stamp":"2024-04-19T03:41:42.240166+0000","last_deep_scrub":"93'8","last_deep_scrub_stamp":"2024-04-19T03:41:42.240166+0000","last_clean_scrub_stamp":"2024-04-19T03:41:42.240166+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:01.948223+0000","scrub_duration":0.0037955760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.615150+0000","last_change":"2024-04-19T03:40:20.615150+0000","last_active":"2024-04-19T03:40:20.615150+0000","last_peered":"2024-04-19T03:40:20.615150+0000","last_clean":"2024-04-19T03:40:20.615150+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:40:20.615150+0000","last_undegraded":"2024-04-19T03:40:20.615150+0000","last_fullsized":"2024-04-19T03:40:20.615150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4063","last_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_deep_scrub":"70'4063","last_deep_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.614982+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:01.364729+0000","scrub_duration":0.003172963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"93'99","reported_seq":70,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.346209+0000","last_change":"2024-04-19T03:40:48.346209+0000","last_active":"2024-04-19T03:40:48.346209+0000","last_peered":"2024-04-19T03:40:48.346209+0000","last_clean":"2024-04-19T03:40:48.346209+0000","last_became_active":"2024-04-19T03:39:43.437298+0000","last_became_peered":"2024-04-19T03:39:43.437298+0000","last_unstale":"2024-04-19T03:40:48.346209+0000","last_undegraded":"2024-04-19T03:40:48.346209+0000","last_fullsized":"2024-04-19T03:40:48.346209+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'99","last_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_deep_scrub":"93'99","last_deep_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.346076+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:13.038605+0000","scrub_duration":0.007204322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:40.440980+0000","last_change":"2024-04-19T03:40:40.440980+0000","last_active":"2024-04-19T03:40:40.440980+0000","last_peered":"2024-04-19T03:40:40.440980+0000","last_clean":"2024-04-19T03:40:40.440980+0000","last_became_active":"2024-04-19T03:39:43.434605+0000","last_became_peered":"2024-04-19T03:39:43.434605+0000","last_unstale":"2024-04-19T03:40:40.440980+0000","last_undegraded":"2024-04-19T03:40:40.440980+0000","last_fullsized":"2024-04-19T03:40:40.440980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4083","last_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_deep_scrub":"70'4083","last_deep_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_clean_scrub_stamp":"2024-04-19T03:40:40.440842+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:45.344854+0000","scrub_duration":0.0025970279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"93'4","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.460494+0000","last_change":"2024-04-19T03:40:42.460494+0000","last_active":"2024-04-19T03:40:42.460494+0000","last_peered":"2024-04-19T03:40:42.460494+0000","last_clean":"2024-04-19T03:40:42.460494+0000","last_became_active":"2024-04-19T03:39:43.431842+0000","last_became_peered":"2024-04-19T03:39:43.431842+0000","last_unstale":"2024-04-19T03:40:42.460494+0000","last_undegraded":"2024-04-19T03:40:42.460494+0000","last_fullsized":"2024-04-19T03:40:42.460494+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.460363+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:49.733129+0000","scrub_duration":0.003431403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2076,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.285715+0000","last_change":"2024-04-19T03:40:08.285715+0000","last_active":"2024-04-19T03:40:08.285715+0000","last_peered":"2024-04-19T03:40:08.285715+0000","last_clean":"2024-04-19T03:40:08.285715+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:40:08.285715+0000","last_undegraded":"2024-04-19T03:40:08.285715+0000","last_fullsized":"2024-04-19T03:40:08.285715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1975","last_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_deep_scrub":"70'1975","last_deep_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.285526+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:52.411692+0000","scrub_duration":0.0032122520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:11.030687+0000","last_change":"2024-04-19T03:41:11.030803+0000","last_active":"2024-04-19T03:41:11.030687+0000","last_peered":"2024-04-19T03:41:11.030687+0000","last_clean":"2024-04-19T03:41:11.030687+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:41:11.030687+0000","last_undegraded":"2024-04-19T03:41:11.030687+0000","last_fullsized":"2024-04-19T03:41:11.030687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:11.030662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:11.030662+0000","last_clean_scrub_stamp":"2024-04-19T03:41:11.030662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:29.251141+0000","scrub_duration":0.0017162169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:11.249784+0000","last_change":"2024-04-19T03:40:11.249784+0000","last_active":"2024-04-19T03:40:11.249784+0000","last_peered":"2024-04-19T03:40:11.249784+0000","last_clean":"2024-04-19T03:40:11.249784+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:40:11.249784+0000","last_undegraded":"2024-04-19T03:40:11.249784+0000","last_fullsized":"2024-04-19T03:40:11.249784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2033","last_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_deep_scrub":"70'2033","last_deep_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_clean_scrub_stamp":"2024-04-19T03:40:11.249632+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:04.679387+0000","scrub_duration":0.0039095689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:58.391315+0000","last_change":"2024-04-19T03:40:58.391420+0000","last_active":"2024-04-19T03:40:58.391315+0000","last_peered":"2024-04-19T03:40:58.391315+0000","last_clean":"2024-04-19T03:40:58.391315+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:40:58.391315+0000","last_undegraded":"2024-04-19T03:40:58.391315+0000","last_fullsized":"2024-04-19T03:40:58.391315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_clean_scrub_stamp":"2024-04-19T03:40:58.391280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:42.335959+0000","scrub_duration":0.001857837,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:30.761230+0000","last_change":"2024-04-19T03:40:30.761230+0000","last_active":"2024-04-19T03:40:30.761230+0000","last_peered":"2024-04-19T03:40:30.761230+0000","last_clean":"2024-04-19T03:40:30.761230+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:40:30.761230+0000","last_undegraded":"2024-04-19T03:40:30.761230+0000","last_fullsized":"2024-04-19T03:40:30.761230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'10","last_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_deep_scrub":"70'10","last_deep_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_clean_scrub_stamp":"2024-04-19T03:40:30.761100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:51.151497+0000","scrub_duration":0.0024608220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"93'13","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.342391+0000","last_change":"2024-04-19T03:40:33.342391+0000","last_active":"2024-04-19T03:40:33.342391+0000","last_peered":"2024-04-19T03:40:33.342391+0000","last_clean":"2024-04-19T03:40:33.342391+0000","last_became_active":"2024-04-19T03:39:43.436291+0000","last_became_peered":"2024-04-19T03:39:43.436291+0000","last_unstale":"2024-04-19T03:40:33.342391+0000","last_undegraded":"2024-04-19T03:40:33.342391+0000","last_fullsized":"2024-04-19T03:40:33.342391+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'13","last_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_deep_scrub":"93'13","last_deep_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.342214+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:39:21.052990+0000","scrub_duration":0.0050089979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2219,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.743742+0000","last_change":"2024-04-19T03:40:33.743742+0000","last_active":"2024-04-19T03:40:33.743742+0000","last_peered":"2024-04-19T03:40:33.743742+0000","last_clean":"2024-04-19T03:40:33.743742+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:40:33.743742+0000","last_undegraded":"2024-04-19T03:40:33.743742+0000","last_fullsized":"2024-04-19T03:40:33.743742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2095","last_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_deep_scrub":"70'2095","last_deep_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.743609+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:30.726079+0000","scrub_duration":0.0029003269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"93'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.429204+0000","last_change":"2024-04-19T03:40:08.429204+0000","last_active":"2024-04-19T03:40:08.429204+0000","last_peered":"2024-04-19T03:40:08.429204+0000","last_clean":"2024-04-19T03:40:08.429204+0000","last_became_active":"2024-04-19T03:39:43.431751+0000","last_became_peered":"2024-04-19T03:39:43.431751+0000","last_unstale":"2024-04-19T03:40:08.429204+0000","last_undegraded":"2024-04-19T03:40:08.429204+0000","last_fullsized":"2024-04-19T03:40:08.429204+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.429067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:52.134126+0000","scrub_duration":0.0036343399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:02.298573+0000","last_change":"2024-04-19T03:40:02.298573+0000","last_active":"2024-04-19T03:40:02.298573+0000","last_peered":"2024-04-19T03:40:02.298573+0000","last_clean":"2024-04-19T03:40:02.298573+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:40:02.298573+0000","last_undegraded":"2024-04-19T03:40:02.298573+0000","last_fullsized":"2024-04-19T03:40:02.298573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2054","last_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_deep_scrub":"70'2054","last_deep_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_clean_scrub_stamp":"2024-04-19T03:40:02.298435+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:12.759109+0000","scrub_duration":0.0023525339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"93'3","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:02.299399+0000","last_change":"2024-04-19T03:41:02.299516+0000","last_active":"2024-04-19T03:41:02.299399+0000","last_peered":"2024-04-19T03:41:02.299399+0000","last_clean":"2024-04-19T03:41:02.299399+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:41:02.299399+0000","last_undegraded":"2024-04-19T03:41:02.299399+0000","last_fullsized":"2024-04-19T03:41:02.299399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_clean_scrub_stamp":"2024-04-19T03:41:02.299371+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:42.745471+0000","scrub_duration":0.0032937819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:01.328432+0000","last_change":"2024-04-19T03:41:01.328574+0000","last_active":"2024-04-19T03:41:01.328432+0000","last_peered":"2024-04-19T03:41:01.328432+0000","last_clean":"2024-04-19T03:41:01.328432+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:41:01.328432+0000","last_undegraded":"2024-04-19T03:41:01.328432+0000","last_fullsized":"2024-04-19T03:41:01.328432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2","last_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_deep_scrub":"70'2","last_deep_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_clean_scrub_stamp":"2024-04-19T03:41:01.328403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:19.548881+0000","scrub_duration":0.003585155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"93'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:04.299312+0000","last_change":"2024-04-19T03:41:04.299312+0000","last_active":"2024-04-19T03:41:04.299312+0000","last_peered":"2024-04-19T03:41:04.299312+0000","last_clean":"2024-04-19T03:41:04.299312+0000","last_became_active":"2024-04-19T03:39:43.436323+0000","last_became_peered":"2024-04-19T03:39:43.436323+0000","last_unstale":"2024-04-19T03:41:04.299312+0000","last_undegraded":"2024-04-19T03:41:04.299312+0000","last_fullsized":"2024-04-19T03:41:04.299312+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_clean_scrub_stamp":"2024-04-19T03:41:04.299169+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:01.619558+0000","scrub_duration":0.003662354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.490790+0000","last_change":"2024-04-19T03:39:51.490790+0000","last_active":"2024-04-19T03:39:51.490790+0000","last_peered":"2024-04-19T03:39:51.490790+0000","last_clean":"2024-04-19T03:39:51.490790+0000","last_became_active":"2024-04-19T03:39:43.434807+0000","last_became_peered":"2024-04-19T03:39:43.434807+0000","last_unstale":"2024-04-19T03:39:51.490790+0000","last_undegraded":"2024-04-19T03:39:51.490790+0000","last_fullsized":"2024-04-19T03:39:51.490790+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1981","last_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_deep_scrub":"70'1981","last_deep_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.490660+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.438851+0000","scrub_duration":0.002801207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.535767+0000","last_change":"2024-04-19T03:40:00.535767+0000","last_active":"2024-04-19T03:40:00.535767+0000","last_peered":"2024-04-19T03:40:00.535767+0000","last_clean":"2024-04-19T03:40:00.535767+0000","last_became_active":"2024-04-19T03:39:43.432885+0000","last_became_peered":"2024-04-19T03:39:43.432885+0000","last_unstale":"2024-04-19T03:40:00.535767+0000","last_undegraded":"2024-04-19T03:40:00.535767+0000","last_fullsized":"2024-04-19T03:40:00.535767+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.535639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:09.252735+0000","scrub_duration":0.0018715909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.617468+0000","last_change":"2024-04-19T03:39:50.617468+0000","last_active":"2024-04-19T03:39:50.617468+0000","last_peered":"2024-04-19T03:39:50.617468+0000","last_clean":"2024-04-19T03:39:50.617468+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:50.617468+0000","last_undegraded":"2024-04-19T03:39:50.617468+0000","last_fullsized":"2024-04-19T03:39:50.617468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_clean_scrub_stamp":"2024-04-19T03:39:50.617321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:52.005449+0000","scrub_duration":0.0027065029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"93'4","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:09.036865+0000","last_change":"2024-04-19T03:41:09.037014+0000","last_active":"2024-04-19T03:41:09.036865+0000","last_peered":"2024-04-19T03:41:09.036865+0000","last_clean":"2024-04-19T03:41:09.036865+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:41:09.036865+0000","last_undegraded":"2024-04-19T03:41:09.036865+0000","last_fullsized":"2024-04-19T03:41:09.036865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:41:09.036840+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:41:09.036840+0000","last_clean_scrub_stamp":"2024-04-19T03:41:09.036840+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:52.981519+0000","scrub_duration":0.0033234079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.395889+0000","last_change":"2024-04-19T03:40:23.395889+0000","last_active":"2024-04-19T03:40:23.395889+0000","last_peered":"2024-04-19T03:40:23.395889+0000","last_clean":"2024-04-19T03:40:23.395889+0000","last_became_active":"2024-04-19T03:39:43.433630+0000","last_became_peered":"2024-04-19T03:39:43.433630+0000","last_unstale":"2024-04-19T03:40:23.395889+0000","last_undegraded":"2024-04-19T03:40:23.395889+0000","last_fullsized":"2024-04-19T03:40:23.395889+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2008","last_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_deep_scrub":"70'2008","last_deep_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:23.395745+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:56:22.631622+0000","scrub_duration":0.002746283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:03.295590+0000","last_change":"2024-04-19T03:41:03.295590+0000","last_active":"2024-04-19T03:41:03.295590+0000","last_peered":"2024-04-19T03:41:03.295590+0000","last_clean":"2024-04-19T03:41:03.295590+0000","last_became_active":"2024-04-19T03:39:43.430616+0000","last_became_peered":"2024-04-19T03:39:43.430616+0000","last_unstale":"2024-04-19T03:41:03.295590+0000","last_undegraded":"2024-04-19T03:41:03.295590+0000","last_fullsized":"2024-04-19T03:41:03.295590+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_clean_scrub_stamp":"2024-04-19T03:41:03.295436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:40.226830+0000","scrub_duration":0.0017184609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.448673+0000","last_change":"2024-04-19T03:40:12.448673+0000","last_active":"2024-04-19T03:40:12.448673+0000","last_peered":"2024-04-19T03:40:12.448673+0000","last_clean":"2024-04-19T03:40:12.448673+0000","last_became_active":"2024-04-19T03:39:43.434699+0000","last_became_peered":"2024-04-19T03:39:43.434699+0000","last_unstale":"2024-04-19T03:40:12.448673+0000","last_undegraded":"2024-04-19T03:40:12.448673+0000","last_fullsized":"2024-04-19T03:40:12.448673+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2035","last_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_deep_scrub":"70'2035","last_deep_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.448493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:23.179035+0000","scrub_duration":0.002191452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:39.214451+0000","last_change":"2024-04-19T03:41:39.214563+0000","last_active":"2024-04-19T03:41:39.214451+0000","last_peered":"2024-04-19T03:41:39.214451+0000","last_clean":"2024-04-19T03:41:39.214451+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:41:39.214451+0000","last_undegraded":"2024-04-19T03:41:39.214451+0000","last_fullsized":"2024-04-19T03:41:39.214451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:39.214425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:39.214425+0000","last_clean_scrub_stamp":"2024-04-19T03:41:39.214425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:04:18.944057+0000","scrub_duration":0.0020519650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.427193+0000","last_change":"2024-04-19T03:40:18.427193+0000","last_active":"2024-04-19T03:40:18.427193+0000","last_peered":"2024-04-19T03:40:18.427193+0000","last_clean":"2024-04-19T03:40:18.427193+0000","last_became_active":"2024-04-19T03:39:43.431921+0000","last_became_peered":"2024-04-19T03:39:43.431921+0000","last_unstale":"2024-04-19T03:40:18.427193+0000","last_undegraded":"2024-04-19T03:40:18.427193+0000","last_fullsized":"2024-04-19T03:40:18.427193+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2045","last_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_deep_scrub":"70'2045","last_deep_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.427077+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:13.005299+0000","scrub_duration":0.0023622740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.368152+0000","last_change":"2024-04-19T03:40:54.368270+0000","last_active":"2024-04-19T03:40:54.368152+0000","last_peered":"2024-04-19T03:40:54.368152+0000","last_clean":"2024-04-19T03:40:54.368152+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:40:54.368152+0000","last_undegraded":"2024-04-19T03:40:54.368152+0000","last_fullsized":"2024-04-19T03:40:54.368152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.368123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:24.596193+0000","scrub_duration":0.001875411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6131,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:10.753203+0000","last_change":"2024-04-19T03:40:10.753203+0000","last_active":"2024-04-19T03:40:10.753203+0000","last_peered":"2024-04-19T03:40:10.753203+0000","last_clean":"2024-04-19T03:40:10.753203+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:40:10.753203+0000","last_undegraded":"2024-04-19T03:40:10.753203+0000","last_fullsized":"2024-04-19T03:40:10.753203+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6031","last_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_deep_scrub":"70'6031","last_deep_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_clean_scrub_stamp":"2024-04-19T03:40:10.753070+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:21.213744+0000","scrub_duration":0.003270387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"93'4","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.909530+0000","last_change":"2024-04-19T03:40:49.909639+0000","last_active":"2024-04-19T03:40:49.909530+0000","last_peered":"2024-04-19T03:40:49.909530+0000","last_clean":"2024-04-19T03:40:49.909530+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:40:49.909530+0000","last_undegraded":"2024-04-19T03:40:49.909530+0000","last_fullsized":"2024-04-19T03:40:49.909530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.909503+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:26.734830+0000","scrub_duration":0.0036995690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:13.104252+0000","last_change":"2024-04-19T03:41:13.104365+0000","last_active":"2024-04-19T03:41:13.104252+0000","last_peered":"2024-04-19T03:41:13.104252+0000","last_clean":"2024-04-19T03:41:13.104252+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:41:13.104252+0000","last_undegraded":"2024-04-19T03:41:13.104252+0000","last_fullsized":"2024-04-19T03:41:13.104252+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:13.104225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:13.104225+0000","last_clean_scrub_stamp":"2024-04-19T03:41:13.104225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:15.360559+0000","scrub_duration":0.001898673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.752671+0000","last_change":"2024-04-19T03:40:08.752671+0000","last_active":"2024-04-19T03:40:08.752671+0000","last_peered":"2024-04-19T03:40:08.752671+0000","last_clean":"2024-04-19T03:40:08.752671+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:40:08.752671+0000","last_undegraded":"2024-04-19T03:40:08.752671+0000","last_fullsized":"2024-04-19T03:40:08.752671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.752529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.556106+0000","scrub_duration":0.002237869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:11.153126+0000","last_change":"2024-04-19T03:41:11.153236+0000","last_active":"2024-04-19T03:41:11.153126+0000","last_peered":"2024-04-19T03:41:11.153126+0000","last_clean":"2024-04-19T03:41:11.153126+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:41:11.153126+0000","last_undegraded":"2024-04-19T03:41:11.153126+0000","last_fullsized":"2024-04-19T03:41:11.153126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:11.153098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:11.153098+0000","last_clean_scrub_stamp":"2024-04-19T03:41:11.153098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:19.786815+0000","scrub_duration":0.0017749490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.007886+0000","last_change":"2024-04-19T03:41:05.008024+0000","last_active":"2024-04-19T03:41:05.007886+0000","last_peered":"2024-04-19T03:41:05.007886+0000","last_clean":"2024-04-19T03:41:05.007886+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:41:05.007886+0000","last_undegraded":"2024-04-19T03:41:05.007886+0000","last_fullsized":"2024-04-19T03:41:05.007886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_deep_scrub":"93'9","last_deep_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.007859+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:06.070427+0000","scrub_duration":0.003113757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.234200+0000","last_change":"2024-04-19T03:40:12.234200+0000","last_active":"2024-04-19T03:40:12.234200+0000","last_peered":"2024-04-19T03:40:12.234200+0000","last_clean":"2024-04-19T03:40:12.234200+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:40:12.234200+0000","last_undegraded":"2024-04-19T03:40:12.234200+0000","last_fullsized":"2024-04-19T03:40:12.234200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.234048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:52.983795+0000","scrub_duration":0.0021178159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.913833+0000","last_change":"2024-04-19T03:40:42.913932+0000","last_active":"2024-04-19T03:40:42.913833+0000","last_peered":"2024-04-19T03:40:42.913833+0000","last_clean":"2024-04-19T03:40:42.913833+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:40:42.913833+0000","last_undegraded":"2024-04-19T03:40:42.913833+0000","last_fullsized":"2024-04-19T03:40:42.913833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.913809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:11.158157+0000","scrub_duration":0.001532853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"93'159","reported_seq":245,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:52.249553+0000","last_change":"2024-04-19T03:40:52.249553+0000","last_active":"2024-04-19T03:40:52.249553+0000","last_peered":"2024-04-19T03:40:52.249553+0000","last_clean":"2024-04-19T03:40:52.249553+0000","last_became_active":"2024-04-19T03:39:43.438741+0000","last_became_peered":"2024-04-19T03:39:43.438741+0000","last_unstale":"2024-04-19T03:40:52.249553+0000","last_undegraded":"2024-04-19T03:40:52.249553+0000","last_fullsized":"2024-04-19T03:40:52.249553+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'159","last_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_deep_scrub":"93'159","last_deep_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_clean_scrub_stamp":"2024-04-19T03:40:52.249385+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:50.993077+0000","scrub_duration":0.006639893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":126,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.897457+0000","last_change":"2024-04-19T03:40:46.897576+0000","last_active":"2024-04-19T03:40:46.897457+0000","last_peered":"2024-04-19T03:40:46.897457+0000","last_clean":"2024-04-19T03:40:46.897457+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:40:46.897457+0000","last_undegraded":"2024-04-19T03:40:46.897457+0000","last_fullsized":"2024-04-19T03:40:46.897457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'5","last_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_deep_scrub":"93'5","last_deep_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.897430+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:16.596202+0000","scrub_duration":0.0029799929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.247773+0000","last_change":"2024-04-19T03:40:42.247912+0000","last_active":"2024-04-19T03:40:42.247773+0000","last_peered":"2024-04-19T03:40:42.247773+0000","last_clean":"2024-04-19T03:40:42.247773+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:40:42.247773+0000","last_undegraded":"2024-04-19T03:40:42.247773+0000","last_fullsized":"2024-04-19T03:40:42.247773+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8001","last_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_deep_scrub":"70'8001","last_deep_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.247746+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:19.073073+0000","scrub_duration":0.0039554270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.324496+0000","last_change":"2024-04-19T03:40:49.324496+0000","last_active":"2024-04-19T03:40:49.324496+0000","last_peered":"2024-04-19T03:40:49.324496+0000","last_clean":"2024-04-19T03:40:49.324496+0000","last_became_active":"2024-04-19T03:39:43.430609+0000","last_became_peered":"2024-04-19T03:39:43.430609+0000","last_unstale":"2024-04-19T03:40:49.324496+0000","last_undegraded":"2024-04-19T03:40:49.324496+0000","last_fullsized":"2024-04-19T03:40:49.324496+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.324336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:09.713311+0000","scrub_duration":0.0017616750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:31.194380+0000","last_change":"2024-04-19T03:41:31.194380+0000","last_active":"2024-04-19T03:41:31.194380+0000","last_peered":"2024-04-19T03:41:31.194380+0000","last_clean":"2024-04-19T03:41:31.194380+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:41:31.194380+0000","last_undegraded":"2024-04-19T03:41:31.194380+0000","last_fullsized":"2024-04-19T03:41:31.194380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:31.194230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:31.194230+0000","last_clean_scrub_stamp":"2024-04-19T03:41:31.194230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:40.952838+0000","scrub_duration":0.0017914579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":105,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:54.705566+0000","last_change":"2024-04-19T03:39:54.705566+0000","last_active":"2024-04-19T03:39:54.705566+0000","last_peered":"2024-04-19T03:39:54.705566+0000","last_clean":"2024-04-19T03:39:54.705566+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:39:54.705566+0000","last_undegraded":"2024-04-19T03:39:54.705566+0000","last_fullsized":"2024-04-19T03:39:54.705566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_clean_scrub_stamp":"2024-04-19T03:39:54.705417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:50:16.417137+0000","scrub_duration":0.0033800929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.452070+0000","last_change":"2024-04-19T03:40:20.452070+0000","last_active":"2024-04-19T03:40:20.452070+0000","last_peered":"2024-04-19T03:40:20.452070+0000","last_clean":"2024-04-19T03:40:20.452070+0000","last_became_active":"2024-04-19T03:39:43.435880+0000","last_became_peered":"2024-04-19T03:39:43.435880+0000","last_unstale":"2024-04-19T03:40:20.452070+0000","last_undegraded":"2024-04-19T03:40:20.452070+0000","last_fullsized":"2024-04-19T03:40:20.452070+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.451936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:29.525420+0000","scrub_duration":0.0019933870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.857769+0000","last_change":"2024-04-19T03:40:48.857891+0000","last_active":"2024-04-19T03:40:48.857769+0000","last_peered":"2024-04-19T03:40:48.857769+0000","last_clean":"2024-04-19T03:40:48.857769+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:40:48.857769+0000","last_undegraded":"2024-04-19T03:40:48.857769+0000","last_fullsized":"2024-04-19T03:40:48.857769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.857745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:15.620029+0000","scrub_duration":0.0021533479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:56.284196+0000","last_change":"2024-04-19T03:40:56.284196+0000","last_active":"2024-04-19T03:40:56.284196+0000","last_peered":"2024-04-19T03:40:56.284196+0000","last_clean":"2024-04-19T03:40:56.284196+0000","last_became_active":"2024-04-19T03:39:43.436182+0000","last_became_peered":"2024-04-19T03:39:43.436182+0000","last_unstale":"2024-04-19T03:40:56.284196+0000","last_undegraded":"2024-04-19T03:40:56.284196+0000","last_fullsized":"2024-04-19T03:40:56.284196+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_clean_scrub_stamp":"2024-04-19T03:40:56.284017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:50:30.538951+0000","scrub_duration":0.0026653649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.159695+0000","last_change":"2024-04-19T03:41:17.159804+0000","last_active":"2024-04-19T03:41:17.159695+0000","last_peered":"2024-04-19T03:41:17.159695+0000","last_clean":"2024-04-19T03:41:17.159695+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:41:17.159695+0000","last_undegraded":"2024-04-19T03:41:17.159695+0000","last_fullsized":"2024-04-19T03:41:17.159695+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:17.159669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:17.159669+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.159669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:35.783665+0000","scrub_duration":0.001766386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:17.412289+0000","last_change":"2024-04-19T03:40:17.412289+0000","last_active":"2024-04-19T03:40:17.412289+0000","last_peered":"2024-04-19T03:40:17.412289+0000","last_clean":"2024-04-19T03:40:17.412289+0000","last_became_active":"2024-04-19T03:39:43.430100+0000","last_became_peered":"2024-04-19T03:39:43.430100+0000","last_unstale":"2024-04-19T03:40:17.412289+0000","last_undegraded":"2024-04-19T03:40:17.412289+0000","last_fullsized":"2024-04-19T03:40:17.412289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_clean_scrub_stamp":"2024-04-19T03:40:17.412165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:23.547748+0000","scrub_duration":0.001842256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":109,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.644185+0000","last_change":"2024-04-19T03:39:51.644185+0000","last_active":"2024-04-19T03:39:51.644185+0000","last_peered":"2024-04-19T03:39:51.644185+0000","last_clean":"2024-04-19T03:39:51.644185+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:39:51.644185+0000","last_undegraded":"2024-04-19T03:39:51.644185+0000","last_fullsized":"2024-04-19T03:39:51.644185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.644015+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:34.517088+0000","scrub_duration":0.0031723060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:18.177597+0000","last_change":"2024-04-19T03:41:18.177701+0000","last_active":"2024-04-19T03:41:18.177597+0000","last_peered":"2024-04-19T03:41:18.177597+0000","last_clean":"2024-04-19T03:41:18.177597+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:41:18.177597+0000","last_undegraded":"2024-04-19T03:41:18.177597+0000","last_fullsized":"2024-04-19T03:41:18.177597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:18.177571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:18.177571+0000","last_clean_scrub_stamp":"2024-04-19T03:41:18.177571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:17.247688+0000","scrub_duration":0.001928417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.009918+0000","last_change":"2024-04-19T03:41:07.010082+0000","last_active":"2024-04-19T03:41:07.009918+0000","last_peered":"2024-04-19T03:41:07.009918+0000","last_clean":"2024-04-19T03:41:07.009918+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:41:07.009918+0000","last_undegraded":"2024-04-19T03:41:07.009918+0000","last_fullsized":"2024-04-19T03:41:07.009918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.009894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:02.384210+0000","scrub_duration":0.0020010129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2079,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:41.293688+0000","last_change":"2024-04-19T03:40:41.293806+0000","last_active":"2024-04-19T03:40:41.293688+0000","last_peered":"2024-04-19T03:40:41.293688+0000","last_clean":"2024-04-19T03:40:41.293688+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:40:41.293688+0000","last_undegraded":"2024-04-19T03:40:41.293688+0000","last_fullsized":"2024-04-19T03:40:41.293688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1954","last_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_deep_scrub":"70'1954","last_deep_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_clean_scrub_stamp":"2024-04-19T03:40:41.293661+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:08.055945+0000","scrub_duration":0.0022932429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:06.458556+0000","last_change":"2024-04-19T03:40:06.458556+0000","last_active":"2024-04-19T03:40:06.458556+0000","last_peered":"2024-04-19T03:40:06.458556+0000","last_clean":"2024-04-19T03:40:06.458556+0000","last_became_active":"2024-04-19T03:39:43.434441+0000","last_became_peered":"2024-04-19T03:39:43.434441+0000","last_unstale":"2024-04-19T03:40:06.458556+0000","last_undegraded":"2024-04-19T03:40:06.458556+0000","last_fullsized":"2024-04-19T03:40:06.458556+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_clean_scrub_stamp":"2024-04-19T03:40:06.458408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:59.975433+0000","scrub_duration":0.0018363920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:29.306077+0000","last_change":"2024-04-19T03:40:29.306077+0000","last_active":"2024-04-19T03:40:29.306077+0000","last_peered":"2024-04-19T03:40:29.306077+0000","last_clean":"2024-04-19T03:40:29.306077+0000","last_became_active":"2024-04-19T03:39:43.431591+0000","last_became_peered":"2024-04-19T03:39:43.431591+0000","last_unstale":"2024-04-19T03:40:29.306077+0000","last_undegraded":"2024-04-19T03:40:29.306077+0000","last_fullsized":"2024-04-19T03:40:29.306077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_clean_scrub_stamp":"2024-04-19T03:40:29.305921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:42.842536+0000","scrub_duration":0.001644497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.325430+0000","last_change":"2024-04-19T03:40:00.325430+0000","last_active":"2024-04-19T03:40:00.325430+0000","last_peered":"2024-04-19T03:40:00.325430+0000","last_clean":"2024-04-19T03:40:00.325430+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:40:00.325430+0000","last_undegraded":"2024-04-19T03:40:00.325430+0000","last_fullsized":"2024-04-19T03:40:00.325430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.325262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:24.128839+0000","scrub_duration":0.0024403659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:10.199887+0000","last_change":"2024-04-19T03:41:10.200012+0000","last_active":"2024-04-19T03:41:10.199887+0000","last_peered":"2024-04-19T03:41:10.199887+0000","last_clean":"2024-04-19T03:41:10.199887+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:41:10.199887+0000","last_undegraded":"2024-04-19T03:41:10.199887+0000","last_fullsized":"2024-04-19T03:41:10.199887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:41:10.199856+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:41:10.199856+0000","last_clean_scrub_stamp":"2024-04-19T03:41:10.199856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:03:21.601285+0000","scrub_duration":0.0019170070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:57.365883+0000","last_change":"2024-04-19T03:40:57.365883+0000","last_active":"2024-04-19T03:40:57.365883+0000","last_peered":"2024-04-19T03:40:57.365883+0000","last_clean":"2024-04-19T03:40:57.365883+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:40:57.365883+0000","last_undegraded":"2024-04-19T03:40:57.365883+0000","last_fullsized":"2024-04-19T03:40:57.365883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2056","last_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_deep_scrub":"70'2056","last_deep_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_clean_scrub_stamp":"2024-04-19T03:40:57.365740+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:52.740055+0000","scrub_duration":0.0029402849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"93'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.315420+0000","last_change":"2024-04-19T03:40:54.315420+0000","last_active":"2024-04-19T03:40:54.315420+0000","last_peered":"2024-04-19T03:40:54.315420+0000","last_clean":"2024-04-19T03:40:54.315420+0000","last_became_active":"2024-04-19T03:39:43.430259+0000","last_became_peered":"2024-04-19T03:39:43.430259+0000","last_unstale":"2024-04-19T03:40:54.315420+0000","last_undegraded":"2024-04-19T03:40:54.315420+0000","last_fullsized":"2024-04-19T03:40:54.315420+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.315248+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:42.599141+0000","scrub_duration":0.003634445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2100,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:55.536049+0000","last_change":"2024-04-19T03:39:55.536049+0000","last_active":"2024-04-19T03:39:55.536049+0000","last_peered":"2024-04-19T03:39:55.536049+0000","last_clean":"2024-04-19T03:39:55.536049+0000","last_became_active":"2024-04-19T03:39:43.430703+0000","last_became_peered":"2024-04-19T03:39:43.430703+0000","last_unstale":"2024-04-19T03:39:55.536049+0000","last_undegraded":"2024-04-19T03:39:55.536049+0000","last_fullsized":"2024-04-19T03:39:55.536049+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2000","last_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_deep_scrub":"70'2000","last_deep_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_clean_scrub_stamp":"2024-04-19T03:39:55.535891+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:22.625053+0000","scrub_duration":0.002398659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.300397+0000","last_change":"2024-04-19T03:40:46.300397+0000","last_active":"2024-04-19T03:40:46.300397+0000","last_peered":"2024-04-19T03:40:46.300397+0000","last_clean":"2024-04-19T03:40:46.300397+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:40:46.300397+0000","last_undegraded":"2024-04-19T03:40:46.300397+0000","last_fullsized":"2024-04-19T03:40:46.300397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.300234+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:31.841726+0000","scrub_duration":0.0033879449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:26.383543+0000","last_change":"2024-04-19T03:40:26.383543+0000","last_active":"2024-04-19T03:40:26.383543+0000","last_peered":"2024-04-19T03:40:26.383543+0000","last_clean":"2024-04-19T03:40:26.383543+0000","last_became_active":"2024-04-19T03:39:43.433233+0000","last_became_peered":"2024-04-19T03:39:43.433233+0000","last_unstale":"2024-04-19T03:40:26.383543+0000","last_undegraded":"2024-04-19T03:40:26.383543+0000","last_fullsized":"2024-04-19T03:40:26.383543+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'7","last_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_deep_scrub":"70'7","last_deep_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_clean_scrub_stamp":"2024-04-19T03:40:26.383375+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:52.425413+0000","scrub_duration":0.0024732740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.608178+0000","last_change":"2024-04-19T03:40:18.608178+0000","last_active":"2024-04-19T03:40:18.608178+0000","last_peered":"2024-04-19T03:40:18.608178+0000","last_clean":"2024-04-19T03:40:18.608178+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:40:18.608178+0000","last_undegraded":"2024-04-19T03:40:18.608178+0000","last_fullsized":"2024-04-19T03:40:18.608178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.608004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:12.037760+0000","scrub_duration":0.0019643289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:46.173427+0000","last_change":"2024-04-19T03:41:46.173539+0000","last_active":"2024-04-19T03:41:46.173427+0000","last_peered":"2024-04-19T03:41:46.173427+0000","last_clean":"2024-04-19T03:41:46.173427+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:41:46.173427+0000","last_undegraded":"2024-04-19T03:41:46.173427+0000","last_fullsized":"2024-04-19T03:41:46.173427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4062","last_scrub_stamp":"2024-04-19T03:41:46.173399+0000","last_deep_scrub":"70'4062","last_deep_scrub_stamp":"2024-04-19T03:41:46.173399+0000","last_clean_scrub_stamp":"2024-04-19T03:41:46.173399+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:52.166988+0000","scrub_duration":0.004049955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.706465+0000","last_change":"2024-04-19T03:40:12.706465+0000","last_active":"2024-04-19T03:40:12.706465+0000","last_peered":"2024-04-19T03:40:12.706465+0000","last_clean":"2024-04-19T03:40:12.706465+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:40:12.706465+0000","last_undegraded":"2024-04-19T03:40:12.706465+0000","last_fullsized":"2024-04-19T03:40:12.706465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'6","last_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_deep_scrub":"93'6","last_deep_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.706336+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:55.113200+0000","scrub_duration":0.0042115119999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.337639+0000","last_change":"2024-04-19T03:41:05.337639+0000","last_active":"2024-04-19T03:41:05.337639+0000","last_peered":"2024-04-19T03:41:05.337639+0000","last_clean":"2024-04-19T03:41:05.337639+0000","last_became_active":"2024-04-19T03:39:43.435662+0000","last_became_peered":"2024-04-19T03:39:43.435662+0000","last_unstale":"2024-04-19T03:41:05.337639+0000","last_undegraded":"2024-04-19T03:41:05.337639+0000","last_fullsized":"2024-04-19T03:41:05.337639+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.337507+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:19.212270+0000","scrub_duration":0.0024382739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.337549+0000","last_change":"2024-04-19T03:40:27.337549+0000","last_active":"2024-04-19T03:40:27.337549+0000","last_peered":"2024-04-19T03:40:27.337549+0000","last_clean":"2024-04-19T03:40:27.337549+0000","last_became_active":"2024-04-19T03:39:43.433006+0000","last_became_peered":"2024-04-19T03:39:43.433006+0000","last_unstale":"2024-04-19T03:40:27.337549+0000","last_undegraded":"2024-04-19T03:40:27.337549+0000","last_fullsized":"2024-04-19T03:40:27.337549+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.337390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:10.033965+0000","scrub_duration":0.0023860370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":112,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:12.011414+0000","last_change":"2024-04-19T03:41:12.011573+0000","last_active":"2024-04-19T03:41:12.011414+0000","last_peered":"2024-04-19T03:41:12.011414+0000","last_clean":"2024-04-19T03:41:12.011414+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:41:12.011414+0000","last_undegraded":"2024-04-19T03:41:12.011414+0000","last_fullsized":"2024-04-19T03:41:12.011414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'12","last_scrub_stamp":"2024-04-19T03:41:12.011372+0000","last_deep_scrub":"70'12","last_deep_scrub_stamp":"2024-04-19T03:41:12.011372+0000","last_clean_scrub_stamp":"2024-04-19T03:41:12.011372+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:20.950499+0000","scrub_duration":0.0034687899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:42:00.106459+0000","last_change":"2024-04-19T03:42:00.106570+0000","last_active":"2024-04-19T03:42:00.106459+0000","last_peered":"2024-04-19T03:42:00.106459+0000","last_clean":"2024-04-19T03:42:00.106459+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:42:00.106459+0000","last_undegraded":"2024-04-19T03:42:00.106459+0000","last_fullsized":"2024-04-19T03:42:00.106459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1976","last_scrub_stamp":"2024-04-19T03:42:00.106431+0000","last_deep_scrub":"70'1976","last_deep_scrub_stamp":"2024-04-19T03:42:00.106431+0000","last_clean_scrub_stamp":"2024-04-19T03:42:00.106431+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:49:39.289948+0000","scrub_duration":0.0024767809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.008433+0000","last_change":"2024-04-19T03:41:17.008586+0000","last_active":"2024-04-19T03:41:17.008433+0000","last_peered":"2024-04-19T03:41:17.008433+0000","last_clean":"2024-04-19T03:41:17.008433+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:41:17.008433+0000","last_undegraded":"2024-04-19T03:41:17.008433+0000","last_fullsized":"2024-04-19T03:41:17.008433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2016","last_scrub_stamp":"2024-04-19T03:41:17.008393+0000","last_deep_scrub":"70'2016","last_deep_scrub_stamp":"2024-04-19T03:41:17.008393+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.008393+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:15:22.430976+0000","scrub_duration":0.0034046279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2178,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.185614+0000","last_change":"2024-04-19T03:40:35.185736+0000","last_active":"2024-04-19T03:40:35.185614+0000","last_peered":"2024-04-19T03:40:35.185614+0000","last_clean":"2024-04-19T03:40:35.185614+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:40:35.185614+0000","last_undegraded":"2024-04-19T03:40:35.185614+0000","last_fullsized":"2024-04-19T03:40:35.185614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2053","last_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_deep_scrub":"70'2053","last_deep_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.185586+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:03.429934+0000","scrub_duration":0.0023438479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481828,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1652,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1691648,"data_stored":1258390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.41099999999999998}]},{"osd":1,"last update":"Fri Apr 19 03:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.48899999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.438}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369840,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002000,"statfs":{"total":96636764160,"available":96258048000,"internally_reserved":0,"allocated":1679360,"data_stored":1257168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:41:08 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41299999999999998,"15min":0.42899999999999999},"min":{"1min":0.33100000000000002,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.622,"5min":1.087,"15min":1.087},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.42999999999999999},"min":{"1min":0.34899999999999998,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.58999999999999997,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Apr 19 03:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.441},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.46700000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738446,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":790528,"data_stored":382380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:42:07 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.49399999999999999,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.54600000000000004,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42499999999999999,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.628,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.442}]},{"osd":2,"last update":"Fri Apr 19 03:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.63800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.64900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:42:14.223 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:42:14.223 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:42:14.224 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T03:35:59.415213+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=35, tm_sec=59, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=39, tm_sec=48, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:42:14.225 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:42:34.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:42:34.610 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:42:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-19T03:42:34.623 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-04-19T03:42:34.378790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":877232,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":383046,"num_write_kb":1956392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115828,"ondisk_log_size":115828,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":795896,"kb_used_data":4064,"kb_used_omap":10,"kb_used_meta":791797,"kb_avail":282319624,"statfs":{"total":289910292480,"available":289095294976,"internally_reserved":0,"allocated":4161536,"data_stored":2897938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10308,"internal_metadata":810801084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003014"},"pg_stats":[{"pgid":"4.3f","version":"70'1979","reported_seq":2081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:57.107264+0000","last_change":"2024-04-19T03:41:57.107264+0000","last_active":"2024-04-19T03:41:57.107264+0000","last_peered":"2024-04-19T03:41:57.107264+0000","last_clean":"2024-04-19T03:41:57.107264+0000","last_became_active":"2024-04-19T03:35:59.880228+0000","last_became_peered":"2024-04-19T03:35:59.880228+0000","last_unstale":"2024-04-19T03:41:57.107264+0000","last_undegraded":"2024-04-19T03:41:57.107264+0000","last_fullsized":"2024-04-19T03:41:57.107264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1979","last_scrub_stamp":"2024-04-19T03:41:57.107124+0000","last_deep_scrub":"70'1979","last_deep_scrub_stamp":"2024-04-19T03:41:57.107124+0000","last_clean_scrub_stamp":"2024-04-19T03:41:57.107124+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:32.343944+0000","scrub_duration":0.00263583,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5876,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"70'4","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:42:14.942204+0000","last_change":"2024-04-19T03:42:14.942204+0000","last_active":"2024-04-19T03:42:14.942204+0000","last_peered":"2024-04-19T03:42:14.942204+0000","last_clean":"2024-04-19T03:42:14.942204+0000","last_became_active":"2024-04-19T03:35:59.882048+0000","last_became_peered":"2024-04-19T03:35:59.882048+0000","last_unstale":"2024-04-19T03:42:14.942204+0000","last_undegraded":"2024-04-19T03:42:14.942204+0000","last_fullsized":"2024-04-19T03:42:14.942204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4","last_scrub_stamp":"2024-04-19T03:42:14.942053+0000","last_deep_scrub":"70'4","last_deep_scrub_stamp":"2024-04-19T03:42:14.942053+0000","last_clean_scrub_stamp":"2024-04-19T03:42:14.942053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:09:11.616133+0000","scrub_duration":0.0029143070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"70'3993","reported_seq":4093,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:28.291061+0000","last_change":"2024-04-19T03:40:28.291061+0000","last_active":"2024-04-19T03:40:28.291061+0000","last_peered":"2024-04-19T03:40:28.291061+0000","last_clean":"2024-04-19T03:40:28.291061+0000","last_became_active":"2024-04-19T03:39:43.437251+0000","last_became_peered":"2024-04-19T03:39:43.437251+0000","last_unstale":"2024-04-19T03:40:28.291061+0000","last_undegraded":"2024-04-19T03:40:28.291061+0000","last_fullsized":"2024-04-19T03:40:28.291061+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3993","last_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_deep_scrub":"70'3993","last_deep_scrub_stamp":"2024-04-19T03:40:28.290885+0000","last_clean_scrub_stamp":"2024-04-19T03:40:28.290885+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:00:17.123063+0000","scrub_duration":0.0023123509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11922,"num_write_kb":59000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"70'8","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:04.425893+0000","last_change":"2024-04-19T03:40:04.425893+0000","last_active":"2024-04-19T03:40:04.425893+0000","last_peered":"2024-04-19T03:40:04.425893+0000","last_clean":"2024-04-19T03:40:04.425893+0000","last_became_active":"2024-04-19T03:39:43.434583+0000","last_became_peered":"2024-04-19T03:39:43.434583+0000","last_unstale":"2024-04-19T03:40:04.425893+0000","last_undegraded":"2024-04-19T03:40:04.425893+0000","last_fullsized":"2024-04-19T03:40:04.425893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:04.425751+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.425751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:57:07.588193+0000","scrub_duration":0.002196057,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"70'2051","reported_seq":2152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:50.306704+0000","last_change":"2024-04-19T03:40:50.306704+0000","last_active":"2024-04-19T03:40:50.306704+0000","last_peered":"2024-04-19T03:40:50.306704+0000","last_clean":"2024-04-19T03:40:50.306704+0000","last_became_active":"2024-04-19T03:35:59.879963+0000","last_became_peered":"2024-04-19T03:35:59.879963+0000","last_unstale":"2024-04-19T03:40:50.306704+0000","last_undegraded":"2024-04-19T03:40:50.306704+0000","last_fullsized":"2024-04-19T03:40:50.306704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2051","last_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_deep_scrub":"70'2051","last_deep_scrub_stamp":"2024-04-19T03:40:50.306544+0000","last_clean_scrub_stamp":"2024-04-19T03:40:50.306544+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:45.676931+0000","scrub_duration":0.0035400869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6155,"num_write_kb":30124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"70'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:47.306484+0000","last_change":"2024-04-19T03:40:47.306484+0000","last_active":"2024-04-19T03:40:47.306484+0000","last_peered":"2024-04-19T03:40:47.306484+0000","last_clean":"2024-04-19T03:40:47.306484+0000","last_became_active":"2024-04-19T03:39:43.429508+0000","last_became_peered":"2024-04-19T03:39:43.429508+0000","last_unstale":"2024-04-19T03:40:47.306484+0000","last_undegraded":"2024-04-19T03:40:47.306484+0000","last_fullsized":"2024-04-19T03:40:47.306484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:47.306304+0000","last_clean_scrub_stamp":"2024-04-19T03:40:47.306304+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:38:24.288058+0000","scrub_duration":0.0027027560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"70'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.363907+0000","last_change":"2024-04-19T03:40:32.363907+0000","last_active":"2024-04-19T03:40:32.363907+0000","last_peered":"2024-04-19T03:40:32.363907+0000","last_clean":"2024-04-19T03:40:32.363907+0000","last_became_active":"2024-04-19T03:39:43.428726+0000","last_became_peered":"2024-04-19T03:39:43.428726+0000","last_unstale":"2024-04-19T03:40:32.363907+0000","last_undegraded":"2024-04-19T03:40:32.363907+0000","last_fullsized":"2024-04-19T03:40:32.363907+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:32.363768+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.363768+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:55:49.483155+0000","scrub_duration":0.0027930099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"70'8029","reported_seq":8141,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:03.416142+0000","last_change":"2024-04-19T03:40:03.416142+0000","last_active":"2024-04-19T03:40:03.416142+0000","last_peered":"2024-04-19T03:40:03.416142+0000","last_clean":"2024-04-19T03:40:03.416142+0000","last_became_active":"2024-04-19T03:39:43.433063+0000","last_became_peered":"2024-04-19T03:39:43.433063+0000","last_unstale":"2024-04-19T03:40:03.416142+0000","last_undegraded":"2024-04-19T03:40:03.416142+0000","last_fullsized":"2024-04-19T03:40:03.416142+0000","mapping_epoch":92,"log_start":"58'3700","ondisk_log_start":"58'3700","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8029","last_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_deep_scrub":"70'8029","last_deep_scrub_stamp":"2024-04-19T03:40:03.416008+0000","last_clean_scrub_stamp":"2024-04-19T03:40:03.416008+0000","objects_scrubbed":0,"log_size":4329,"log_dups_size":3700,"ondisk_log_size":4329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:39.795688+0000","scrub_duration":0.002564808,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23927,"num_write_kb":118504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"70'6074","reported_seq":6174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:41.102056+0000","last_change":"2024-04-19T03:41:41.102169+0000","last_active":"2024-04-19T03:41:41.102056+0000","last_peered":"2024-04-19T03:41:41.102056+0000","last_clean":"2024-04-19T03:41:41.102056+0000","last_became_active":"2024-04-19T03:35:59.885352+0000","last_became_peered":"2024-04-19T03:35:59.885352+0000","last_unstale":"2024-04-19T03:41:41.102056+0000","last_undegraded":"2024-04-19T03:41:41.102056+0000","last_fullsized":"2024-04-19T03:41:41.102056+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6074","last_scrub_stamp":"2024-04-19T03:41:41.102029+0000","last_deep_scrub":"70'6074","last_deep_scrub_stamp":"2024-04-19T03:41:41.102029+0000","last_clean_scrub_stamp":"2024-04-19T03:41:41.102029+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":1700,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:50.860638+0000","scrub_duration":0.0040250590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18029,"num_write_kb":88784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"70'6086","reported_seq":6187,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:44.241689+0000","last_change":"2024-04-19T03:41:44.241814+0000","last_active":"2024-04-19T03:41:44.241689+0000","last_peered":"2024-04-19T03:41:44.241689+0000","last_clean":"2024-04-19T03:41:44.241689+0000","last_became_active":"2024-04-19T03:35:59.879838+0000","last_became_peered":"2024-04-19T03:35:59.879838+0000","last_unstale":"2024-04-19T03:41:44.241689+0000","last_undegraded":"2024-04-19T03:41:44.241689+0000","last_fullsized":"2024-04-19T03:41:44.241689+0000","mapping_epoch":14,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6086","last_scrub_stamp":"2024-04-19T03:41:44.241662+0000","last_deep_scrub":"70'6086","last_deep_scrub_stamp":"2024-04-19T03:41:44.241662+0000","last_clean_scrub_stamp":"2024-04-19T03:41:44.241662+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":1600,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:12.120455+0000","scrub_duration":0.004073119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18051,"num_write_kb":150171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"70'3939","reported_seq":4039,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:21.433640+0000","last_change":"2024-04-19T03:40:21.433640+0000","last_active":"2024-04-19T03:40:21.433640+0000","last_peered":"2024-04-19T03:40:21.433640+0000","last_clean":"2024-04-19T03:40:21.433640+0000","last_became_active":"2024-04-19T03:39:43.431742+0000","last_became_peered":"2024-04-19T03:39:43.431742+0000","last_unstale":"2024-04-19T03:40:21.433640+0000","last_undegraded":"2024-04-19T03:40:21.433640+0000","last_fullsized":"2024-04-19T03:40:21.433640+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'3939","last_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_deep_scrub":"70'3939","last_deep_scrub_stamp":"2024-04-19T03:40:21.433514+0000","last_clean_scrub_stamp":"2024-04-19T03:40:21.433514+0000","objects_scrubbed":0,"log_size":3939,"log_dups_size":0,"ondisk_log_size":3939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:57.721359+0000","scrub_duration":0.0025512870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11790,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"70'2067","reported_seq":2192,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:42:13.981179+0000","last_change":"2024-04-19T03:42:13.981304+0000","last_active":"2024-04-19T03:42:13.981179+0000","last_peered":"2024-04-19T03:42:13.981179+0000","last_clean":"2024-04-19T03:42:13.981179+0000","last_became_active":"2024-04-19T03:39:22.423417+0000","last_became_peered":"2024-04-19T03:39:22.423417+0000","last_unstale":"2024-04-19T03:42:13.981179+0000","last_undegraded":"2024-04-19T03:42:13.981179+0000","last_fullsized":"2024-04-19T03:42:13.981179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2067","last_scrub_stamp":"2024-04-19T03:42:13.981153+0000","last_deep_scrub":"70'2067","last_deep_scrub_stamp":"2024-04-19T03:42:13.981153+0000","last_clean_scrub_stamp":"2024-04-19T03:42:13.981153+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:59:11.929368+0000","scrub_duration":0.002972438,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6088,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"70'1992","reported_seq":2093,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:53.110283+0000","last_change":"2024-04-19T03:41:53.110404+0000","last_active":"2024-04-19T03:41:53.110283+0000","last_peered":"2024-04-19T03:41:53.110283+0000","last_clean":"2024-04-19T03:41:53.110283+0000","last_became_active":"2024-04-19T03:35:59.880731+0000","last_became_peered":"2024-04-19T03:35:59.880731+0000","last_unstale":"2024-04-19T03:41:53.110283+0000","last_undegraded":"2024-04-19T03:41:53.110283+0000","last_fullsized":"2024-04-19T03:41:53.110283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1992","last_scrub_stamp":"2024-04-19T03:41:53.110247+0000","last_deep_scrub":"70'1992","last_deep_scrub_stamp":"2024-04-19T03:41:53.110247+0000","last_clean_scrub_stamp":"2024-04-19T03:41:53.110247+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:05.030834+0000","scrub_duration":0.0029438989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5978,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"70'2072","reported_seq":2172,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:14.425058+0000","last_change":"2024-04-19T03:40:14.425058+0000","last_active":"2024-04-19T03:40:14.425058+0000","last_peered":"2024-04-19T03:40:14.425058+0000","last_clean":"2024-04-19T03:40:14.425058+0000","last_became_active":"2024-04-19T03:39:43.435748+0000","last_became_peered":"2024-04-19T03:39:43.435748+0000","last_unstale":"2024-04-19T03:40:14.425058+0000","last_undegraded":"2024-04-19T03:40:14.425058+0000","last_fullsized":"2024-04-19T03:40:14.425058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2072","last_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_deep_scrub":"70'2072","last_deep_scrub_stamp":"2024-04-19T03:40:14.424896+0000","last_clean_scrub_stamp":"2024-04-19T03:40:14.424896+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:23.898309+0000","scrub_duration":0.0031291729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":29924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"70'2025","reported_seq":2125,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:31.388574+0000","last_change":"2024-04-19T03:40:31.388574+0000","last_active":"2024-04-19T03:40:31.388574+0000","last_peered":"2024-04-19T03:40:31.388574+0000","last_clean":"2024-04-19T03:40:31.388574+0000","last_became_active":"2024-04-19T03:39:43.430447+0000","last_became_peered":"2024-04-19T03:39:43.430447+0000","last_unstale":"2024-04-19T03:40:31.388574+0000","last_undegraded":"2024-04-19T03:40:31.388574+0000","last_fullsized":"2024-04-19T03:40:31.388574+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2025","last_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_deep_scrub":"70'2025","last_deep_scrub_stamp":"2024-04-19T03:40:31.388419+0000","last_clean_scrub_stamp":"2024-04-19T03:40:31.388419+0000","objects_scrubbed":0,"log_size":2025,"log_dups_size":0,"ondisk_log_size":2025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:12.219961+0000","scrub_duration":0.0023057400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":30108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"70'2002","reported_seq":2102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:55.327902+0000","last_change":"2024-04-19T03:40:55.327902+0000","last_active":"2024-04-19T03:40:55.327902+0000","last_peered":"2024-04-19T03:40:55.327902+0000","last_clean":"2024-04-19T03:40:55.327902+0000","last_became_active":"2024-04-19T03:39:43.433748+0000","last_became_peered":"2024-04-19T03:39:43.433748+0000","last_unstale":"2024-04-19T03:40:55.327902+0000","last_undegraded":"2024-04-19T03:40:55.327902+0000","last_fullsized":"2024-04-19T03:40:55.327902+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2002","last_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_deep_scrub":"70'2002","last_deep_scrub_stamp":"2024-04-19T03:40:55.327775+0000","last_clean_scrub_stamp":"2024-04-19T03:40:55.327775+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:08:48.213870+0000","scrub_duration":0.0026441490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5851,"num_write_kb":28968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"70'1980","reported_seq":2080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:30.038201+0000","last_change":"2024-04-19T03:41:30.038366+0000","last_active":"2024-04-19T03:41:30.038201+0000","last_peered":"2024-04-19T03:41:30.038201+0000","last_clean":"2024-04-19T03:41:30.038201+0000","last_became_active":"2024-04-19T03:35:59.885150+0000","last_became_peered":"2024-04-19T03:35:59.885150+0000","last_unstale":"2024-04-19T03:41:30.038201+0000","last_undegraded":"2024-04-19T03:41:30.038201+0000","last_fullsized":"2024-04-19T03:41:30.038201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1980","last_scrub_stamp":"2024-04-19T03:41:30.038158+0000","last_deep_scrub":"70'1980","last_deep_scrub_stamp":"2024-04-19T03:41:30.038158+0000","last_clean_scrub_stamp":"2024-04-19T03:41:30.038158+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:39.586687+0000","scrub_duration":0.0027094950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5908,"num_write_kb":29204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"70'2058","reported_seq":2159,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:42:09.067743+0000","last_change":"2024-04-19T03:42:09.067865+0000","last_active":"2024-04-19T03:42:09.067743+0000","last_peered":"2024-04-19T03:42:09.067743+0000","last_clean":"2024-04-19T03:42:09.067743+0000","last_became_active":"2024-04-19T03:35:59.881803+0000","last_became_peered":"2024-04-19T03:35:59.881803+0000","last_unstale":"2024-04-19T03:42:09.067743+0000","last_undegraded":"2024-04-19T03:42:09.067743+0000","last_fullsized":"2024-04-19T03:42:09.067743+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2058","last_scrub_stamp":"2024-04-19T03:42:09.067713+0000","last_deep_scrub":"70'2058","last_deep_scrub_stamp":"2024-04-19T03:42:09.067713+0000","last_clean_scrub_stamp":"2024-04-19T03:42:09.067713+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:16.517615+0000","scrub_duration":0.0030911210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6003,"num_write_kb":29676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"70'4052","reported_seq":4152,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:29.015153+0000","last_change":"2024-04-19T03:41:29.015259+0000","last_active":"2024-04-19T03:41:29.015153+0000","last_peered":"2024-04-19T03:41:29.015153+0000","last_clean":"2024-04-19T03:41:29.015153+0000","last_became_active":"2024-04-19T03:35:59.882394+0000","last_became_peered":"2024-04-19T03:35:59.882394+0000","last_unstale":"2024-04-19T03:41:29.015153+0000","last_undegraded":"2024-04-19T03:41:29.015153+0000","last_fullsized":"2024-04-19T03:41:29.015153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4052","last_scrub_stamp":"2024-04-19T03:41:29.015128+0000","last_deep_scrub":"70'4052","last_deep_scrub_stamp":"2024-04-19T03:41:29.015128+0000","last_clean_scrub_stamp":"2024-04-19T03:41:29.015128+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:28.085244+0000","scrub_duration":0.0035691020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":58324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"70'4086","reported_seq":4186,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.399826+0000","last_change":"2024-04-19T03:40:35.399826+0000","last_active":"2024-04-19T03:40:35.399826+0000","last_peered":"2024-04-19T03:40:35.399826+0000","last_clean":"2024-04-19T03:40:35.399826+0000","last_became_active":"2024-04-19T03:39:43.431899+0000","last_became_peered":"2024-04-19T03:39:43.431899+0000","last_unstale":"2024-04-19T03:40:35.399826+0000","last_undegraded":"2024-04-19T03:40:35.399826+0000","last_fullsized":"2024-04-19T03:40:35.399826+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4086","last_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_deep_scrub":"70'4086","last_deep_scrub_stamp":"2024-04-19T03:40:35.399694+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.399694+0000","objects_scrubbed":0,"log_size":4086,"log_dups_size":0,"ondisk_log_size":4086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:40:10.836662+0000","scrub_duration":0.0025555930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12153,"num_write_kb":59924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"70'11","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:07.410737+0000","last_change":"2024-04-19T03:40:07.410737+0000","last_active":"2024-04-19T03:40:07.410737+0000","last_peered":"2024-04-19T03:40:07.410737+0000","last_clean":"2024-04-19T03:40:07.410737+0000","last_became_active":"2024-04-19T03:39:43.431732+0000","last_became_peered":"2024-04-19T03:39:43.431732+0000","last_unstale":"2024-04-19T03:40:07.410737+0000","last_undegraded":"2024-04-19T03:40:07.410737+0000","last_fullsized":"2024-04-19T03:40:07.410737+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'11","last_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_deep_scrub":"70'11","last_deep_scrub_stamp":"2024-04-19T03:40:07.410606+0000","last_clean_scrub_stamp":"2024-04-19T03:40:07.410606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:58.262646+0000","scrub_duration":0.0023107370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"70'2049","reported_seq":2174,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.207298+0000","last_change":"2024-04-19T03:41:07.207411+0000","last_active":"2024-04-19T03:41:07.207298+0000","last_peered":"2024-04-19T03:41:07.207298+0000","last_clean":"2024-04-19T03:41:07.207298+0000","last_became_active":"2024-04-19T03:39:22.423322+0000","last_became_peered":"2024-04-19T03:39:22.423322+0000","last_unstale":"2024-04-19T03:41:07.207298+0000","last_undegraded":"2024-04-19T03:41:07.207298+0000","last_fullsized":"2024-04-19T03:41:07.207298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:07.207263+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.207263+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:15:12.629847+0000","scrub_duration":0.0031871450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5977,"num_write_kb":29692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"70'2044","reported_seq":2168,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:28.039679+0000","last_change":"2024-04-19T03:41:28.039806+0000","last_active":"2024-04-19T03:41:28.039679+0000","last_peered":"2024-04-19T03:41:28.039679+0000","last_clean":"2024-04-19T03:41:28.039679+0000","last_became_active":"2024-04-19T03:39:22.420468+0000","last_became_peered":"2024-04-19T03:39:22.420468+0000","last_unstale":"2024-04-19T03:41:28.039679+0000","last_undegraded":"2024-04-19T03:41:28.039679+0000","last_fullsized":"2024-04-19T03:41:28.039679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2044","last_scrub_stamp":"2024-04-19T03:41:28.039638+0000","last_deep_scrub":"70'2044","last_deep_scrub_stamp":"2024-04-19T03:41:28.039638+0000","last_clean_scrub_stamp":"2024-04-19T03:41:28.039638+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:46.663635+0000","scrub_duration":0.0029199209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":29524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"70'4021","reported_seq":4123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.134573+0000","last_change":"2024-04-19T03:40:32.134573+0000","last_active":"2024-04-19T03:40:32.134573+0000","last_peered":"2024-04-19T03:40:32.134573+0000","last_clean":"2024-04-19T03:40:32.134573+0000","last_became_active":"2024-04-19T03:35:59.879905+0000","last_became_peered":"2024-04-19T03:35:59.879905+0000","last_unstale":"2024-04-19T03:40:32.134573+0000","last_undegraded":"2024-04-19T03:40:32.134573+0000","last_fullsized":"2024-04-19T03:40:32.134573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4021","last_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_deep_scrub":"70'4021","last_deep_scrub_stamp":"2024-04-19T03:40:32.134399+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.134399+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:06.376575+0000","scrub_duration":0.0035905770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11923,"num_write_kb":58796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"70'1983","reported_seq":2109,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.431337+0000","last_change":"2024-04-19T03:40:04.324323+0000","last_active":"2024-04-19T03:40:23.431337+0000","last_peered":"2024-04-19T03:40:23.431337+0000","last_clean":"2024-04-19T03:40:23.431337+0000","last_became_active":"2024-04-19T03:39:22.423368+0000","last_became_peered":"2024-04-19T03:39:22.423368+0000","last_unstale":"2024-04-19T03:40:23.431337+0000","last_undegraded":"2024-04-19T03:40:23.431337+0000","last_fullsized":"2024-04-19T03:40:23.431337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1983","last_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_deep_scrub":"70'1983","last_deep_scrub_stamp":"2024-04-19T03:40:04.324180+0000","last_clean_scrub_stamp":"2024-04-19T03:40:04.324180+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:46.731044+0000","scrub_duration":0.0027598010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6007,"num_write_kb":29652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"70'15","reported_seq":129,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:22.036031+0000","last_change":"2024-04-19T03:41:22.036031+0000","last_active":"2024-04-19T03:41:22.036031+0000","last_peered":"2024-04-19T03:41:22.036031+0000","last_clean":"2024-04-19T03:41:22.036031+0000","last_became_active":"2024-04-19T03:39:19.424187+0000","last_became_peered":"2024-04-19T03:39:19.424187+0000","last_unstale":"2024-04-19T03:41:22.036031+0000","last_undegraded":"2024-04-19T03:41:22.036031+0000","last_fullsized":"2024-04-19T03:41:22.036031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:41:22.035877+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:41:22.035877+0000","last_clean_scrub_stamp":"2024-04-19T03:41:22.035877+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:30.669594+0000","scrub_duration":0.002404804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"70'2028","reported_seq":2128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:52.486333+0000","last_change":"2024-04-19T03:39:52.486333+0000","last_active":"2024-04-19T03:39:52.486333+0000","last_peered":"2024-04-19T03:39:52.486333+0000","last_clean":"2024-04-19T03:39:52.486333+0000","last_became_active":"2024-04-19T03:39:43.437065+0000","last_became_peered":"2024-04-19T03:39:43.437065+0000","last_unstale":"2024-04-19T03:39:52.486333+0000","last_undegraded":"2024-04-19T03:39:52.486333+0000","last_fullsized":"2024-04-19T03:39:52.486333+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2028","last_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_deep_scrub":"70'2028","last_deep_scrub_stamp":"2024-04-19T03:39:52.486195+0000","last_clean_scrub_stamp":"2024-04-19T03:39:52.486195+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:49.821209+0000","scrub_duration":0.0024754260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":29672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:37.231826+0000","last_change":"2024-04-19T03:41:37.231947+0000","last_active":"2024-04-19T03:41:37.231826+0000","last_peered":"2024-04-19T03:41:37.231826+0000","last_clean":"2024-04-19T03:41:37.231826+0000","last_became_active":"2024-04-19T03:35:59.432325+0000","last_became_peered":"2024-04-19T03:35:59.432325+0000","last_unstale":"2024-04-19T03:41:37.231826+0000","last_undegraded":"2024-04-19T03:41:37.231826+0000","last_fullsized":"2024-04-19T03:41:37.231826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:41:37.231798+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:41:37.231798+0000","last_clean_scrub_stamp":"2024-04-19T03:41:37.231798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:47:49.109320+0000","scrub_duration":0.0020331149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"70'15","reported_seq":129,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:22.199937+0000","last_change":"2024-04-19T03:40:22.199937+0000","last_active":"2024-04-19T03:40:22.199937+0000","last_peered":"2024-04-19T03:40:22.199937+0000","last_clean":"2024-04-19T03:40:22.199937+0000","last_became_active":"2024-04-19T03:39:19.423350+0000","last_became_peered":"2024-04-19T03:39:19.423350+0000","last_unstale":"2024-04-19T03:40:22.199937+0000","last_undegraded":"2024-04-19T03:40:22.199937+0000","last_fullsized":"2024-04-19T03:40:22.199937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'15","last_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_deep_scrub":"70'15","last_deep_scrub_stamp":"2024-04-19T03:40:22.199728+0000","last_clean_scrub_stamp":"2024-04-19T03:40:22.199728+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:08:02.693048+0000","scrub_duration":0.0026297960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:32.760857+0000","last_change":"2024-04-19T03:40:32.760857+0000","last_active":"2024-04-19T03:40:32.760857+0000","last_peered":"2024-04-19T03:40:32.760857+0000","last_clean":"2024-04-19T03:40:32.760857+0000","last_became_active":"2024-04-19T03:39:19.423911+0000","last_became_peered":"2024-04-19T03:39:19.423911+0000","last_unstale":"2024-04-19T03:40:32.760857+0000","last_undegraded":"2024-04-19T03:40:32.760857+0000","last_fullsized":"2024-04-19T03:40:32.760857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:32.760689+0000","last_clean_scrub_stamp":"2024-04-19T03:40:32.760689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:48.412394+0000","scrub_duration":0.001792664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"70'5","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.970164+0000","last_change":"2024-04-19T03:41:17.970164+0000","last_active":"2024-04-19T03:41:17.970164+0000","last_peered":"2024-04-19T03:41:17.970164+0000","last_clean":"2024-04-19T03:41:17.970164+0000","last_became_active":"2024-04-19T03:39:19.423936+0000","last_became_peered":"2024-04-19T03:39:19.423936+0000","last_unstale":"2024-04-19T03:41:17.970164+0000","last_undegraded":"2024-04-19T03:41:17.970164+0000","last_fullsized":"2024-04-19T03:41:17.970164+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:41:17.970042+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:41:17.970042+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.970042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:30.160406+0000","scrub_duration":0.0029412599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.857512+0000","last_change":"2024-04-19T03:40:39.857512+0000","last_active":"2024-04-19T03:40:39.857512+0000","last_peered":"2024-04-19T03:40:39.857512+0000","last_clean":"2024-04-19T03:40:39.857512+0000","last_became_active":"2024-04-19T03:35:59.428394+0000","last_became_peered":"2024-04-19T03:35:59.428394+0000","last_unstale":"2024-04-19T03:40:39.857512+0000","last_undegraded":"2024-04-19T03:40:39.857512+0000","last_fullsized":"2024-04-19T03:40:39.857512+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:39.857367+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.857367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:14.099544+0000","scrub_duration":0.0016111649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"70'6","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:39.287366+0000","last_change":"2024-04-19T03:40:39.287366+0000","last_active":"2024-04-19T03:40:39.287366+0000","last_peered":"2024-04-19T03:40:39.287366+0000","last_clean":"2024-04-19T03:40:39.287366+0000","last_became_active":"2024-04-19T03:39:19.424952+0000","last_became_peered":"2024-04-19T03:39:19.424952+0000","last_unstale":"2024-04-19T03:40:39.287366+0000","last_undegraded":"2024-04-19T03:40:39.287366+0000","last_fullsized":"2024-04-19T03:40:39.287366+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:40:39.287191+0000","last_clean_scrub_stamp":"2024-04-19T03:40:39.287191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:08.985963+0000","scrub_duration":0.0020786289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"69'1","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.690988+0000","last_change":"2024-04-19T03:40:27.690988+0000","last_active":"2024-04-19T03:40:27.690988+0000","last_peered":"2024-04-19T03:40:27.690988+0000","last_clean":"2024-04-19T03:40:27.690988+0000","last_became_active":"2024-04-19T03:39:19.419504+0000","last_became_peered":"2024-04-19T03:39:19.419504+0000","last_unstale":"2024-04-19T03:40:27.690988+0000","last_undegraded":"2024-04-19T03:40:27.690988+0000","last_fullsized":"2024-04-19T03:40:27.690988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-04-19T03:40:27.690844+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.690844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:32.347176+0000","scrub_duration":0.001791932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"70'6","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:59.727483+0000","last_change":"2024-04-19T03:39:59.727483+0000","last_active":"2024-04-19T03:39:59.727483+0000","last_peered":"2024-04-19T03:39:59.727483+0000","last_clean":"2024-04-19T03:39:59.727483+0000","last_became_active":"2024-04-19T03:35:59.882244+0000","last_became_peered":"2024-04-19T03:35:59.882244+0000","last_unstale":"2024-04-19T03:39:59.727483+0000","last_undegraded":"2024-04-19T03:39:59.727483+0000","last_fullsized":"2024-04-19T03:39:59.727483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6","last_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_deep_scrub":"70'6","last_deep_scrub_stamp":"2024-04-19T03:39:59.727297+0000","last_clean_scrub_stamp":"2024-04-19T03:39:59.727297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:17.092087+0000","scrub_duration":0.0035426419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:25.393587+0000","last_change":"2024-04-19T03:40:25.393587+0000","last_active":"2024-04-19T03:40:25.393587+0000","last_peered":"2024-04-19T03:40:25.393587+0000","last_clean":"2024-04-19T03:40:25.393587+0000","last_became_active":"2024-04-19T03:39:43.429210+0000","last_became_peered":"2024-04-19T03:39:43.429210+0000","last_unstale":"2024-04-19T03:40:25.393587+0000","last_undegraded":"2024-04-19T03:40:25.393587+0000","last_fullsized":"2024-04-19T03:40:25.393587+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:25.393456+0000","last_clean_scrub_stamp":"2024-04-19T03:40:25.393456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:37:41.962081+0000","scrub_duration":0.002168045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"70'5950","reported_seq":6080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:16.670035+0000","last_change":"2024-04-19T03:40:16.670035+0000","last_active":"2024-04-19T03:40:16.670035+0000","last_peered":"2024-04-19T03:40:16.670035+0000","last_clean":"2024-04-19T03:40:16.670035+0000","last_became_active":"2024-04-19T03:39:22.421878+0000","last_became_peered":"2024-04-19T03:39:22.421878+0000","last_unstale":"2024-04-19T03:40:16.670035+0000","last_undegraded":"2024-04-19T03:40:16.670035+0000","last_fullsized":"2024-04-19T03:40:16.670035+0000","mapping_epoch":80,"log_start":"54'1600","ondisk_log_start":"54'1600","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5950","last_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_deep_scrub":"70'5950","last_deep_scrub_stamp":"2024-04-19T03:40:16.669845+0000","last_clean_scrub_stamp":"2024-04-19T03:40:16.669845+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":1600,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:55:00.796011+0000","scrub_duration":0.0029482610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":88632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"93'8","reported_seq":128,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:42.240191+0000","last_change":"2024-04-19T03:41:42.240315+0000","last_active":"2024-04-19T03:41:42.240191+0000","last_peered":"2024-04-19T03:41:42.240191+0000","last_clean":"2024-04-19T03:41:42.240191+0000","last_became_active":"2024-04-19T03:39:19.423647+0000","last_became_peered":"2024-04-19T03:39:19.423647+0000","last_unstale":"2024-04-19T03:41:42.240191+0000","last_undegraded":"2024-04-19T03:41:42.240191+0000","last_fullsized":"2024-04-19T03:41:42.240191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'8","last_scrub_stamp":"2024-04-19T03:41:42.240166+0000","last_deep_scrub":"93'8","last_deep_scrub_stamp":"2024-04-19T03:41:42.240166+0000","last_clean_scrub_stamp":"2024-04-19T03:41:42.240166+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:01.948223+0000","scrub_duration":0.0037955760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"70'4063","reported_seq":4163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.615150+0000","last_change":"2024-04-19T03:40:20.615150+0000","last_active":"2024-04-19T03:40:20.615150+0000","last_peered":"2024-04-19T03:40:20.615150+0000","last_clean":"2024-04-19T03:40:20.615150+0000","last_became_active":"2024-04-19T03:35:59.882303+0000","last_became_peered":"2024-04-19T03:35:59.882303+0000","last_unstale":"2024-04-19T03:40:20.615150+0000","last_undegraded":"2024-04-19T03:40:20.615150+0000","last_fullsized":"2024-04-19T03:40:20.615150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4063","last_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_deep_scrub":"70'4063","last_deep_scrub_stamp":"2024-04-19T03:40:20.614982+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.614982+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:01.364729+0000","scrub_duration":0.003172963,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11916,"num_write_kb":58871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"93'99","reported_seq":70,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.346209+0000","last_change":"2024-04-19T03:40:48.346209+0000","last_active":"2024-04-19T03:40:48.346209+0000","last_peered":"2024-04-19T03:40:48.346209+0000","last_clean":"2024-04-19T03:40:48.346209+0000","last_became_active":"2024-04-19T03:39:43.437298+0000","last_became_peered":"2024-04-19T03:39:43.437298+0000","last_unstale":"2024-04-19T03:40:48.346209+0000","last_undegraded":"2024-04-19T03:40:48.346209+0000","last_fullsized":"2024-04-19T03:40:48.346209+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'99","last_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_deep_scrub":"93'99","last_deep_scrub_stamp":"2024-04-19T03:40:48.346076+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.346076+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:13.038605+0000","scrub_duration":0.007204322,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":280712,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"70'4083","reported_seq":4183,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:40.440980+0000","last_change":"2024-04-19T03:40:40.440980+0000","last_active":"2024-04-19T03:40:40.440980+0000","last_peered":"2024-04-19T03:40:40.440980+0000","last_clean":"2024-04-19T03:40:40.440980+0000","last_became_active":"2024-04-19T03:39:43.434605+0000","last_became_peered":"2024-04-19T03:39:43.434605+0000","last_unstale":"2024-04-19T03:40:40.440980+0000","last_undegraded":"2024-04-19T03:40:40.440980+0000","last_fullsized":"2024-04-19T03:40:40.440980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4083","last_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_deep_scrub":"70'4083","last_deep_scrub_stamp":"2024-04-19T03:40:40.440842+0000","last_clean_scrub_stamp":"2024-04-19T03:40:40.440842+0000","objects_scrubbed":0,"log_size":4083,"log_dups_size":0,"ondisk_log_size":4083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:45.344854+0000","scrub_duration":0.0025970279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11870,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"93'4","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.460494+0000","last_change":"2024-04-19T03:40:42.460494+0000","last_active":"2024-04-19T03:40:42.460494+0000","last_peered":"2024-04-19T03:40:42.460494+0000","last_clean":"2024-04-19T03:40:42.460494+0000","last_became_active":"2024-04-19T03:39:43.431842+0000","last_became_peered":"2024-04-19T03:39:43.431842+0000","last_unstale":"2024-04-19T03:40:42.460494+0000","last_undegraded":"2024-04-19T03:40:42.460494+0000","last_fullsized":"2024-04-19T03:40:42.460494+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:42.460363+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.460363+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:45:49.733129+0000","scrub_duration":0.003431403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"70'1975","reported_seq":2076,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.285715+0000","last_change":"2024-04-19T03:40:08.285715+0000","last_active":"2024-04-19T03:40:08.285715+0000","last_peered":"2024-04-19T03:40:08.285715+0000","last_clean":"2024-04-19T03:40:08.285715+0000","last_became_active":"2024-04-19T03:35:59.882206+0000","last_became_peered":"2024-04-19T03:35:59.882206+0000","last_unstale":"2024-04-19T03:40:08.285715+0000","last_undegraded":"2024-04-19T03:40:08.285715+0000","last_fullsized":"2024-04-19T03:40:08.285715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1975","last_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_deep_scrub":"70'1975","last_deep_scrub_stamp":"2024-04-19T03:40:08.285526+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.285526+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:52.411692+0000","scrub_duration":0.0032122520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5896,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":114,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:11.030687+0000","last_change":"2024-04-19T03:41:11.030803+0000","last_active":"2024-04-19T03:41:11.030687+0000","last_peered":"2024-04-19T03:41:11.030687+0000","last_clean":"2024-04-19T03:41:11.030687+0000","last_became_active":"2024-04-19T03:39:19.422916+0000","last_became_peered":"2024-04-19T03:39:19.422916+0000","last_unstale":"2024-04-19T03:41:11.030687+0000","last_undegraded":"2024-04-19T03:41:11.030687+0000","last_fullsized":"2024-04-19T03:41:11.030687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:11.030662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:11.030662+0000","last_clean_scrub_stamp":"2024-04-19T03:41:11.030662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:29.251141+0000","scrub_duration":0.0017162169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"70'2033","reported_seq":2134,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:11.249784+0000","last_change":"2024-04-19T03:40:11.249784+0000","last_active":"2024-04-19T03:40:11.249784+0000","last_peered":"2024-04-19T03:40:11.249784+0000","last_clean":"2024-04-19T03:40:11.249784+0000","last_became_active":"2024-04-19T03:35:59.879907+0000","last_became_peered":"2024-04-19T03:35:59.879907+0000","last_unstale":"2024-04-19T03:40:11.249784+0000","last_undegraded":"2024-04-19T03:40:11.249784+0000","last_fullsized":"2024-04-19T03:40:11.249784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2033","last_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_deep_scrub":"70'2033","last_deep_scrub_stamp":"2024-04-19T03:40:11.249632+0000","last_clean_scrub_stamp":"2024-04-19T03:40:11.249632+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:04.679387+0000","scrub_duration":0.0039095689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:58.391315+0000","last_change":"2024-04-19T03:40:58.391420+0000","last_active":"2024-04-19T03:40:58.391315+0000","last_peered":"2024-04-19T03:40:58.391315+0000","last_clean":"2024-04-19T03:40:58.391315+0000","last_became_active":"2024-04-19T03:39:19.423324+0000","last_became_peered":"2024-04-19T03:39:19.423324+0000","last_unstale":"2024-04-19T03:40:58.391315+0000","last_undegraded":"2024-04-19T03:40:58.391315+0000","last_fullsized":"2024-04-19T03:40:58.391315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:58.391280+0000","last_clean_scrub_stamp":"2024-04-19T03:40:58.391280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:42.335959+0000","scrub_duration":0.001857837,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"70'10","reported_seq":123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:30.761230+0000","last_change":"2024-04-19T03:40:30.761230+0000","last_active":"2024-04-19T03:40:30.761230+0000","last_peered":"2024-04-19T03:40:30.761230+0000","last_clean":"2024-04-19T03:40:30.761230+0000","last_became_active":"2024-04-19T03:39:19.424316+0000","last_became_peered":"2024-04-19T03:39:19.424316+0000","last_unstale":"2024-04-19T03:40:30.761230+0000","last_undegraded":"2024-04-19T03:40:30.761230+0000","last_fullsized":"2024-04-19T03:40:30.761230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'10","last_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_deep_scrub":"70'10","last_deep_scrub_stamp":"2024-04-19T03:40:30.761100+0000","last_clean_scrub_stamp":"2024-04-19T03:40:30.761100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:37:51.151497+0000","scrub_duration":0.0024608220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"93'13","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.342391+0000","last_change":"2024-04-19T03:40:33.342391+0000","last_active":"2024-04-19T03:40:33.342391+0000","last_peered":"2024-04-19T03:40:33.342391+0000","last_clean":"2024-04-19T03:40:33.342391+0000","last_became_active":"2024-04-19T03:39:43.436291+0000","last_became_peered":"2024-04-19T03:39:43.436291+0000","last_unstale":"2024-04-19T03:40:33.342391+0000","last_undegraded":"2024-04-19T03:40:33.342391+0000","last_fullsized":"2024-04-19T03:40:33.342391+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'13","last_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_deep_scrub":"93'13","last_deep_scrub_stamp":"2024-04-19T03:40:33.342214+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.342214+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:39:21.052990+0000","scrub_duration":0.0050089979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"70'2095","reported_seq":2219,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:33.743742+0000","last_change":"2024-04-19T03:40:33.743742+0000","last_active":"2024-04-19T03:40:33.743742+0000","last_peered":"2024-04-19T03:40:33.743742+0000","last_clean":"2024-04-19T03:40:33.743742+0000","last_became_active":"2024-04-19T03:39:22.420535+0000","last_became_peered":"2024-04-19T03:39:22.420535+0000","last_unstale":"2024-04-19T03:40:33.743742+0000","last_undegraded":"2024-04-19T03:40:33.743742+0000","last_fullsized":"2024-04-19T03:40:33.743742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2095","last_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_deep_scrub":"70'2095","last_deep_scrub_stamp":"2024-04-19T03:40:33.743609+0000","last_clean_scrub_stamp":"2024-04-19T03:40:33.743609+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:30.726079+0000","scrub_duration":0.0029003269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":30008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"93'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.429204+0000","last_change":"2024-04-19T03:40:08.429204+0000","last_active":"2024-04-19T03:40:08.429204+0000","last_peered":"2024-04-19T03:40:08.429204+0000","last_clean":"2024-04-19T03:40:08.429204+0000","last_became_active":"2024-04-19T03:39:43.431751+0000","last_became_peered":"2024-04-19T03:39:43.431751+0000","last_unstale":"2024-04-19T03:40:08.429204+0000","last_undegraded":"2024-04-19T03:40:08.429204+0000","last_fullsized":"2024-04-19T03:40:08.429204+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:40:08.429067+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.429067+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:52.134126+0000","scrub_duration":0.0036343399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"70'2054","reported_seq":2180,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.430946+0000","last_change":"2024-04-19T03:40:02.298573+0000","last_active":"2024-04-19T03:40:23.430946+0000","last_peered":"2024-04-19T03:40:23.430946+0000","last_clean":"2024-04-19T03:40:23.430946+0000","last_became_active":"2024-04-19T03:39:22.422807+0000","last_became_peered":"2024-04-19T03:39:22.422807+0000","last_unstale":"2024-04-19T03:40:23.430946+0000","last_undegraded":"2024-04-19T03:40:23.430946+0000","last_fullsized":"2024-04-19T03:40:23.430946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2054","last_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_deep_scrub":"70'2054","last_deep_scrub_stamp":"2024-04-19T03:40:02.298435+0000","last_clean_scrub_stamp":"2024-04-19T03:40:02.298435+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:12.759109+0000","scrub_duration":0.0023525339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"93'3","reported_seq":118,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:02.299399+0000","last_change":"2024-04-19T03:41:02.299516+0000","last_active":"2024-04-19T03:41:02.299399+0000","last_peered":"2024-04-19T03:41:02.299399+0000","last_clean":"2024-04-19T03:41:02.299399+0000","last_became_active":"2024-04-19T03:39:19.425183+0000","last_became_peered":"2024-04-19T03:39:19.425183+0000","last_unstale":"2024-04-19T03:41:02.299399+0000","last_undegraded":"2024-04-19T03:41:02.299399+0000","last_fullsized":"2024-04-19T03:41:02.299399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:41:02.299371+0000","last_clean_scrub_stamp":"2024-04-19T03:41:02.299371+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:42.745471+0000","scrub_duration":0.0032937819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"70'2","reported_seq":104,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:01.328574+0000","last_change":"2024-04-19T03:41:01.328574+0000","last_active":"2024-04-19T03:41:01.328574+0000","last_peered":"2024-04-19T03:41:01.328574+0000","last_clean":"2024-04-19T03:41:01.328574+0000","last_became_active":"2024-04-19T03:35:59.879065+0000","last_became_peered":"2024-04-19T03:35:59.879065+0000","last_unstale":"2024-04-19T03:41:01.328574+0000","last_undegraded":"2024-04-19T03:41:01.328574+0000","last_fullsized":"2024-04-19T03:41:01.328574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2","last_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_deep_scrub":"70'2","last_deep_scrub_stamp":"2024-04-19T03:41:01.328403+0000","last_clean_scrub_stamp":"2024-04-19T03:41:01.328403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:34:19.548881+0000","scrub_duration":0.003585155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"93'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:04.299312+0000","last_change":"2024-04-19T03:41:04.299312+0000","last_active":"2024-04-19T03:41:04.299312+0000","last_peered":"2024-04-19T03:41:04.299312+0000","last_clean":"2024-04-19T03:41:04.299312+0000","last_became_active":"2024-04-19T03:39:43.436323+0000","last_became_peered":"2024-04-19T03:39:43.436323+0000","last_unstale":"2024-04-19T03:41:04.299312+0000","last_undegraded":"2024-04-19T03:41:04.299312+0000","last_fullsized":"2024-04-19T03:41:04.299312+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'2","last_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_deep_scrub":"93'2","last_deep_scrub_stamp":"2024-04-19T03:41:04.299169+0000","last_clean_scrub_stamp":"2024-04-19T03:41:04.299169+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:01.619558+0000","scrub_duration":0.003662354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"70'1981","reported_seq":2081,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:51.490790+0000","last_change":"2024-04-19T03:39:51.490790+0000","last_active":"2024-04-19T03:39:51.490790+0000","last_peered":"2024-04-19T03:39:51.490790+0000","last_clean":"2024-04-19T03:39:51.490790+0000","last_became_active":"2024-04-19T03:39:43.434807+0000","last_became_peered":"2024-04-19T03:39:43.434807+0000","last_unstale":"2024-04-19T03:39:51.490790+0000","last_undegraded":"2024-04-19T03:39:51.490790+0000","last_fullsized":"2024-04-19T03:39:51.490790+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1981","last_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_deep_scrub":"70'1981","last_deep_scrub_stamp":"2024-04-19T03:39:51.490660+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.490660+0000","objects_scrubbed":0,"log_size":1981,"log_dups_size":0,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.438851+0000","scrub_duration":0.002801207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5946,"num_write_kb":29368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:00.535767+0000","last_change":"2024-04-19T03:40:00.535767+0000","last_active":"2024-04-19T03:40:00.535767+0000","last_peered":"2024-04-19T03:40:00.535767+0000","last_clean":"2024-04-19T03:40:00.535767+0000","last_became_active":"2024-04-19T03:39:43.432885+0000","last_became_peered":"2024-04-19T03:39:43.432885+0000","last_unstale":"2024-04-19T03:40:00.535767+0000","last_undegraded":"2024-04-19T03:40:00.535767+0000","last_fullsized":"2024-04-19T03:40:00.535767+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:00.535639+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.535639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:09.252735+0000","scrub_duration":0.0018715909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"70'8","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:50.617468+0000","last_change":"2024-04-19T03:39:50.617468+0000","last_active":"2024-04-19T03:39:50.617468+0000","last_peered":"2024-04-19T03:39:50.617468+0000","last_clean":"2024-04-19T03:39:50.617468+0000","last_became_active":"2024-04-19T03:39:19.427015+0000","last_became_peered":"2024-04-19T03:39:19.427015+0000","last_unstale":"2024-04-19T03:39:50.617468+0000","last_undegraded":"2024-04-19T03:39:50.617468+0000","last_fullsized":"2024-04-19T03:39:50.617468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:39:50.617321+0000","last_clean_scrub_stamp":"2024-04-19T03:39:50.617321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:20:52.005449+0000","scrub_duration":0.0027065029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"93'4","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:09.036865+0000","last_change":"2024-04-19T03:41:09.037014+0000","last_active":"2024-04-19T03:41:09.036865+0000","last_peered":"2024-04-19T03:41:09.036865+0000","last_clean":"2024-04-19T03:41:09.036865+0000","last_became_active":"2024-04-19T03:39:19.425834+0000","last_became_peered":"2024-04-19T03:39:19.425834+0000","last_unstale":"2024-04-19T03:41:09.036865+0000","last_undegraded":"2024-04-19T03:41:09.036865+0000","last_fullsized":"2024-04-19T03:41:09.036865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:41:09.036840+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:41:09.036840+0000","last_clean_scrub_stamp":"2024-04-19T03:41:09.036840+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:52.981519+0000","scrub_duration":0.0033234079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"70'2008","reported_seq":2108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.395889+0000","last_change":"2024-04-19T03:40:23.395889+0000","last_active":"2024-04-19T03:40:23.395889+0000","last_peered":"2024-04-19T03:40:23.395889+0000","last_clean":"2024-04-19T03:40:23.395889+0000","last_became_active":"2024-04-19T03:39:43.433630+0000","last_became_peered":"2024-04-19T03:39:43.433630+0000","last_unstale":"2024-04-19T03:40:23.395889+0000","last_undegraded":"2024-04-19T03:40:23.395889+0000","last_fullsized":"2024-04-19T03:40:23.395889+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2008","last_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_deep_scrub":"70'2008","last_deep_scrub_stamp":"2024-04-19T03:40:23.395745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:23.395745+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:56:22.631622+0000","scrub_duration":0.002746283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5909,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:03.295590+0000","last_change":"2024-04-19T03:41:03.295590+0000","last_active":"2024-04-19T03:41:03.295590+0000","last_peered":"2024-04-19T03:41:03.295590+0000","last_clean":"2024-04-19T03:41:03.295590+0000","last_became_active":"2024-04-19T03:39:43.430616+0000","last_became_peered":"2024-04-19T03:39:43.430616+0000","last_unstale":"2024-04-19T03:41:03.295590+0000","last_undegraded":"2024-04-19T03:41:03.295590+0000","last_fullsized":"2024-04-19T03:41:03.295590+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:03.295436+0000","last_clean_scrub_stamp":"2024-04-19T03:41:03.295436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:40.226830+0000","scrub_duration":0.0017184609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"70'2035","reported_seq":2135,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:12.448673+0000","last_change":"2024-04-19T03:40:12.448673+0000","last_active":"2024-04-19T03:40:12.448673+0000","last_peered":"2024-04-19T03:40:12.448673+0000","last_clean":"2024-04-19T03:40:12.448673+0000","last_became_active":"2024-04-19T03:39:43.434699+0000","last_became_peered":"2024-04-19T03:39:43.434699+0000","last_unstale":"2024-04-19T03:40:12.448673+0000","last_undegraded":"2024-04-19T03:40:12.448673+0000","last_fullsized":"2024-04-19T03:40:12.448673+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2035","last_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_deep_scrub":"70'2035","last_deep_scrub_stamp":"2024-04-19T03:40:12.448493+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.448493+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:23.179035+0000","scrub_duration":0.002191452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5992,"num_write_kb":29492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:39.214563+0000","last_change":"2024-04-19T03:41:39.214563+0000","last_active":"2024-04-19T03:41:39.214563+0000","last_peered":"2024-04-19T03:41:39.214563+0000","last_clean":"2024-04-19T03:41:39.214563+0000","last_became_active":"2024-04-19T03:39:19.423213+0000","last_became_peered":"2024-04-19T03:39:19.423213+0000","last_unstale":"2024-04-19T03:41:39.214563+0000","last_undegraded":"2024-04-19T03:41:39.214563+0000","last_fullsized":"2024-04-19T03:41:39.214563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:39.214425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:39.214425+0000","last_clean_scrub_stamp":"2024-04-19T03:41:39.214425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:04:18.944057+0000","scrub_duration":0.0020519650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"70'2045","reported_seq":2145,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.427193+0000","last_change":"2024-04-19T03:40:18.427193+0000","last_active":"2024-04-19T03:40:18.427193+0000","last_peered":"2024-04-19T03:40:18.427193+0000","last_clean":"2024-04-19T03:40:18.427193+0000","last_became_active":"2024-04-19T03:39:43.431921+0000","last_became_peered":"2024-04-19T03:39:43.431921+0000","last_unstale":"2024-04-19T03:40:18.427193+0000","last_undegraded":"2024-04-19T03:40:18.427193+0000","last_fullsized":"2024-04-19T03:40:18.427193+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2045","last_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_deep_scrub":"70'2045","last_deep_scrub_stamp":"2024-04-19T03:40:18.427077+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.427077+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T15:29:13.005299+0000","scrub_duration":0.0023622740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.368270+0000","last_change":"2024-04-19T03:40:54.368270+0000","last_active":"2024-04-19T03:40:54.368270+0000","last_peered":"2024-04-19T03:40:54.368270+0000","last_clean":"2024-04-19T03:40:54.368270+0000","last_became_active":"2024-04-19T03:35:59.430854+0000","last_became_peered":"2024-04-19T03:35:59.430854+0000","last_unstale":"2024-04-19T03:40:54.368270+0000","last_undegraded":"2024-04-19T03:40:54.368270+0000","last_fullsized":"2024-04-19T03:40:54.368270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:54.368123+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.368123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:24.596193+0000","scrub_duration":0.001875411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"70'6031","reported_seq":6131,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:10.753203+0000","last_change":"2024-04-19T03:40:10.753203+0000","last_active":"2024-04-19T03:40:10.753203+0000","last_peered":"2024-04-19T03:40:10.753203+0000","last_clean":"2024-04-19T03:40:10.753203+0000","last_became_active":"2024-04-19T03:35:59.885112+0000","last_became_peered":"2024-04-19T03:35:59.885112+0000","last_unstale":"2024-04-19T03:40:10.753203+0000","last_undegraded":"2024-04-19T03:40:10.753203+0000","last_fullsized":"2024-04-19T03:40:10.753203+0000","mapping_epoch":14,"log_start":"54'1700","ondisk_log_start":"54'1700","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'6031","last_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_deep_scrub":"70'6031","last_deep_scrub_stamp":"2024-04-19T03:40:10.753070+0000","last_clean_scrub_stamp":"2024-04-19T03:40:10.753070+0000","objects_scrubbed":0,"log_size":4331,"log_dups_size":1700,"ondisk_log_size":4331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:21.213744+0000","scrub_duration":0.003270387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18041,"num_write_kb":89128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"93'4","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.909639+0000","last_change":"2024-04-19T03:40:49.909639+0000","last_active":"2024-04-19T03:40:49.909639+0000","last_peered":"2024-04-19T03:40:49.909639+0000","last_clean":"2024-04-19T03:40:49.909639+0000","last_became_active":"2024-04-19T03:35:59.432680+0000","last_became_peered":"2024-04-19T03:35:59.432680+0000","last_unstale":"2024-04-19T03:40:49.909639+0000","last_undegraded":"2024-04-19T03:40:49.909639+0000","last_fullsized":"2024-04-19T03:40:49.909639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:49.909503+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.909503+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:26.734830+0000","scrub_duration":0.0036995690000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:13.104365+0000","last_change":"2024-04-19T03:41:13.104365+0000","last_active":"2024-04-19T03:41:13.104365+0000","last_peered":"2024-04-19T03:41:13.104365+0000","last_clean":"2024-04-19T03:41:13.104365+0000","last_became_active":"2024-04-19T03:35:54.408908+0000","last_became_peered":"2024-04-19T03:35:54.408908+0000","last_unstale":"2024-04-19T03:41:13.104365+0000","last_undegraded":"2024-04-19T03:41:13.104365+0000","last_fullsized":"2024-04-19T03:41:13.104365+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:13.104225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:13.104225+0000","last_clean_scrub_stamp":"2024-04-19T03:41:13.104225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:55:15.360559+0000","scrub_duration":0.001898673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"70'8","reported_seq":122,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:08.752671+0000","last_change":"2024-04-19T03:40:08.752671+0000","last_active":"2024-04-19T03:40:08.752671+0000","last_peered":"2024-04-19T03:40:08.752671+0000","last_clean":"2024-04-19T03:40:08.752671+0000","last_became_active":"2024-04-19T03:39:19.427156+0000","last_became_peered":"2024-04-19T03:39:19.427156+0000","last_unstale":"2024-04-19T03:40:08.752671+0000","last_undegraded":"2024-04-19T03:40:08.752671+0000","last_fullsized":"2024-04-19T03:40:08.752671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:08.752529+0000","last_clean_scrub_stamp":"2024-04-19T03:40:08.752529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.556106+0000","scrub_duration":0.002237869,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:11.153236+0000","last_change":"2024-04-19T03:41:11.153236+0000","last_active":"2024-04-19T03:41:11.153236+0000","last_peered":"2024-04-19T03:41:11.153236+0000","last_clean":"2024-04-19T03:41:11.153236+0000","last_became_active":"2024-04-19T03:39:19.422024+0000","last_became_peered":"2024-04-19T03:39:19.422024+0000","last_unstale":"2024-04-19T03:41:11.153236+0000","last_undegraded":"2024-04-19T03:41:11.153236+0000","last_fullsized":"2024-04-19T03:41:11.153236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:11.153098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:11.153098+0000","last_clean_scrub_stamp":"2024-04-19T03:41:11.153098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:19.786815+0000","scrub_duration":0.0017749490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":129,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.008024+0000","last_change":"2024-04-19T03:41:05.008024+0000","last_active":"2024-04-19T03:41:05.008024+0000","last_peered":"2024-04-19T03:41:05.008024+0000","last_clean":"2024-04-19T03:41:05.008024+0000","last_became_active":"2024-04-19T03:39:19.423614+0000","last_became_peered":"2024-04-19T03:39:19.423614+0000","last_unstale":"2024-04-19T03:41:05.008024+0000","last_undegraded":"2024-04-19T03:41:05.008024+0000","last_fullsized":"2024-04-19T03:41:05.008024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'9","last_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_deep_scrub":"93'9","last_deep_scrub_stamp":"2024-04-19T03:41:05.007859+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.007859+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:11:06.070427+0000","scrub_duration":0.003113757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"70'5","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:13.429610+0000","last_change":"2024-04-19T03:40:12.234200+0000","last_active":"2024-04-19T03:40:13.429610+0000","last_peered":"2024-04-19T03:40:13.429610+0000","last_clean":"2024-04-19T03:40:13.429610+0000","last_became_active":"2024-04-19T03:39:19.425016+0000","last_became_peered":"2024-04-19T03:39:19.425016+0000","last_unstale":"2024-04-19T03:40:13.429610+0000","last_undegraded":"2024-04-19T03:40:13.429610+0000","last_fullsized":"2024-04-19T03:40:13.429610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:12.234048+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.234048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:52.983795+0000","scrub_duration":0.0021178159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":119,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.913932+0000","last_change":"2024-04-19T03:40:42.913932+0000","last_active":"2024-04-19T03:40:42.913932+0000","last_peered":"2024-04-19T03:40:42.913932+0000","last_clean":"2024-04-19T03:40:42.913932+0000","last_became_active":"2024-04-19T03:39:19.425780+0000","last_became_peered":"2024-04-19T03:39:19.425780+0000","last_unstale":"2024-04-19T03:40:42.913932+0000","last_undegraded":"2024-04-19T03:40:42.913932+0000","last_fullsized":"2024-04-19T03:40:42.913932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:42.913809+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.913809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:11.158157+0000","scrub_duration":0.001532853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"93'159","reported_seq":245,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:52.249553+0000","last_change":"2024-04-19T03:40:52.249553+0000","last_active":"2024-04-19T03:40:52.249553+0000","last_peered":"2024-04-19T03:40:52.249553+0000","last_clean":"2024-04-19T03:40:52.249553+0000","last_became_active":"2024-04-19T03:39:43.438741+0000","last_became_peered":"2024-04-19T03:39:43.438741+0000","last_unstale":"2024-04-19T03:40:52.249553+0000","last_undegraded":"2024-04-19T03:40:52.249553+0000","last_fullsized":"2024-04-19T03:40:52.249553+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'159","last_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_deep_scrub":"93'159","last_deep_scrub_stamp":"2024-04-19T03:40:52.249385+0000","last_clean_scrub_stamp":"2024-04-19T03:40:52.249385+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:22:50.993077+0000","scrub_duration":0.006639893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"93'5","reported_seq":127,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.897576+0000","last_change":"2024-04-19T03:40:46.897576+0000","last_active":"2024-04-19T03:40:46.897576+0000","last_peered":"2024-04-19T03:40:46.897576+0000","last_clean":"2024-04-19T03:40:46.897576+0000","last_became_active":"2024-04-19T03:39:19.417869+0000","last_became_peered":"2024-04-19T03:39:19.417869+0000","last_unstale":"2024-04-19T03:40:46.897576+0000","last_undegraded":"2024-04-19T03:40:46.897576+0000","last_fullsized":"2024-04-19T03:40:46.897576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'5","last_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_deep_scrub":"93'5","last_deep_scrub_stamp":"2024-04-19T03:40:46.897430+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.897430+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:16.596202+0000","scrub_duration":0.0029799929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"70'8001","reported_seq":8103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:42.247912+0000","last_change":"2024-04-19T03:40:42.247912+0000","last_active":"2024-04-19T03:40:42.247912+0000","last_peered":"2024-04-19T03:40:42.247912+0000","last_clean":"2024-04-19T03:40:42.247912+0000","last_became_active":"2024-04-19T03:35:59.881321+0000","last_became_peered":"2024-04-19T03:35:59.881321+0000","last_unstale":"2024-04-19T03:40:42.247912+0000","last_undegraded":"2024-04-19T03:40:42.247912+0000","last_fullsized":"2024-04-19T03:40:42.247912+0000","mapping_epoch":14,"log_start":"57'3500","ondisk_log_start":"57'3500","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8001","last_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_deep_scrub":"70'8001","last_deep_scrub_stamp":"2024-04-19T03:40:42.247746+0000","last_clean_scrub_stamp":"2024-04-19T03:40:42.247746+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":3500,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:19.073073+0000","scrub_duration":0.0039554270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23727,"num_write_kb":117220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:49.324496+0000","last_change":"2024-04-19T03:40:49.324496+0000","last_active":"2024-04-19T03:40:49.324496+0000","last_peered":"2024-04-19T03:40:49.324496+0000","last_clean":"2024-04-19T03:40:49.324496+0000","last_became_active":"2024-04-19T03:39:43.430609+0000","last_became_peered":"2024-04-19T03:39:43.430609+0000","last_unstale":"2024-04-19T03:40:49.324496+0000","last_undegraded":"2024-04-19T03:40:49.324496+0000","last_fullsized":"2024-04-19T03:40:49.324496+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:49.324336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:49.324336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:41:09.713311+0000","scrub_duration":0.0017616750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:31.194380+0000","last_change":"2024-04-19T03:41:31.194380+0000","last_active":"2024-04-19T03:41:31.194380+0000","last_peered":"2024-04-19T03:41:31.194380+0000","last_clean":"2024-04-19T03:41:31.194380+0000","last_became_active":"2024-04-19T03:39:19.427482+0000","last_became_peered":"2024-04-19T03:39:19.427482+0000","last_unstale":"2024-04-19T03:41:31.194380+0000","last_undegraded":"2024-04-19T03:41:31.194380+0000","last_fullsized":"2024-04-19T03:41:31.194380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:31.194230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:31.194230+0000","last_clean_scrub_stamp":"2024-04-19T03:41:31.194230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:51:40.952838+0000","scrub_duration":0.0017914579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"70'5","reported_seq":106,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:23.446256+0000","last_change":"2024-04-19T03:39:54.705566+0000","last_active":"2024-04-19T03:40:23.446256+0000","last_peered":"2024-04-19T03:40:23.446256+0000","last_clean":"2024-04-19T03:40:23.446256+0000","last_became_active":"2024-04-19T03:35:59.880033+0000","last_became_peered":"2024-04-19T03:35:59.880033+0000","last_unstale":"2024-04-19T03:40:23.446256+0000","last_undegraded":"2024-04-19T03:40:23.446256+0000","last_fullsized":"2024-04-19T03:40:23.446256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:39:54.705417+0000","last_clean_scrub_stamp":"2024-04-19T03:39:54.705417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:50:16.417137+0000","scrub_duration":0.0033800929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:20.452070+0000","last_change":"2024-04-19T03:40:20.452070+0000","last_active":"2024-04-19T03:40:20.452070+0000","last_peered":"2024-04-19T03:40:20.452070+0000","last_clean":"2024-04-19T03:40:20.452070+0000","last_became_active":"2024-04-19T03:39:43.435880+0000","last_became_peered":"2024-04-19T03:39:43.435880+0000","last_unstale":"2024-04-19T03:40:20.452070+0000","last_undegraded":"2024-04-19T03:40:20.452070+0000","last_fullsized":"2024-04-19T03:40:20.452070+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:20.451936+0000","last_clean_scrub_stamp":"2024-04-19T03:40:20.451936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:08:29.525420+0000","scrub_duration":0.0019933870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:48.857891+0000","last_change":"2024-04-19T03:40:48.857891+0000","last_active":"2024-04-19T03:40:48.857891+0000","last_peered":"2024-04-19T03:40:48.857891+0000","last_clean":"2024-04-19T03:40:48.857891+0000","last_became_active":"2024-04-19T03:35:59.430249+0000","last_became_peered":"2024-04-19T03:35:59.430249+0000","last_unstale":"2024-04-19T03:40:48.857891+0000","last_undegraded":"2024-04-19T03:40:48.857891+0000","last_fullsized":"2024-04-19T03:40:48.857891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:48.857745+0000","last_clean_scrub_stamp":"2024-04-19T03:40:48.857745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:15.620029+0000","scrub_duration":0.0021533479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"70'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:56.284196+0000","last_change":"2024-04-19T03:40:56.284196+0000","last_active":"2024-04-19T03:40:56.284196+0000","last_peered":"2024-04-19T03:40:56.284196+0000","last_clean":"2024-04-19T03:40:56.284196+0000","last_became_active":"2024-04-19T03:39:43.436182+0000","last_became_peered":"2024-04-19T03:39:43.436182+0000","last_unstale":"2024-04-19T03:40:56.284196+0000","last_undegraded":"2024-04-19T03:40:56.284196+0000","last_fullsized":"2024-04-19T03:40:56.284196+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'5","last_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_deep_scrub":"70'5","last_deep_scrub_stamp":"2024-04-19T03:40:56.284017+0000","last_clean_scrub_stamp":"2024-04-19T03:40:56.284017+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:50:30.538951+0000","scrub_duration":0.0026653649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.159804+0000","last_change":"2024-04-19T03:41:17.159804+0000","last_active":"2024-04-19T03:41:17.159804+0000","last_peered":"2024-04-19T03:41:17.159804+0000","last_clean":"2024-04-19T03:41:17.159804+0000","last_became_active":"2024-04-19T03:35:54.408865+0000","last_became_peered":"2024-04-19T03:35:54.408865+0000","last_unstale":"2024-04-19T03:41:17.159804+0000","last_undegraded":"2024-04-19T03:41:17.159804+0000","last_fullsized":"2024-04-19T03:41:17.159804+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:17.159669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:17.159669+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.159669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:27:35.783665+0000","scrub_duration":0.001766386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:17.412289+0000","last_change":"2024-04-19T03:40:17.412289+0000","last_active":"2024-04-19T03:40:17.412289+0000","last_peered":"2024-04-19T03:40:17.412289+0000","last_clean":"2024-04-19T03:40:17.412289+0000","last_became_active":"2024-04-19T03:39:43.430100+0000","last_became_peered":"2024-04-19T03:39:43.430100+0000","last_unstale":"2024-04-19T03:40:17.412289+0000","last_undegraded":"2024-04-19T03:40:17.412289+0000","last_fullsized":"2024-04-19T03:40:17.412289+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:17.412165+0000","last_clean_scrub_stamp":"2024-04-19T03:40:17.412165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:34:23.547748+0000","scrub_duration":0.001842256,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"70'9","reported_seq":110,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:13.444499+0000","last_change":"2024-04-19T03:39:51.644185+0000","last_active":"2024-04-19T03:40:13.444499+0000","last_peered":"2024-04-19T03:40:13.444499+0000","last_clean":"2024-04-19T03:40:13.444499+0000","last_became_active":"2024-04-19T03:35:59.885189+0000","last_became_peered":"2024-04-19T03:35:59.885189+0000","last_unstale":"2024-04-19T03:40:13.444499+0000","last_undegraded":"2024-04-19T03:40:13.444499+0000","last_fullsized":"2024-04-19T03:40:13.444499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:39:51.644015+0000","last_clean_scrub_stamp":"2024-04-19T03:39:51.644015+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:47:34.517088+0000","scrub_duration":0.0031723060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:18.177701+0000","last_change":"2024-04-19T03:41:18.177701+0000","last_active":"2024-04-19T03:41:18.177701+0000","last_peered":"2024-04-19T03:41:18.177701+0000","last_clean":"2024-04-19T03:41:18.177701+0000","last_became_active":"2024-04-19T03:39:19.425318+0000","last_became_peered":"2024-04-19T03:39:19.425318+0000","last_unstale":"2024-04-19T03:41:18.177701+0000","last_undegraded":"2024-04-19T03:41:18.177701+0000","last_fullsized":"2024-04-19T03:41:18.177701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:18.177571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:18.177571+0000","last_clean_scrub_stamp":"2024-04-19T03:41:18.177571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:17.247688+0000","scrub_duration":0.001928417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:07.010082+0000","last_change":"2024-04-19T03:41:07.010082+0000","last_active":"2024-04-19T03:41:07.010082+0000","last_peered":"2024-04-19T03:41:07.010082+0000","last_clean":"2024-04-19T03:41:07.010082+0000","last_became_active":"2024-04-19T03:35:59.433469+0000","last_became_peered":"2024-04-19T03:35:59.433469+0000","last_unstale":"2024-04-19T03:41:07.010082+0000","last_undegraded":"2024-04-19T03:41:07.010082+0000","last_fullsized":"2024-04-19T03:41:07.010082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:41:07.009894+0000","last_clean_scrub_stamp":"2024-04-19T03:41:07.009894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:19:02.384210+0000","scrub_duration":0.0020010129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"70'1954","reported_seq":2080,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:41.293806+0000","last_change":"2024-04-19T03:40:41.293806+0000","last_active":"2024-04-19T03:40:41.293806+0000","last_peered":"2024-04-19T03:40:41.293806+0000","last_clean":"2024-04-19T03:40:41.293806+0000","last_became_active":"2024-04-19T03:39:22.423032+0000","last_became_peered":"2024-04-19T03:39:22.423032+0000","last_unstale":"2024-04-19T03:40:41.293806+0000","last_undegraded":"2024-04-19T03:40:41.293806+0000","last_fullsized":"2024-04-19T03:40:41.293806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1954","last_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_deep_scrub":"70'1954","last_deep_scrub_stamp":"2024-04-19T03:40:41.293661+0000","last_clean_scrub_stamp":"2024-04-19T03:40:41.293661+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:08.055945+0000","scrub_duration":0.0022932429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5901,"num_write_kb":29224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:06.458556+0000","last_change":"2024-04-19T03:40:06.458556+0000","last_active":"2024-04-19T03:40:06.458556+0000","last_peered":"2024-04-19T03:40:06.458556+0000","last_clean":"2024-04-19T03:40:06.458556+0000","last_became_active":"2024-04-19T03:39:43.434441+0000","last_became_peered":"2024-04-19T03:39:43.434441+0000","last_unstale":"2024-04-19T03:40:06.458556+0000","last_undegraded":"2024-04-19T03:40:06.458556+0000","last_fullsized":"2024-04-19T03:40:06.458556+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:06.458408+0000","last_clean_scrub_stamp":"2024-04-19T03:40:06.458408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:29:59.975433+0000","scrub_duration":0.0018363920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":88,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:29.306077+0000","last_change":"2024-04-19T03:40:29.306077+0000","last_active":"2024-04-19T03:40:29.306077+0000","last_peered":"2024-04-19T03:40:29.306077+0000","last_clean":"2024-04-19T03:40:29.306077+0000","last_became_active":"2024-04-19T03:39:43.431591+0000","last_became_peered":"2024-04-19T03:39:43.431591+0000","last_unstale":"2024-04-19T03:40:29.306077+0000","last_undegraded":"2024-04-19T03:40:29.306077+0000","last_fullsized":"2024-04-19T03:40:29.306077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:40:29.305921+0000","last_clean_scrub_stamp":"2024-04-19T03:40:29.305921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:42.842536+0000","scrub_duration":0.001644497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"70'8","reported_seq":123,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:13.429663+0000","last_change":"2024-04-19T03:40:00.325430+0000","last_active":"2024-04-19T03:40:13.429663+0000","last_peered":"2024-04-19T03:40:13.429663+0000","last_clean":"2024-04-19T03:40:13.429663+0000","last_became_active":"2024-04-19T03:39:19.423329+0000","last_became_peered":"2024-04-19T03:39:19.423329+0000","last_unstale":"2024-04-19T03:40:13.429663+0000","last_undegraded":"2024-04-19T03:40:13.429663+0000","last_fullsized":"2024-04-19T03:40:13.429663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'8","last_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_deep_scrub":"70'8","last_deep_scrub_stamp":"2024-04-19T03:40:00.325262+0000","last_clean_scrub_stamp":"2024-04-19T03:40:00.325262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:24.128839+0000","scrub_duration":0.0024403659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":116,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:10.199887+0000","last_change":"2024-04-19T03:41:10.200012+0000","last_active":"2024-04-19T03:41:10.199887+0000","last_peered":"2024-04-19T03:41:10.199887+0000","last_clean":"2024-04-19T03:41:10.199887+0000","last_became_active":"2024-04-19T03:39:19.427808+0000","last_became_peered":"2024-04-19T03:39:19.427808+0000","last_unstale":"2024-04-19T03:41:10.199887+0000","last_undegraded":"2024-04-19T03:41:10.199887+0000","last_fullsized":"2024-04-19T03:41:10.199887+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:41:10.199856+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:41:10.199856+0000","last_clean_scrub_stamp":"2024-04-19T03:41:10.199856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:03:21.601285+0000","scrub_duration":0.0019170070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"70'2056","reported_seq":2157,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:57.365883+0000","last_change":"2024-04-19T03:40:57.365883+0000","last_active":"2024-04-19T03:40:57.365883+0000","last_peered":"2024-04-19T03:40:57.365883+0000","last_clean":"2024-04-19T03:40:57.365883+0000","last_became_active":"2024-04-19T03:35:59.879874+0000","last_became_peered":"2024-04-19T03:35:59.879874+0000","last_unstale":"2024-04-19T03:40:57.365883+0000","last_undegraded":"2024-04-19T03:40:57.365883+0000","last_fullsized":"2024-04-19T03:40:57.365883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2056","last_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_deep_scrub":"70'2056","last_deep_scrub_stamp":"2024-04-19T03:40:57.365740+0000","last_clean_scrub_stamp":"2024-04-19T03:40:57.365740+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:52.740055+0000","scrub_duration":0.0029402849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6016,"num_write_kb":29804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"93'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:54.315420+0000","last_change":"2024-04-19T03:40:54.315420+0000","last_active":"2024-04-19T03:40:54.315420+0000","last_peered":"2024-04-19T03:40:54.315420+0000","last_clean":"2024-04-19T03:40:54.315420+0000","last_became_active":"2024-04-19T03:39:43.430259+0000","last_became_peered":"2024-04-19T03:39:43.430259+0000","last_unstale":"2024-04-19T03:40:54.315420+0000","last_undegraded":"2024-04-19T03:40:54.315420+0000","last_fullsized":"2024-04-19T03:40:54.315420+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'3","last_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_deep_scrub":"93'3","last_deep_scrub_stamp":"2024-04-19T03:40:54.315248+0000","last_clean_scrub_stamp":"2024-04-19T03:40:54.315248+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:42.599141+0000","scrub_duration":0.003634445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"70'2000","reported_seq":2100,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:39:55.536049+0000","last_change":"2024-04-19T03:39:55.536049+0000","last_active":"2024-04-19T03:39:55.536049+0000","last_peered":"2024-04-19T03:39:55.536049+0000","last_clean":"2024-04-19T03:39:55.536049+0000","last_became_active":"2024-04-19T03:39:43.430703+0000","last_became_peered":"2024-04-19T03:39:43.430703+0000","last_unstale":"2024-04-19T03:39:55.536049+0000","last_undegraded":"2024-04-19T03:39:55.536049+0000","last_fullsized":"2024-04-19T03:39:55.536049+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2000","last_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_deep_scrub":"70'2000","last_deep_scrub_stamp":"2024-04-19T03:39:55.535891+0000","last_clean_scrub_stamp":"2024-04-19T03:39:55.535891+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:22.625053+0000","scrub_duration":0.002398659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5922,"num_write_kb":29300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"93'4","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:46.300397+0000","last_change":"2024-04-19T03:40:46.300397+0000","last_active":"2024-04-19T03:40:46.300397+0000","last_peered":"2024-04-19T03:40:46.300397+0000","last_clean":"2024-04-19T03:40:46.300397+0000","last_became_active":"2024-04-19T03:39:19.425293+0000","last_became_peered":"2024-04-19T03:39:19.425293+0000","last_unstale":"2024-04-19T03:40:46.300397+0000","last_undegraded":"2024-04-19T03:40:46.300397+0000","last_fullsized":"2024-04-19T03:40:46.300397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'4","last_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_deep_scrub":"93'4","last_deep_scrub_stamp":"2024-04-19T03:40:46.300234+0000","last_clean_scrub_stamp":"2024-04-19T03:40:46.300234+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:32:31.841726+0000","scrub_duration":0.0033879449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"70'7","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:26.383543+0000","last_change":"2024-04-19T03:40:26.383543+0000","last_active":"2024-04-19T03:40:26.383543+0000","last_peered":"2024-04-19T03:40:26.383543+0000","last_clean":"2024-04-19T03:40:26.383543+0000","last_became_active":"2024-04-19T03:39:43.433233+0000","last_became_peered":"2024-04-19T03:39:43.433233+0000","last_unstale":"2024-04-19T03:40:26.383543+0000","last_undegraded":"2024-04-19T03:40:26.383543+0000","last_fullsized":"2024-04-19T03:40:26.383543+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'7","last_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_deep_scrub":"70'7","last_deep_scrub_stamp":"2024-04-19T03:40:26.383375+0000","last_clean_scrub_stamp":"2024-04-19T03:40:26.383375+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:20:52.425413+0000","scrub_duration":0.0024732740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":103,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:18.608178+0000","last_change":"2024-04-19T03:40:18.608178+0000","last_active":"2024-04-19T03:40:18.608178+0000","last_peered":"2024-04-19T03:40:18.608178+0000","last_clean":"2024-04-19T03:40:18.608178+0000","last_became_active":"2024-04-19T03:35:59.432873+0000","last_became_peered":"2024-04-19T03:35:59.432873+0000","last_unstale":"2024-04-19T03:40:18.608178+0000","last_undegraded":"2024-04-19T03:40:18.608178+0000","last_fullsized":"2024-04-19T03:40:18.608178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-04-19T03:40:18.608004+0000","last_clean_scrub_stamp":"2024-04-19T03:40:18.608004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:12.037760+0000","scrub_duration":0.0019643289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"70'4062","reported_seq":4163,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:46.173427+0000","last_change":"2024-04-19T03:41:46.173539+0000","last_active":"2024-04-19T03:41:46.173427+0000","last_peered":"2024-04-19T03:41:46.173427+0000","last_clean":"2024-04-19T03:41:46.173427+0000","last_became_active":"2024-04-19T03:35:59.880745+0000","last_became_peered":"2024-04-19T03:35:59.880745+0000","last_unstale":"2024-04-19T03:41:46.173427+0000","last_undegraded":"2024-04-19T03:41:46.173427+0000","last_fullsized":"2024-04-19T03:41:46.173427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'4062","last_scrub_stamp":"2024-04-19T03:41:46.173399+0000","last_deep_scrub":"70'4062","last_deep_scrub_stamp":"2024-04-19T03:41:46.173399+0000","last_clean_scrub_stamp":"2024-04-19T03:41:46.173399+0000","objects_scrubbed":0,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:24:52.166988+0000","scrub_duration":0.004049955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11988,"num_write_kb":59336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"93'6","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:13.444599+0000","last_change":"2024-04-19T03:40:12.706465+0000","last_active":"2024-04-19T03:40:13.444599+0000","last_peered":"2024-04-19T03:40:13.444599+0000","last_clean":"2024-04-19T03:40:13.444599+0000","last_became_active":"2024-04-19T03:39:19.423589+0000","last_became_peered":"2024-04-19T03:39:19.423589+0000","last_unstale":"2024-04-19T03:40:13.444599+0000","last_undegraded":"2024-04-19T03:40:13.444599+0000","last_fullsized":"2024-04-19T03:40:13.444599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"93'6","last_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_deep_scrub":"93'6","last_deep_scrub_stamp":"2024-04-19T03:40:12.706336+0000","last_clean_scrub_stamp":"2024-04-19T03:40:12.706336+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:55.113200+0000","scrub_duration":0.0042115119999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"70'2049","reported_seq":2149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:05.337639+0000","last_change":"2024-04-19T03:41:05.337639+0000","last_active":"2024-04-19T03:41:05.337639+0000","last_peered":"2024-04-19T03:41:05.337639+0000","last_clean":"2024-04-19T03:41:05.337639+0000","last_became_active":"2024-04-19T03:39:43.435662+0000","last_became_peered":"2024-04-19T03:39:43.435662+0000","last_unstale":"2024-04-19T03:41:05.337639+0000","last_undegraded":"2024-04-19T03:41:05.337639+0000","last_fullsized":"2024-04-19T03:41:05.337639+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2049","last_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_deep_scrub":"70'2049","last_deep_scrub_stamp":"2024-04-19T03:41:05.337507+0000","last_clean_scrub_stamp":"2024-04-19T03:41:05.337507+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:11:19.212270+0000","scrub_duration":0.0024382739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6093,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"70'9","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:27.337549+0000","last_change":"2024-04-19T03:40:27.337549+0000","last_active":"2024-04-19T03:40:27.337549+0000","last_peered":"2024-04-19T03:40:27.337549+0000","last_clean":"2024-04-19T03:40:27.337549+0000","last_became_active":"2024-04-19T03:39:43.433006+0000","last_became_peered":"2024-04-19T03:39:43.433006+0000","last_unstale":"2024-04-19T03:40:27.337549+0000","last_undegraded":"2024-04-19T03:40:27.337549+0000","last_fullsized":"2024-04-19T03:40:27.337549+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'9","last_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_deep_scrub":"70'9","last_deep_scrub_stamp":"2024-04-19T03:40:27.337390+0000","last_clean_scrub_stamp":"2024-04-19T03:40:27.337390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:10.033965+0000","scrub_duration":0.0023860370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"70'12","reported_seq":113,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:12.011573+0000","last_change":"2024-04-19T03:41:12.011573+0000","last_active":"2024-04-19T03:41:12.011573+0000","last_peered":"2024-04-19T03:41:12.011573+0000","last_clean":"2024-04-19T03:41:12.011573+0000","last_became_active":"2024-04-19T03:35:59.882762+0000","last_became_peered":"2024-04-19T03:35:59.882762+0000","last_unstale":"2024-04-19T03:41:12.011573+0000","last_undegraded":"2024-04-19T03:41:12.011573+0000","last_fullsized":"2024-04-19T03:41:12.011573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'12","last_scrub_stamp":"2024-04-19T03:41:12.011372+0000","last_deep_scrub":"70'12","last_deep_scrub_stamp":"2024-04-19T03:41:12.011372+0000","last_clean_scrub_stamp":"2024-04-19T03:41:12.011372+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:20.950499+0000","scrub_duration":0.0034687899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"70'1976","reported_seq":2102,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:42:00.106570+0000","last_change":"2024-04-19T03:42:00.106570+0000","last_active":"2024-04-19T03:42:00.106570+0000","last_peered":"2024-04-19T03:42:00.106570+0000","last_clean":"2024-04-19T03:42:00.106570+0000","last_became_active":"2024-04-19T03:39:22.422935+0000","last_became_peered":"2024-04-19T03:39:22.422935+0000","last_unstale":"2024-04-19T03:42:00.106570+0000","last_undegraded":"2024-04-19T03:42:00.106570+0000","last_fullsized":"2024-04-19T03:42:00.106570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'1976","last_scrub_stamp":"2024-04-19T03:42:00.106431+0000","last_deep_scrub":"70'1976","last_deep_scrub_stamp":"2024-04-19T03:42:00.106431+0000","last_clean_scrub_stamp":"2024-04-19T03:42:00.106431+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:49:39.289948+0000","scrub_duration":0.0024767809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5835,"num_write_kb":28920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"70'2016","reported_seq":2117,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:41:17.008586+0000","last_change":"2024-04-19T03:41:17.008586+0000","last_active":"2024-04-19T03:41:17.008586+0000","last_peered":"2024-04-19T03:41:17.008586+0000","last_clean":"2024-04-19T03:41:17.008586+0000","last_became_active":"2024-04-19T03:35:59.882029+0000","last_became_peered":"2024-04-19T03:35:59.882029+0000","last_unstale":"2024-04-19T03:41:17.008586+0000","last_undegraded":"2024-04-19T03:41:17.008586+0000","last_fullsized":"2024-04-19T03:41:17.008586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2016","last_scrub_stamp":"2024-04-19T03:41:17.008393+0000","last_deep_scrub":"70'2016","last_deep_scrub_stamp":"2024-04-19T03:41:17.008393+0000","last_clean_scrub_stamp":"2024-04-19T03:41:17.008393+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:15:22.430976+0000","scrub_duration":0.0034046279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5988,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"70'2053","reported_seq":2179,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-19T03:40:35.185736+0000","last_change":"2024-04-19T03:40:35.185736+0000","last_active":"2024-04-19T03:40:35.185736+0000","last_peered":"2024-04-19T03:40:35.185736+0000","last_clean":"2024-04-19T03:40:35.185736+0000","last_became_active":"2024-04-19T03:39:22.424621+0000","last_became_peered":"2024-04-19T03:39:22.424621+0000","last_unstale":"2024-04-19T03:40:35.185736+0000","last_undegraded":"2024-04-19T03:40:35.185736+0000","last_fullsized":"2024-04-19T03:40:35.185736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'2053","last_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_deep_scrub":"70'2053","last_deep_scrub_stamp":"2024-04-19T03:40:35.185586+0000","last_clean_scrub_stamp":"2024-04-19T03:40:35.185586+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:03.429934+0000","scrub_duration":0.0023438479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6122,"num_write_kb":30100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382691,"num_write_kb":1952574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115499,"ondisk_log_size":115499,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":286864,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":152,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":281408,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":573728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":77,"seq":330712481833,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47228,"kb_used_data":1652,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324612,"statfs":{"total":96636764160,"available":96588402688,"internally_reserved":0,"allocated":1691648,"data_stored":1258390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7121,"internal_metadata":46654511},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:42:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60499999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.38},{"interface":"front","average":{"1min":0.44,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.32500000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54600000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Apr 19 03:42:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.50700000000000001},"min":{"1min":0.39600000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58199999999999996,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.377,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60599999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.41099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369840,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":94002000,"statfs":{"total":96636764160,"available":96258048000,"internally_reserved":0,"allocated":1679360,"data_stored":1257168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.43099999999999999},"min":{"1min":0.29599999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.60499999999999998,"5min":1.087,"15min":1.087},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.34300000000000003,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Apr 19 03:42:24 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.375,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.61199999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.317,"15min":0.317},"max":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.58699999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738451,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378828,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":378046,"kb_avail":93993012,"statfs":{"total":96636764160,"available":96248844288,"internally_reserved":0,"allocated":790528,"data_stored":382380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":387119558},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:42:07 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.49399999999999999,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.54600000000000004,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42499999999999999,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.628,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Apr 19 03:42:26 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.63800000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.504},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.65400000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":285642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":286864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5527,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:42:34.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-19T03:42:35.049 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-19T03:42:35.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:42:35.461 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:42:35.462 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:35:59.859870+0000","modified":"2024-04-19T03:36:02.866201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6803/2772249024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2772249024},{"type":"v1","addr":"172.21.15.5:6803","nonce":2772249024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:42:35.464 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-19T03:42:35.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:42:35.895 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:42:35.895 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:35:59.859870+0000","modified":"2024-04-19T03:36:02.866201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6803/2772249024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2772249024},{"type":"v1","addr":"172.21.15.5:6803","nonce":2772249024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:42:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-04-19T03:42:35.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:42:36.281 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-19T03:42:36.282 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":93,"fsid":"094bb330-e26a-42d1-b1be-7931c5493f05","created":"2024-04-19T03:35:44.411658+0000","modified":"2024-04-19T03:39:43.419100+0000","last_up_change":"2024-04-19T03:39:18.391293+0000","last_in_change":"2024-04-19T03:35:45.353224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-19T03:35:52.932739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-19T03:35:54.326287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:35:58.002172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:35:58.844614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7e36406-63c4-4d90-9e2d-6418a6750ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":40323},{"type":"v1","addr":"172.21.15.57:6801","nonce":40323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":40323},{"type":"v1","addr":"172.21.15.57:6803","nonce":40323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":40323},{"type":"v1","addr":"172.21.15.57:6807","nonce":40323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":40323},{"type":"v1","addr":"172.21.15.57:6805","nonce":40323}]},"public_addr":"172.21.15.57:6801/40323","cluster_addr":"172.21.15.57:6803/40323","heartbeat_back_addr":"172.21.15.57:6807/40323","heartbeat_front_addr":"172.21.15.57:6805/40323","state":["exists","up"]},{"osd":1,"uuid":"098c6748-6099-4f21-8443-fa1806e634c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":40278},{"type":"v1","addr":"172.21.15.87:6801","nonce":40278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":40278},{"type":"v1","addr":"172.21.15.87:6803","nonce":40278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":40278},{"type":"v1","addr":"172.21.15.87:6807","nonce":40278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":40278},{"type":"v1","addr":"172.21.15.87:6805","nonce":40278}]},"public_addr":"172.21.15.87:6801/40278","cluster_addr":"172.21.15.87:6803/40278","heartbeat_back_addr":"172.21.15.87:6807/40278","heartbeat_front_addr":"172.21.15.87:6805/40278","state":["exists","up"]},{"osd":2,"uuid":"05fd0106-3888-443d-b028-e3735dc03df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":19,"up_from":77,"up_thru":92,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":5986},{"type":"v1","addr":"172.21.15.129:6801","nonce":5986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":5986},{"type":"v1","addr":"172.21.15.129:6803","nonce":5986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":5986},{"type":"v1","addr":"172.21.15.129:6807","nonce":5986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":5986},{"type":"v1","addr":"172.21.15.129:6805","nonce":5986}]},"public_addr":"172.21.15.129:6801/5986","cluster_addr":"172.21.15.129:6803/5986","heartbeat_back_addr":"172.21.15.129:6807/5986","heartbeat_front_addr":"172.21.15.129:6805/5986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:51.441045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.410078+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:35:50.388216+0000","dead_epoch":19}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:42:36.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-19T03:42:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-19T03:42:36.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-19T03:42:36.749 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2024-04-19T03:42:37.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-19T03:42:39.047 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-04-19T03:42:39.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-19T03:42:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-04-19T03:42:40.064 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-19T03:42:40.065 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-19T03:42:40.065 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:42:40.075 INFO:tasks.ceph.mds.a:Stopped 2024-04-19T03:42:40.075 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-19T03:42:40.075 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-19T03:42:40.075 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:42:40.123 INFO:tasks.ceph.osd.0:Stopped 2024-04-19T03:42:40.124 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-19T03:42:40.124 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:42:40.167 INFO:tasks.ceph.osd.1:Stopped 2024-04-19T03:42:40.168 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-19T03:42:40.168 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:42:40.207 INFO:tasks.ceph.osd.2:Stopped 2024-04-19T03:42:40.207 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-19T03:42:40.207 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-19T03:42:40.207 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:42:40.238 INFO:tasks.ceph.mgr.x:Stopped 2024-04-19T03:42:40.238 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-19T03:42:40.238 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:42:40.307 INFO:tasks.ceph.mgr.y:Stopped 2024-04-19T03:42:40.308 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-19T03:42:40.308 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-19T03:42:40.308 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:42:40.362 INFO:tasks.ceph.mon.a:Stopped 2024-04-19T03:42:40.362 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-19T03:42:40.362 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:42:40.415 INFO:tasks.ceph.mon.b:Stopped 2024-04-19T03:42:40.416 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-19T03:42:40.416 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:42:40.470 INFO:tasks.ceph.mon.c:Stopped 2024-04-19T03:42:40.470 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-19T03:42:40.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-19T03:42:40.553 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-19T03:42:40.553 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-19T03:42:40.777 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-19T03:42:40.778 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-19T03:42:40.962 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi129.front.sepia.ceph.com 2024-04-19T03:42:40.962 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-19T03:42:41.102 INFO:tasks.ceph:Archiving mon data... 2024-04-19T03:42:41.103 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/data/mon.a.tgz 2024-04-19T03:42:41.104 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-04-19T03:42:41.126 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.oO7siw5u1p 2024-04-19T03:42:41.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.oO7siw5u1p 2024-04-19T03:42:41.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.oO7siw5u1p 2024-04-19T03:42:41.384 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.oO7siw5u1p is 427KB 2024-04-19T03:42:41.482 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.oO7siw5u1p 2024-04-19T03:42:41.503 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/data/mon.b.tgz 2024-04-19T03:42:41.503 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-04-19T03:42:41.564 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.h8fsjI73no 2024-04-19T03:42:41.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.h8fsjI73no 2024-04-19T03:42:41.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.h8fsjI73no 2024-04-19T03:42:41.850 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.h8fsjI73no is 578KB 2024-04-19T03:42:41.950 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.h8fsjI73no 2024-04-19T03:42:41.971 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/data/mon.c.tgz 2024-04-19T03:42:41.971 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-04-19T03:42:42.032 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.bACHNyArDA 2024-04-19T03:42:42.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.bACHNyArDA 2024-04-19T03:42:42.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.bACHNyArDA 2024-04-19T03:42:42.318 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.bACHNyArDA is 578KB 2024-04-19T03:42:42.394 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.bACHNyArDA 2024-04-19T03:42:42.414 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-19T03:42:42.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T03:42:42.456 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T03:42:42.458 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T03:42:42.461 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T03:42:42.511 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-19T03:42:42.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T03:42:42.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T03:42:42.535 DEBUG:teuthology.orchestra.run.smithi087:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T03:42:42.538 DEBUG:teuthology.orchestra.run.smithi129:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T03:42:42.564 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T03:42:42.567 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T03:42:42.568 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T03:42:42.586 INFO:teuthology.orchestra.run.smithi129.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T03:42:42.593 INFO:tasks.ceph:Archiving crash dumps... 2024-04-19T03:42:42.595 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi005/crash 2024-04-19T03:42:42.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T03:42:42.647 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi057/crash 2024-04-19T03:42:42.648 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T03:42:42.697 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi087/crash 2024-04-19T03:42:42.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T03:42:42.748 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi129/crash 2024-04-19T03:42:42.749 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T03:42:42.836 INFO:tasks.ceph:Compressing logs... 2024-04-19T03:42:42.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:42:42.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:42:42.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:42:42.844 DEBUG:teuthology.orchestra.run.smithi129:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:43:04.163 INFO:tasks.ceph:Archiving logs... 2024-04-19T03:43:04.163 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi005/log 2024-04-19T03:43:04.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T03:43:04.512 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi057/log 2024-04-19T03:43:04.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T03:43:06.822 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi087/log 2024-04-19T03:43:06.824 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T03:43:09.109 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi129/log 2024-04-19T03:43:09.110 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T03:43:09.288 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-19T03:43:09.298 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-19T03:43:09.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T03:43:09.301 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T03:43:09.304 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T03:43:09.306 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T03:43:09.414 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-19T03:43:09.423 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-19T03:43:09.424 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:43:09.426 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:43:09.429 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:43:09.431 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:43:09.444 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2024-04-19T03:43:09.447 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2024-04-19T03:43:09.448 INFO:teuthology.orchestra.run.smithi087.stderr:bash: ntpq: command not found 2024-04-19T03:43:09.448 INFO:teuthology.orchestra.run.smithi129.stderr:bash: ntpq: command not found 2024-04-19T03:43:09.450 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T03:43:09.450 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-04-19T03:43:09.450 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 2 +1354us[+1350us] +/- 66ms 2024-04-19T03:43:09.451 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv02.front.sepia.ceph.com 3 6 377 1 -1233us[-1237us] +/- 64ms 2024-04-19T03:43:09.451 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +19us[ +16us] +/- 62ms 2024-04-19T03:43:09.451 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:43:09.452 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T03:43:09.452 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-04-19T03:43:09.452 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 3 +1307us[+1308us] +/- 66ms 2024-04-19T03:43:09.452 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv02.front.sepia.ceph.com 3 6 377 0 -1268us[-1267us] +/- 64ms 2024-04-19T03:43:09.452 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 65 +5300ns[+6578ns] +/- 61ms 2024-04-19T03:43:09.452 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:43:09.454 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T03:43:09.454 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-04-19T03:43:09.454 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 3 +1323us[+1330us] +/- 66ms 2024-04-19T03:43:09.455 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv02.front.sepia.ceph.com 3 6 377 2 -1257us[-1250us] +/- 64ms 2024-04-19T03:43:09.455 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -560ns[+6416ns] +/- 62ms 2024-04-19T03:43:09.455 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:43:09.455 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-19T03:43:09.455 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-04-19T03:43:09.455 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv01.front.sepia.ceph.com 3 6 177 49 +1307us[+1303us] +/- 65ms 2024-04-19T03:43:09.455 INFO:teuthology.orchestra.run.smithi129.stdout:^* hv02.front.sepia.ceph.com 3 6 177 47 -1272us[-1276us] +/- 63ms 2024-04-19T03:43:09.455 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 47 -14us[ -14us] +/- 62ms 2024-04-19T03:43:09.455 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-19T03:43:09.455 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-19T03:43:09.464 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-19T03:43:09.465 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-19T03:43:09.522 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T03:43:09.604 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T03:43:09.688 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T03:43:09.765 DEBUG:teuthology.orchestra.run.smithi129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-19T03:43:09.902 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T03:43:09.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:43:09.942 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T03:43:09.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:43:09.981 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T03:43:10.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:43:10.015 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-19T03:43:10.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:43:10.049 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-19T03:43:10.060 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-19T03:43:10.097 INFO:teuthology.task.internal:Duration was 1258.923353 seconds 2024-04-19T03:43:10.097 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-19T03:43:10.164 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-19T03:43:10.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T03:43:10.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T03:43:10.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T03:43:10.172 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T03:43:10.223 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T03:43:10.224 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T03:43:10.227 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T03:43:10.253 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-19T03:43:10.607 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-19T03:43:10.607 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-04-19T03:43:10.607 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T03:43:10.635 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-04-19T03:43:10.635 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T03:43:10.664 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-04-19T03:43:10.664 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T03:43:10.690 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-04-19T03:43:10.690 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T03:43:10.716 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-19T03:43:10.716 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:43:10.719 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:43:10.721 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:43:10.733 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:43:10.836 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-19T03:43:10.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T03:43:10.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T03:43:10.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T03:43:10.844 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T03:43:10.951 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-19T03:43:10.962 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-19T03:43:10.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T03:43:10.993 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T03:43:11.024 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T03:43:11.052 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T03:43:11.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-19T03:43:11.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:43:11.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:43:11.105 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:43:11.107 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:43:11.132 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-04-19T03:43:11.134 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-04-19T03:43:11.136 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-04-19T03:43:11.167 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-04-19T03:43:11.196 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:43:11.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:43:11.217 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:43:11.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:43:11.238 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:43:11.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:43:11.254 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:43:11.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:43:11.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-19T03:43:11.282 INFO:teuthology.task.internal:Transferring archived files... 2024-04-19T03:43:11.283 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi005 2024-04-19T03:43:11.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T03:43:11.330 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi057 2024-04-19T03:43:11.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T03:43:11.376 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi087 2024-04-19T03:43:11.377 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T03:43:11.415 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662907/remote/smithi129 2024-04-19T03:43:11.415 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T03:43:11.457 INFO:teuthology.task.internal:Removing archive directory... 2024-04-19T03:43:11.457 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T03:43:11.459 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T03:43:11.462 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T03:43:11.464 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T03:43:11.510 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-19T03:43:11.523 INFO:teuthology.task.internal:Not uploading archives. 2024-04-19T03:43:11.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-19T03:43:11.556 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-19T03:43:11.556 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T03:43:11.559 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T03:43:11.561 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T03:43:11.564 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T03:43:11.577 INFO:teuthology.orchestra.run.smithi005.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 03:43 /home/ubuntu/cephtest 2024-04-19T03:43:11.578 INFO:teuthology.orchestra.run.smithi087.stdout: 262158 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 03:43 /home/ubuntu/cephtest 2024-04-19T03:43:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 03:43 /home/ubuntu/cephtest 2024-04-19T03:43:11.582 INFO:teuthology.orchestra.run.smithi129.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 03:43 /home/ubuntu/cephtest 2024-04-19T03:43:11.583 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-19T03:43:11.606 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-19T03:43:11.709 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} duration: 1258.9233531951904 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-19T03:43:11.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T03:43:11.790 INFO:teuthology.run:pass